2023-10-16T19:26:59.926 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T19:26:59.927 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071 --owner scheduled_rishabh@teuthology --verbose --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/orig.config.yaml 2023-10-16T19:26:59.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:27:00.047 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071 branch: rishabh-2023oct13 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: null first_in_suite: false job_id: '7430071' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-qa2 sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-qa2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_18:49:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T19:27:00.047 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa; will attempt to use it 2023-10-16T19:27:00.048 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks 2023-10-16T19:27:00.049 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T19:27:00.050 INFO:teuthology.task.internal:Checking packages... 2023-10-16T19:27:00.072 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T19:27:00.073 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T19:27:00.073 INFO:teuthology.packaging:ref: None 2023-10-16T19:27:00.073 INFO:teuthology.packaging:tag: None 2023-10-16T19:27:00.074 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T19:27:00.074 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:27:00.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T19:27:00.224 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T19:27:00.224 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T19:27:00.231 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T19:27:00.231 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T19:27:00.306 INFO:teuthology.task.internal:Saving configuration 2023-10-16T19:27:00.323 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T19:27:00.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:27:00.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:21:42.649852', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:27:00.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:21:42.648263', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:27:00.379 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T19:27:00.385 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-16T19:27:00.385 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-10-16T19:27:00.385 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T19:27:00.468 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6777399d0>, signals=[15]) 2023-10-16T19:27:00.469 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T19:27:00.474 INFO:teuthology.task.internal:Opening connections... 2023-10-16T19:27:00.475 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:27:00.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:27:00.545 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:27:00.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:27:00.613 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T19:27:00.620 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-10-16T19:27:00.642 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-10-16T19:27:00.642 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-16T19:27:00.702 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:27:00.702 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:27:00.702 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-10-16T19:27:00.703 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-10-16T19:27:00.703 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-10-16T19:27:00.703 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:27:00.703 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:27:00.703 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-10-16T19:27:00.704 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:27:00.704 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:27:00.704 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:27:00.704 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:27:00.704 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:27:00.705 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:27:00.705 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:27:00.705 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:27:00.705 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:27:00.706 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-16T19:27:00.732 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-10-16T19:27:00.753 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-10-16T19:27:00.754 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-10-16T19:27:00.814 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:27:00.814 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:27:00.814 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-10-16T19:27:00.814 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-10-16T19:27:00.815 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-10-16T19:27:00.815 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:27:00.815 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:27:00.815 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-10-16T19:27:00.815 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:27:00.816 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:27:00.816 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:27:00.816 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:27:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:27:00.816 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:27:00.817 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:27:00.817 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:27:00.817 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:27:00.817 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-10-16T19:27:00.839 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T19:27:00.848 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T19:27:00.889 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T19:27:00.889 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:27:00.893 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:27:00.912 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T19:27:00.918 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T19:27:00.919 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:27:00.952 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:27:01.033 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T19:27:01.090 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T19:27:01.105 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T19:27:01.106 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2023-10-16T19:27:01.106 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-16T19:27:01.106 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:27:01.107 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:27:01.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:27:01.127 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-16T19:27:01.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:27:01.128 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-10-16T19:27:01.187 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:01.187 INFO:teuthology.task.kernel:Running kernel on smithi029: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:01.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2023-10-16T19:27:01.189 INFO:teuthology.orchestra.run.smithi053.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:01.189 INFO:teuthology.task.kernel:Running kernel on smithi053: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:01.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2023-10-16T19:27:02.352 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:02.352 INFO:teuthology.orchestra.run.smithi053.stdout:Unable to read consumer identity 2023-10-16T19:27:02.791 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:02.792 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-16T19:27:03.917 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-10-16T19:27:04.892 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-16T19:27:05.437 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-16T19:27:06.289 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-16T19:27:08.734 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 517 kB/s | 24 kB 00:00 2023-10-16T19:27:09.419 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:27:09.479 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-10-16T19:27:09.480 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2023-10-16T19:27:09.481 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-10-16T19:27:09.620 DEBUG:teuthology.orchestra.run.smithi053:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:27:09.990 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 423 kB/s | 24 kB 00:00 2023-10-16T19:27:10.011 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:10.011 INFO:teuthology.orchestra.run.smithi053.stdout:Unable to read consumer identity 2023-10-16T19:27:10.284 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:27:08 PM UTC. 2023-10-16T19:27:10.328 INFO:teuthology.orchestra.run.smithi053.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:27:10.364 INFO:teuthology.orchestra.run.smithi053.stderr:Error: No packages marked for reinstall. 2023-10-16T19:27:10.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum reinstall -y kernel || true 2023-10-16T19:27:10.754 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:27:10.761 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:10.761 INFO:teuthology.orchestra.run.smithi053.stdout:Unable to read consumer identity 2023-10-16T19:27:10.847 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-16T19:27:10.848 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-10-16T19:27:10.848 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-16T19:27:10.980 DEBUG:teuthology.orchestra.run.smithi029:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:27:11.030 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:03 ago on Mon 16 Oct 2023 07:27:08 PM UTC. 2023-10-16T19:27:11.073 INFO:teuthology.orchestra.run.smithi053.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:27:11.096 INFO:teuthology.orchestra.run.smithi053.stderr:Error: No packages marked for reinstall. 2023-10-16T19:27:11.148 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:27:11.232 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:11.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:11.232 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:27:11.233 DEBUG:teuthology.parallel:result is None 2023-10-16T19:27:11.332 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:11.333 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-16T19:27:11.610 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:27:09 PM UTC. 2023-10-16T19:27:11.662 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:27:11.709 INFO:teuthology.orchestra.run.smithi029.stderr:Error: No packages marked for reinstall. 2023-10-16T19:27:11.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum reinstall -y kernel || true 2023-10-16T19:27:12.107 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-16T19:27:12.108 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-16T19:27:12.374 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:03 ago on Mon 16 Oct 2023 07:27:09 PM UTC. 2023-10-16T19:27:12.416 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:27:12.448 INFO:teuthology.orchestra.run.smithi029.stderr:Error: No packages marked for reinstall. 2023-10-16T19:27:12.494 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:27:12.578 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:12.578 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:27:12.578 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:27:12.579 DEBUG:teuthology.parallel:result is None 2023-10-16T19:27:12.579 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T19:27:12.585 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T19:27:12.585 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:27:12.588 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:27:12.608 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T19:27:12.621 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T19:27:12.646 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T19:27:12.647 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:27:12.649 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:27:12.684 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T19:27:12.691 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T19:27:12.691 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:27:12.707 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:27:12.737 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:27:12.750 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:27:12.758 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:27:12.771 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:27:12.773 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T19:27:12.784 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T19:27:12.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:27:12.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:27:12.844 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T19:27:12.853 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T19:27:12.854 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:27:12.861 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:27:12.902 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:27:12.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:27:13.020 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:27:13.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:27:13.104 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:27:13.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:27:13.178 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:27:13.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:27:13.279 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:27:13.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:27:13.411 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:27:13.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:27:13.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-10-16T19:27:13.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-10-16T19:27:13.551 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:27:13.623 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:27:13.868 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T19:27:13.879 INFO:teuthology.task.internal:Starting timer... 2023-10-16T19:27:13.880 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T19:27:13.922 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T19:27:13.954 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T19:27:13.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2023-10-16T19:27:14.007 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2023-10-16T19:27:14.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2023-10-16T19:27:14.070 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2023-10-16T19:27:14.072 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T19:27:14.072 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2023-10-16T19:27:14.093 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2023-10-16T19:27:14.093 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2023-10-16T19:27:14.118 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2023-10-16T19:27:14.119 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi053.front.sepia.ceph.com': 'permissive'} 2023-10-16T19:27:14.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:27:14.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:27:14.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:27:14.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:27:14.190 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T19:27:14.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:27:14.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:27:14.269 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T19:27:14.279 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T19:27:14.286 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T19:27:14.396 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T19:27:14.413 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T19:27:14.414 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi053.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T19:36:21.579 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi053.front.sepia.ceph.com')] 2023-10-16T19:36:21.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-16T19:36:21.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:36:21.653 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-16T19:36:21.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-16T19:36:21.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-10-16T19:36:21.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:36:21.790 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-10-16T19:36:21.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-10-16T19:36:21.857 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T19:36:21.870 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T19:36:21.870 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:36:21.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:36:21.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:36:21.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:36:21.905 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:36:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:36:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:36:21.946 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:36:21.999 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2023-10-16T19:36:22.012 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2023-10-16T19:36:22.025 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2023-10-16T19:36:22.027 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:36:22.038 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2023-10-16T19:36:22.042 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:36:22.053 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:36:22.067 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:36:22.119 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-10-16T19:36:22.123 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:36:22.123 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-10-16T19:36:22.123 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.123 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.124 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.124 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.142 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-10-16T19:36:22.146 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:36:22.146 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-10-16T19:36:22.146 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.146 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.147 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.147 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:36:22.148 INFO:teuthology.run_tasks:Running task install... 2023-10-16T19:36:22.157 DEBUG:teuthology.task.install:project ceph 2023-10-16T19:36:22.158 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T19:36:22.158 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T19:36:22.158 INFO:teuthology.task.install:Using flavor: default 2023-10-16T19:36:22.167 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T19:36:22.168 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T19:36:22.169 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:36:22.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:36:22.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:36:22.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:36:22.333 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T19:36:22.333 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:36:22.404 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T19:36:22.405 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:36:22.516 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:36:22.516 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:36:22.517 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:36:22.520 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:36:22.520 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:36:22.520 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:36:22.546 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:36:22.547 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:36:22.550 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:36:22.550 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:36:22.616 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:36:22.619 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:36:22.695 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:36:22.698 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:36:22.762 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2023-10-16T19:36:22.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2023-10-16T19:36:22.765 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2023-10-16T19:36:22.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2023-10-16T19:36:23.154 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-16T19:36:23.156 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-10-16T19:36:23.470 INFO:teuthology.orchestra.run.smithi029.stdout:44 files removed 2023-10-16T19:36:23.478 INFO:teuthology.orchestra.run.smithi053.stdout:44 files removed 2023-10-16T19:36:23.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:36:23.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:36:23.868 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-16T19:36:23.875 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-10-16T19:36:24.626 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 267 kB/s | 81 kB 00:00 2023-10-16T19:36:24.629 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 257 kB/s | 81 kB 00:00 2023-10-16T19:36:24.896 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-10-16T19:36:24.971 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-10-16T19:36:25.306 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-16T19:36:25.380 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-16T19:36:25.566 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-16T19:36:25.648 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-10-16T19:36:26.465 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-16T19:36:27.287 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2023-10-16T19:36:30.240 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 565 kB/s | 24 kB 00:00 2023-10-16T19:36:30.963 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-10-16T19:36:31.259 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 MB/s | 53 MB 00:00 2023-10-16T19:36:32.307 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 42 MB/s | 53 MB 00:01 2023-10-16T19:36:39.968 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-16T19:36:41.393 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-10-16T19:36:51.584 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:36:51.584 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:36:51.599 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T19:36:51.601 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T19:36:51.602 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T19:36:51.603 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T19:36:51.605 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T19:36:51.608 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T19:36:51.609 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T19:36:51.754 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-10-16T19:36:51.767 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-10-16T19:36:51.768 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2023-10-16T19:36:51.768 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-10-16T19:36:51.768 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2023-10-16T19:36:51.768 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T19:36:51.768 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T19:36:51.769 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T19:36:51.770 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T19:36:51.770 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T19:36:51.770 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T19:36:51.770 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T19:36:51.770 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T19:36:51.771 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T19:36:51.771 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T19:36:51.771 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T19:36:51.771 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T19:36:51.771 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T19:36:51.772 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T19:36:51.773 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T19:36:51.773 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T19:36:51.773 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T19:36:51.773 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T19:36:51.773 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T19:36:51.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T19:36:51.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T19:36:51.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T19:36:51.774 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T19:36:51.774 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T19:36:51.775 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:36:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:36:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2023-10-16T19:36:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T19:36:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T19:36:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T19:36:51.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T19:36:51.778 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T19:36:51.778 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T19:36:51.778 INFO:teuthology.orchestra.run.smithi053.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T19:36:51.778 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T19:36:51.778 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T19:36:51.779 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T19:36:51.779 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T19:36:51.779 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T19:36:51.779 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T19:36:51.779 INFO:teuthology.orchestra.run.smithi053.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T19:36:51.780 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T19:36:51.781 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T19:36:51.781 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T19:36:51.781 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T19:36:51.781 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T19:36:51.781 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T19:36:51.782 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T19:36:51.783 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T19:36:51.783 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T19:36:51.783 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T19:36:51.783 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T19:36:51.783 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T19:36:51.784 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T19:36:51.785 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T19:36:51.785 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T19:36:51.785 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T19:36:51.785 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T19:36:51.785 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T19:36:51.786 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T19:36:51.787 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T19:36:51.787 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T19:36:51.787 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T19:36:51.787 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T19:36:51.787 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T19:36:51.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T19:36:51.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T19:36:51.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T19:36:51.790 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T19:36:51.790 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T19:36:51.790 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T19:36:51.791 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T19:36:51.791 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T19:36:51.791 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T19:36:51.791 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:36:51.791 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T19:36:51.792 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T19:36:51.793 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T19:36:51.793 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T19:36:51.793 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T19:36:51.793 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T19:36:51.793 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T19:36:51.794 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T19:36:51.794 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T19:36:51.794 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T19:36:51.794 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T19:36:51.794 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T19:36:51.795 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T19:36:51.795 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling module streams: 2023-10-16T19:36:51.795 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql 10 2023-10-16T19:36:51.795 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:36:51.795 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-10-16T19:36:51.796 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-10-16T19:36:51.796 INFO:teuthology.orchestra.run.smithi053.stdout:Install 128 Packages 2023-10-16T19:36:51.796 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 3 Packages 2023-10-16T19:36:51.796 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:36:51.797 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 209 M 2023-10-16T19:36:51.797 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2023-10-16T19:36:52.076 INFO:teuthology.orchestra.run.smithi053.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 53 kB/s | 6.4 kB 00:00 2023-10-16T19:36:52.252 INFO:teuthology.orchestra.run.smithi053.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 5.2 MB/s | 918 kB 00:00 2023-10-16T19:36:52.302 INFO:teuthology.orchestra.run.smithi053.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 3.3 MB/s | 167 kB 00:00 2023-10-16T19:36:52.469 INFO:teuthology.orchestra.run.smithi053.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 14 MB/s | 2.3 MB 00:00 2023-10-16T19:36:52.628 INFO:teuthology.orchestra.run.smithi053.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 10 MB/s | 1.6 MB 00:00 2023-10-16T19:36:52.995 INFO:teuthology.orchestra.run.smithi053.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 13 MB/s | 4.6 MB 00:00 2023-10-16T19:36:53.096 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:36:53.097 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:36:53.112 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T19:36:53.113 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T19:36:53.114 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T19:36:53.115 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T19:36:53.118 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T19:36:53.121 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T19:36:53.122 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T19:36:53.247 INFO:teuthology.orchestra.run.smithi053.stdout:(7/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 4.2 MB/s | 5.4 MB 00:01 2023-10-16T19:36:53.262 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-16T19:36:53.276 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================================================== 2023-10-16T19:36:53.276 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-10-16T19:36:53.276 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================================================== 2023-10-16T19:36:53.277 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-10-16T19:36:53.277 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T19:36:53.277 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T19:36:53.278 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T19:36:53.278 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T19:36:53.278 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T19:36:53.279 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T19:36:53.279 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T19:36:53.279 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T19:36:53.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T19:36:53.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T19:36:53.281 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T19:36:53.281 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T19:36:53.281 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T19:36:53.281 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T19:36:53.282 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T19:36:53.282 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T19:36:53.283 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T19:36:53.283 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T19:36:53.283 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T19:36:53.283 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T19:36:53.284 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T19:36:53.284 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T19:36:53.284 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T19:36:53.285 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T19:36:53.285 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T19:36:53.285 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T19:36:53.286 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T19:36:53.286 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T19:36:53.286 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T19:36:53.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T19:36:53.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T19:36:53.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T19:36:53.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T19:36:53.288 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T19:36:53.288 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T19:36:53.288 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T19:36:53.289 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T19:36:53.289 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2023-10-16T19:36:53.289 INFO:teuthology.orchestra.run.smithi029.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T19:36:53.290 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:36:53.290 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:36:53.290 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-10-16T19:36:53.291 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T19:36:53.291 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T19:36:53.291 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T19:36:53.291 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T19:36:53.292 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T19:36:53.292 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T19:36:53.292 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T19:36:53.292 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T19:36:53.292 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T19:36:53.293 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T19:36:53.293 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T19:36:53.293 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T19:36:53.293 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T19:36:53.293 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T19:36:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T19:36:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T19:36:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T19:36:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T19:36:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T19:36:53.295 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T19:36:53.296 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T19:36:53.296 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T19:36:53.296 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T19:36:53.296 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T19:36:53.296 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T19:36:53.297 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T19:36:53.297 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T19:36:53.297 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T19:36:53.297 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T19:36:53.297 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T19:36:53.298 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T19:36:53.298 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T19:36:53.298 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T19:36:53.298 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T19:36:53.298 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T19:36:53.299 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T19:36:53.299 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T19:36:53.299 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T19:36:53.299 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T19:36:53.299 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T19:36:53.300 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T19:36:53.300 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T19:36:53.300 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T19:36:53.300 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T19:36:53.300 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T19:36:53.301 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T19:36:53.301 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T19:36:53.301 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T19:36:53.301 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:36:53.301 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T19:36:53.302 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T19:36:53.302 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T19:36:53.302 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T19:36:53.303 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T19:36:53.303 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T19:36:53.303 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T19:36:53.304 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T19:36:53.304 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T19:36:53.304 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T19:36:53.305 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T19:36:53.305 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T19:36:53.305 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T19:36:53.306 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T19:36:53.306 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T19:36:53.306 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T19:36:53.307 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T19:36:53.307 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T19:36:53.308 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:36:53.308 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T19:36:53.308 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T19:36:53.309 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T19:36:53.309 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T19:36:53.309 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T19:36:53.310 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T19:36:53.310 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T19:36:53.311 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T19:36:53.311 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T19:36:53.311 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T19:36:53.312 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T19:36:53.312 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T19:36:53.312 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T19:36:53.313 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T19:36:53.313 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T19:36:53.313 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T19:36:53.314 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T19:36:53.314 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T19:36:53.314 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling module streams: 2023-10-16T19:36:53.315 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql 10 2023-10-16T19:36:53.315 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:36:53.315 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-10-16T19:36:53.316 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================================================== 2023-10-16T19:36:53.316 INFO:teuthology.orchestra.run.smithi029.stdout:Install 128 Packages 2023-10-16T19:36:53.316 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 3 Packages 2023-10-16T19:36:53.317 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:36:53.318 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 209 M 2023-10-16T19:36:53.318 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-10-16T19:36:53.681 INFO:teuthology.orchestra.run.smithi029.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-16T19:36:54.379 INFO:teuthology.orchestra.run.smithi053.stdout:(8/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x86 13 MB/s | 18 MB 00:01 2023-10-16T19:36:54.406 INFO:teuthology.orchestra.run.smithi029.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.2 MB/s | 918 kB 00:00 2023-10-16T19:36:54.429 INFO:teuthology.orchestra.run.smithi053.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 488 kB/s | 24 kB 00:00 2023-10-16T19:36:54.532 INFO:teuthology.orchestra.run.smithi029.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.3 MB/s | 167 kB 00:00 2023-10-16T19:36:55.296 INFO:teuthology.orchestra.run.smithi053.stdout:(10/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 6.8 MB/s | 14 MB 00:02 2023-10-16T19:36:55.404 INFO:teuthology.orchestra.run.smithi053.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 261 kB 00:00 2023-10-16T19:36:55.513 INFO:teuthology.orchestra.run.smithi053.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 286 kB/s | 31 kB 00:00 2023-10-16T19:36:55.616 INFO:teuthology.orchestra.run.smithi029.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-16T19:36:55.714 INFO:teuthology.orchestra.run.smithi053.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 4.1 MB/s | 839 kB 00:00 2023-10-16T19:36:55.806 INFO:teuthology.orchestra.run.smithi053.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.0 MB/s | 184 kB 00:00 2023-10-16T19:36:55.906 INFO:teuthology.orchestra.run.smithi053.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 139 kB 00:00 2023-10-16T19:36:56.031 INFO:teuthology.orchestra.run.smithi053.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 4.1 MB/s | 518 kB 00:00 2023-10-16T19:36:56.049 INFO:teuthology.orchestra.run.smithi029.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-16T19:36:56.964 INFO:teuthology.orchestra.run.smithi053.stdout:(17/131): ceph-common-18.0.0-6730.g4ba8a190.el8 4.5 MB/s | 23 MB 00:05 2023-10-16T19:36:57.009 INFO:teuthology.orchestra.run.smithi029.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 4.8 MB/s | 4.6 MB 00:00 2023-10-16T19:36:57.065 INFO:teuthology.orchestra.run.smithi053.stdout:(18/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 6.7 MB/s | 6.9 MB 00:01 2023-10-16T19:36:57.090 INFO:teuthology.orchestra.run.smithi053.stdout:(19/131): python3-ceph-argparse-18.0.0-6730.g4b 358 kB/s | 45 kB 00:00 2023-10-16T19:36:57.117 INFO:teuthology.orchestra.run.smithi029.stdout:(7/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-10-16T19:36:57.157 INFO:teuthology.orchestra.run.smithi053.stdout:(20/131): python3-ceph-common-18.0.0-6730.g4ba8 1.3 MB/s | 126 kB 00:00 2023-10-16T19:36:57.299 INFO:teuthology.orchestra.run.smithi053.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.6 MB/s | 371 kB 00:00 2023-10-16T19:36:57.324 INFO:teuthology.orchestra.run.smithi053.stdout:(22/131): python3-cephfs-18.0.0-6730.g4ba8a190. 843 kB/s | 197 kB 00:00 2023-10-16T19:36:57.466 INFO:teuthology.orchestra.run.smithi053.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 753 kB/s | 107 kB 00:00 2023-10-16T19:36:57.600 INFO:teuthology.orchestra.run.smithi053.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 701 kB/s | 94 kB 00:00 2023-10-16T19:36:57.625 INFO:teuthology.orchestra.run.smithi053.stdout:(25/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 1.1 MB/s | 365 kB 00:00 2023-10-16T19:36:57.767 INFO:teuthology.orchestra.run.smithi053.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.2 MB/s | 179 kB 00:00 2023-10-16T19:36:57.892 INFO:teuthology.orchestra.run.smithi053.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 185 kB/s | 23 kB 00:00 2023-10-16T19:36:58.009 INFO:teuthology.orchestra.run.smithi053.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.1 MB/s | 132 kB 00:00 2023-10-16T19:36:58.427 INFO:teuthology.orchestra.run.smithi053.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.2 MB/s | 1.8 MB 00:00 2023-10-16T19:36:58.752 INFO:teuthology.orchestra.run.smithi053.stdout:(30/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 3.1 MB/s | 3.6 MB 00:01 2023-10-16T19:36:58.909 INFO:teuthology.orchestra.run.smithi029.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 4.1 MB/s | 23 MB 00:05 2023-10-16T19:36:58.994 INFO:teuthology.orchestra.run.smithi053.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.0 MB/s | 242 kB 00:00 2023-10-16T19:36:59.086 INFO:teuthology.orchestra.run.smithi053.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 519 kB/s | 47 kB 00:00 2023-10-16T19:36:59.171 INFO:teuthology.orchestra.run.smithi053.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 180 kB/s | 15 kB 00:00 2023-10-16T19:36:59.260 INFO:teuthology.orchestra.run.smithi029.stdout:(9/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x86 8.0 MB/s | 18 MB 00:02 2023-10-16T19:36:59.278 INFO:teuthology.orchestra.run.smithi053.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.4 MB/s | 261 kB 00:00 2023-10-16T19:36:59.294 INFO:teuthology.orchestra.run.smithi029.stdout:(10/131): ceph-selinux-18.0.0-6730.g4ba8a190.el 63 kB/s | 24 kB 00:00 2023-10-16T19:36:59.387 INFO:teuthology.orchestra.run.smithi053.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.7 MB/s | 192 kB 00:00 2023-10-16T19:36:59.504 INFO:teuthology.orchestra.run.smithi053.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 155 kB/s | 18 kB 00:00 2023-10-16T19:36:59.521 INFO:teuthology.orchestra.run.smithi029.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.1 MB/s | 261 kB 00:00 2023-10-16T19:36:59.654 INFO:teuthology.orchestra.run.smithi053.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.0 MB/s | 7.4 MB 00:01 2023-10-16T19:37:00.029 INFO:teuthology.orchestra.run.smithi029.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 61 kB/s | 31 kB 00:00 2023-10-16T19:37:00.130 INFO:teuthology.orchestra.run.smithi053.stdout:(38/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 8.6 MB/s | 49 MB 00:05 2023-10-16T19:37:00.263 INFO:teuthology.orchestra.run.smithi053.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 404 kB/s | 306 kB 00:00 2023-10-16T19:37:00.313 INFO:teuthology.orchestra.run.smithi053.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 89 kB/s | 59 kB 00:00 2023-10-16T19:37:00.314 INFO:teuthology.orchestra.run.smithi029.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 2.9 MB/s | 839 kB 00:00 2023-10-16T19:37:00.380 INFO:teuthology.orchestra.run.smithi053.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 300 kB/s | 75 kB 00:00 2023-10-16T19:37:00.414 INFO:teuthology.orchestra.run.smithi053.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 435 kB/s | 44 kB 00:00 2023-10-16T19:37:00.415 INFO:teuthology.orchestra.run.smithi029.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.8 MB/s | 184 kB 00:00 2023-10-16T19:37:00.447 INFO:teuthology.orchestra.run.smithi053.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-10-16T19:37:00.515 INFO:teuthology.orchestra.run.smithi029.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 139 kB 00:00 2023-10-16T19:37:00.522 INFO:teuthology.orchestra.run.smithi053.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-16T19:37:00.539 INFO:teuthology.orchestra.run.smithi053.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 263 kB/s | 33 kB 00:00 2023-10-16T19:37:00.556 INFO:teuthology.orchestra.run.smithi053.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-16T19:37:00.623 INFO:teuthology.orchestra.run.smithi053.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-16T19:37:00.674 INFO:teuthology.orchestra.run.smithi053.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 695 kB/s | 81 kB 00:00 2023-10-16T19:37:00.690 INFO:teuthology.orchestra.run.smithi029.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 2.9 MB/s | 518 kB 00:00 2023-10-16T19:37:00.716 INFO:teuthology.orchestra.run.smithi053.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-10-16T19:37:00.749 INFO:teuthology.orchestra.run.smithi053.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-10-16T19:37:00.774 INFO:teuthology.orchestra.run.smithi053.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-10-16T19:37:00.841 INFO:teuthology.orchestra.run.smithi053.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 530 kB/s | 49 kB 00:00 2023-10-16T19:37:00.867 INFO:teuthology.orchestra.run.smithi053.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2023-10-16T19:37:00.934 INFO:teuthology.orchestra.run.smithi053.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2023-10-16T19:37:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 514 kB/s | 60 kB 00:00 2023-10-16T19:37:01.009 INFO:teuthology.orchestra.run.smithi053.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-16T19:37:01.051 INFO:teuthology.orchestra.run.smithi053.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-10-16T19:37:01.085 INFO:teuthology.orchestra.run.smithi053.stdout:(58/131): python3-portend-2.6-1.el8.noarch.rpm 103 kB/s | 16 kB 00:00 2023-10-16T19:37:01.127 INFO:teuthology.orchestra.run.smithi053.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-10-16T19:37:01.153 INFO:teuthology.orchestra.run.smithi053.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 637 kB/s | 64 kB 00:00 2023-10-16T19:37:01.202 INFO:teuthology.orchestra.run.smithi053.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-16T19:37:01.227 INFO:teuthology.orchestra.run.smithi053.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-16T19:37:01.253 INFO:teuthology.orchestra.run.smithi053.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-10-16T19:37:01.303 INFO:teuthology.orchestra.run.smithi053.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-16T19:37:01.345 INFO:teuthology.orchestra.run.smithi053.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-16T19:37:01.395 INFO:teuthology.orchestra.run.smithi053.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-16T19:37:01.421 INFO:teuthology.orchestra.run.smithi053.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 522 kB/s | 61 kB 00:00 2023-10-16T19:37:01.446 INFO:teuthology.orchestra.run.smithi053.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 849 kB/s | 85 kB 00:00 2023-10-16T19:37:01.471 INFO:teuthology.orchestra.run.smithi053.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T19:37:01.513 INFO:teuthology.orchestra.run.smithi053.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2023-10-16T19:37:01.538 INFO:teuthology.orchestra.run.smithi053.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 701 kB/s | 47 kB 00:00 2023-10-16T19:37:01.589 INFO:teuthology.orchestra.run.smithi053.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-16T19:37:01.614 INFO:teuthology.orchestra.run.smithi053.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-10-16T19:37:01.656 INFO:teuthology.orchestra.run.smithi053.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-10-16T19:37:01.681 INFO:teuthology.orchestra.run.smithi053.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 719 kB/s | 48 kB 00:00 2023-10-16T19:37:01.715 INFO:teuthology.orchestra.run.smithi053.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-16T19:37:01.740 INFO:teuthology.orchestra.run.smithi053.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 855 kB/s | 43 kB 00:00 2023-10-16T19:37:01.757 INFO:teuthology.orchestra.run.smithi053.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 864 kB/s | 87 kB 00:00 2023-10-16T19:37:01.774 INFO:teuthology.orchestra.run.smithi053.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-10-16T19:37:01.833 INFO:teuthology.orchestra.run.smithi053.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-10-16T19:37:01.858 INFO:teuthology.orchestra.run.smithi053.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 224 kB/s | 19 kB 00:00 2023-10-16T19:37:01.883 INFO:teuthology.orchestra.run.smithi053.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-16T19:37:01.916 INFO:teuthology.orchestra.run.smithi053.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-10-16T19:37:01.934 INFO:teuthology.orchestra.run.smithi053.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-10-16T19:37:01.967 INFO:teuthology.orchestra.run.smithi053.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-10-16T19:37:01.993 INFO:teuthology.orchestra.run.smithi053.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-16T19:37:02.018 INFO:teuthology.orchestra.run.smithi053.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-10-16T19:37:02.043 INFO:teuthology.orchestra.run.smithi053.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-16T19:37:02.069 INFO:teuthology.orchestra.run.smithi053.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T19:37:02.094 INFO:teuthology.orchestra.run.smithi053.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-16T19:37:02.119 INFO:teuthology.orchestra.run.smithi053.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-16T19:37:02.144 INFO:teuthology.orchestra.run.smithi053.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-16T19:37:02.170 INFO:teuthology.orchestra.run.smithi053.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-10-16T19:37:02.212 INFO:teuthology.orchestra.run.smithi053.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-10-16T19:37:02.237 INFO:teuthology.orchestra.run.smithi053.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-16T19:37:02.262 INFO:teuthology.orchestra.run.smithi053.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-16T19:37:02.304 INFO:teuthology.orchestra.run.smithi053.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-16T19:37:02.346 INFO:teuthology.orchestra.run.smithi053.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.1 MB/s | 2.3 MB 00:00 2023-10-16T19:37:02.371 INFO:teuthology.orchestra.run.smithi053.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-10-16T19:37:02.405 INFO:teuthology.orchestra.run.smithi053.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-16T19:37:02.460 INFO:teuthology.orchestra.run.smithi053.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.6 MB/s | 323 kB 00:00 2023-10-16T19:37:02.481 INFO:teuthology.orchestra.run.smithi053.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 516 kB/s | 39 kB 00:00 2023-10-16T19:37:02.522 INFO:teuthology.orchestra.run.smithi053.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-16T19:37:02.556 INFO:teuthology.orchestra.run.smithi053.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-16T19:37:02.566 INFO:teuthology.orchestra.run.smithi029.stdout:(17/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 3.7 MB/s | 6.9 MB 00:01 2023-10-16T19:37:02.581 INFO:teuthology.orchestra.run.smithi053.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-16T19:37:02.607 INFO:teuthology.orchestra.run.smithi053.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-16T19:37:02.649 INFO:teuthology.orchestra.run.smithi053.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-16T19:37:02.666 INFO:teuthology.orchestra.run.smithi029.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 447 kB/s | 45 kB 00:00 2023-10-16T19:37:02.674 INFO:teuthology.orchestra.run.smithi053.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-10-16T19:37:02.716 INFO:teuthology.orchestra.run.smithi053.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-16T19:37:02.749 INFO:teuthology.orchestra.run.smithi053.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-16T19:37:02.767 INFO:teuthology.orchestra.run.smithi029.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.2 MB/s | 126 kB 00:00 2023-10-16T19:37:02.858 INFO:teuthology.orchestra.run.smithi053.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-16T19:37:02.867 INFO:teuthology.orchestra.run.smithi029.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.9 MB/s | 197 kB 00:00 2023-10-16T19:37:02.908 INFO:teuthology.orchestra.run.smithi053.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-10-16T19:37:02.975 INFO:teuthology.orchestra.run.smithi053.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-16T19:37:03.000 INFO:teuthology.orchestra.run.smithi053.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2023-10-16T19:37:03.026 INFO:teuthology.orchestra.run.smithi053.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-10-16T19:37:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 371 kB 00:00 2023-10-16T19:37:03.051 INFO:teuthology.orchestra.run.smithi053.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-16T19:37:03.104 INFO:teuthology.orchestra.run.smithi053.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 256 kB/s | 20 kB 00:00 2023-10-16T19:37:03.127 INFO:teuthology.orchestra.run.smithi053.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.3 MB/s | 103 kB 00:00 2023-10-16T19:37:03.177 INFO:teuthology.orchestra.run.smithi053.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.5 MB/s | 709 kB 00:00 2023-10-16T19:37:03.202 INFO:teuthology.orchestra.run.smithi029.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.1 MB/s | 365 kB 00:00 2023-10-16T19:37:03.219 INFO:teuthology.orchestra.run.smithi053.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-16T19:37:03.303 INFO:teuthology.orchestra.run.smithi029.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.0 MB/s | 107 kB 00:00 2023-10-16T19:37:03.361 INFO:teuthology.orchestra.run.smithi053.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-10-16T19:37:03.403 INFO:teuthology.orchestra.run.smithi053.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-16T19:37:03.403 INFO:teuthology.orchestra.run.smithi029.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 936 kB/s | 94 kB 00:00 2023-10-16T19:37:03.445 INFO:teuthology.orchestra.run.smithi053.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T19:37:03.520 INFO:teuthology.orchestra.run.smithi053.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-10-16T19:37:03.579 INFO:teuthology.orchestra.run.smithi053.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-10-16T19:37:03.637 INFO:teuthology.orchestra.run.smithi053.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-10-16T19:37:03.696 INFO:teuthology.orchestra.run.smithi053.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-10-16T19:37:03.796 INFO:teuthology.orchestra.run.smithi053.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-10-16T19:37:03.846 INFO:teuthology.orchestra.run.smithi053.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T19:37:04.530 INFO:teuthology.orchestra.run.smithi029.stdout:(25/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 3.2 MB/s | 3.6 MB 00:01 2023-10-16T19:37:04.630 INFO:teuthology.orchestra.run.smithi029.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.8 MB/s | 179 kB 00:00 2023-10-16T19:37:04.723 INFO:teuthology.orchestra.run.smithi029.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 251 kB/s | 23 kB 00:00 2023-10-16T19:37:04.824 INFO:teuthology.orchestra.run.smithi029.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.3 MB/s | 132 kB 00:00 2023-10-16T19:37:04.989 INFO:teuthology.orchestra.run.smithi053.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 2.8 MB/s | 3.7 MB 00:01 2023-10-16T19:37:05.355 INFO:teuthology.orchestra.run.smithi053.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.2 MB/s | 3.7 MB 00:01 2023-10-16T19:37:05.358 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:37:05.358 INFO:teuthology.orchestra.run.smithi053.stdout:Total 15 MB/s | 209 MB 00:13 2023-10-16T19:37:05.466 INFO:teuthology.orchestra.run.smithi029.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 2.7 MB/s | 1.8 MB 00:00 2023-10-16T19:37:06.238 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2023-10-16T19:37:06.333 INFO:teuthology.orchestra.run.smithi029.stdout:(30/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 6.9 MB/s | 49 MB 00:07 2023-10-16T19:37:06.370 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2023-10-16T19:37:06.370 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2023-10-16T19:37:06.492 INFO:teuthology.orchestra.run.smithi029.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.5 MB/s | 242 kB 00:00 2023-10-16T19:37:06.551 INFO:teuthology.orchestra.run.smithi029.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 813 kB/s | 47 kB 00:00 2023-10-16T19:37:06.610 INFO:teuthology.orchestra.run.smithi029.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 256 kB/s | 15 kB 00:00 2023-10-16T19:37:06.685 INFO:teuthology.orchestra.run.smithi029.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 3.4 MB/s | 261 kB 00:00 2023-10-16T19:37:06.761 INFO:teuthology.orchestra.run.smithi029.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.5 MB/s | 192 kB 00:00 2023-10-16T19:37:06.828 INFO:teuthology.orchestra.run.smithi029.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 270 kB/s | 18 kB 00:00 2023-10-16T19:37:07.229 INFO:teuthology.orchestra.run.smithi029.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-10-16T19:37:07.321 INFO:teuthology.orchestra.run.smithi029.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 622 kB/s | 306 kB 00:00 2023-10-16T19:37:07.423 INFO:teuthology.orchestra.run.smithi029.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 738 kB/s | 75 kB 00:00 2023-10-16T19:37:07.507 INFO:teuthology.orchestra.run.smithi029.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 212 kB/s | 59 kB 00:00 2023-10-16T19:37:07.560 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2023-10-16T19:37:07.565 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2023-10-16T19:37:07.591 INFO:teuthology.orchestra.run.smithi029.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-10-16T19:37:07.616 INFO:teuthology.orchestra.run.smithi029.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 400 kB/s | 44 kB 00:00 2023-10-16T19:37:07.675 INFO:teuthology.orchestra.run.smithi029.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-16T19:37:07.709 INFO:teuthology.orchestra.run.smithi029.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 357 kB/s | 33 kB 00:00 2023-10-16T19:37:07.751 INFO:teuthology.orchestra.run.smithi029.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 215 kB/s | 16 kB 00:00 2023-10-16T19:37:07.868 INFO:teuthology.orchestra.run.smithi029.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-10-16T19:37:07.894 INFO:teuthology.orchestra.run.smithi029.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 935 kB/s | 173 kB 00:00 2023-10-16T19:37:07.945 INFO:teuthology.orchestra.run.smithi029.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2023-10-16T19:37:07.970 INFO:teuthology.orchestra.run.smithi029.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-16T19:37:08.021 INFO:teuthology.orchestra.run.smithi029.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 232 kB/s | 18 kB 00:00 2023-10-16T19:37:08.096 INFO:teuthology.orchestra.run.smithi029.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 648 kB/s | 49 kB 00:00 2023-10-16T19:37:08.172 INFO:teuthology.orchestra.run.smithi029.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 782 kB/s | 59 kB 00:00 2023-10-16T19:37:08.214 INFO:teuthology.orchestra.run.smithi029.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-10-16T19:37:08.249 INFO:teuthology.orchestra.run.smithi029.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 779 kB/s | 60 kB 00:00 2023-10-16T19:37:08.537 INFO:teuthology.orchestra.run.smithi029.stdout:(55/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 1.2 MB/s | 14 MB 00:11 2023-10-16T19:37:08.567 INFO:teuthology.orchestra.run.smithi029.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 49 kB/s | 16 kB 00:00 2023-10-16T19:37:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 747 kB/s | 283 kB 00:00 2023-10-16T19:37:08.618 INFO:teuthology.orchestra.run.smithi029.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 417 kB/s | 34 kB 00:00 2023-10-16T19:37:08.669 INFO:teuthology.orchestra.run.smithi029.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 847 kB/s | 64 kB 00:00 2023-10-16T19:37:08.694 INFO:teuthology.orchestra.run.smithi029.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 263 kB/s | 19 kB 00:00 2023-10-16T19:37:08.745 INFO:teuthology.orchestra.run.smithi029.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-10-16T19:37:08.770 INFO:teuthology.orchestra.run.smithi029.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-10-16T19:37:08.821 INFO:teuthology.orchestra.run.smithi029.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 363 kB/s | 27 kB 00:00 2023-10-16T19:37:08.863 INFO:teuthology.orchestra.run.smithi029.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-10-16T19:37:08.905 INFO:teuthology.orchestra.run.smithi029.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-16T19:37:08.939 INFO:teuthology.orchestra.run.smithi029.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 810 kB/s | 61 kB 00:00 2023-10-16T19:37:08.973 INFO:teuthology.orchestra.run.smithi029.stdout:(67/131): python3-routes-2.4.1-12.el8.noarch.rp 484 kB/s | 196 kB 00:00 2023-10-16T19:37:08.998 INFO:teuthology.orchestra.run.smithi029.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 920 kB/s | 85 kB 00:00 2023-10-16T19:37:09.025 INFO:teuthology.orchestra.run.smithi029.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 267 kB/s | 23 kB 00:00 2023-10-16T19:37:09.059 INFO:teuthology.orchestra.run.smithi029.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.1 MB/s | 70 kB 00:00 2023-10-16T19:37:09.110 INFO:teuthology.orchestra.run.smithi029.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 557 kB/s | 47 kB 00:00 2023-10-16T19:37:09.144 INFO:teuthology.orchestra.run.smithi029.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-10-16T19:37:09.169 INFO:teuthology.orchestra.run.smithi029.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 720 kB/s | 43 kB 00:00 2023-10-16T19:37:09.212 INFO:teuthology.orchestra.run.smithi029.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-10-16T19:37:09.237 INFO:teuthology.orchestra.run.smithi029.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 714 kB/s | 48 kB 00:00 2023-10-16T19:37:09.262 INFO:teuthology.orchestra.run.smithi029.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T19:37:09.313 INFO:teuthology.orchestra.run.smithi029.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2023-10-16T19:37:09.339 INFO:teuthology.orchestra.run.smithi029.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 421 kB/s | 43 kB 00:00 2023-10-16T19:37:09.373 INFO:teuthology.orchestra.run.smithi029.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 996 kB/s | 109 kB 00:00 2023-10-16T19:37:09.406 INFO:teuthology.orchestra.run.smithi029.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-10-16T19:37:09.432 INFO:teuthology.orchestra.run.smithi029.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 316 kB/s | 19 kB 00:00 2023-10-16T19:37:09.466 INFO:teuthology.orchestra.run.smithi029.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-10-16T19:37:09.499 INFO:teuthology.orchestra.run.smithi029.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-10-16T19:37:09.525 INFO:teuthology.orchestra.run.smithi029.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 303 kB/s | 18 kB 00:00 2023-10-16T19:37:09.569 INFO:teuthology.orchestra.run.smithi029.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.0 MB/s | 559 kB 00:00 2023-10-16T19:37:09.611 INFO:teuthology.orchestra.run.smithi029.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2023-10-16T19:37:09.637 INFO:teuthology.orchestra.run.smithi029.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2023-10-16T19:37:09.662 INFO:teuthology.orchestra.run.smithi029.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-16T19:37:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T19:37:09.713 INFO:teuthology.orchestra.run.smithi029.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-16T19:37:09.747 INFO:teuthology.orchestra.run.smithi029.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-10-16T19:37:09.772 INFO:teuthology.orchestra.run.smithi029.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 979 kB/s | 58 kB 00:00 2023-10-16T19:37:09.798 INFO:teuthology.orchestra.run.smithi029.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 759 kB/s | 39 kB 00:00 2023-10-16T19:37:09.849 INFO:teuthology.orchestra.run.smithi029.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.3 MB/s | 644 kB 00:00 2023-10-16T19:37:09.883 INFO:teuthology.orchestra.run.smithi029.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-10-16T19:37:09.908 INFO:teuthology.orchestra.run.smithi029.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-10-16T19:37:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-16T19:37:10.018 INFO:teuthology.orchestra.run.smithi029.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.2 MB/s | 2.3 MB 00:00 2023-10-16T19:37:10.043 INFO:teuthology.orchestra.run.smithi029.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 586 kB/s | 54 kB 00:00 2023-10-16T19:37:10.110 INFO:teuthology.orchestra.run.smithi029.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.7 MB/s | 259 kB 00:00 2023-10-16T19:37:10.146 INFO:teuthology.orchestra.run.smithi029.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2023-10-16T19:37:10.171 INFO:teuthology.orchestra.run.smithi029.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 640 kB/s | 39 kB 00:00 2023-10-16T19:37:10.214 INFO:teuthology.orchestra.run.smithi029.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-16T19:37:10.256 INFO:teuthology.orchestra.run.smithi029.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.2 MB/s | 538 kB 00:00 2023-10-16T19:37:10.281 INFO:teuthology.orchestra.run.smithi029.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-16T19:37:10.307 INFO:teuthology.orchestra.run.smithi029.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-16T19:37:10.871 INFO:teuthology.orchestra.run.smithi029.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 1.2 MB/s | 713 kB 00:00 2023-10-16T19:37:10.908 INFO:teuthology.orchestra.run.smithi029.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 717 kB/s | 27 kB 00:00 2023-10-16T19:37:10.959 INFO:teuthology.orchestra.run.smithi029.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-10-16T19:37:11.001 INFO:teuthology.orchestra.run.smithi029.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-16T19:37:11.135 INFO:teuthology.orchestra.run.smithi029.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 5.8 MB/s | 4.8 MB 00:00 2023-10-16T19:37:11.193 INFO:teuthology.orchestra.run.smithi029.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-16T19:37:11.236 INFO:teuthology.orchestra.run.smithi029.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-16T19:37:11.319 INFO:teuthology.orchestra.run.smithi029.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-10-16T19:37:11.345 INFO:teuthology.orchestra.run.smithi029.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 587 kB/s | 64 kB 00:00 2023-10-16T19:37:11.372 INFO:teuthology.orchestra.run.smithi029.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.4 MB/s | 126 kB 00:00 2023-10-16T19:37:11.397 INFO:teuthology.orchestra.run.smithi029.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 382 kB/s | 20 kB 00:00 2023-10-16T19:37:11.423 INFO:teuthology.orchestra.run.smithi029.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-16T19:37:11.465 INFO:teuthology.orchestra.run.smithi029.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-16T19:37:11.516 INFO:teuthology.orchestra.run.smithi029.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-10-16T19:37:11.794 INFO:teuthology.orchestra.run.smithi029.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 7.2 MB/s | 14 MB 00:01 2023-10-16T19:37:11.850 INFO:teuthology.orchestra.run.smithi029.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.5 MB/s | 202 kB 00:00 2023-10-16T19:37:11.901 INFO:teuthology.orchestra.run.smithi029.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-16T19:37:12.035 INFO:teuthology.orchestra.run.smithi029.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 7.9 MB/s | 4.9 MB 00:00 2023-10-16T19:37:12.152 INFO:teuthology.orchestra.run.smithi029.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 7.4 MB/s | 4.7 MB 00:00 2023-10-16T19:37:12.202 INFO:teuthology.orchestra.run.smithi029.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.7 MB/s | 808 kB 00:00 2023-10-16T19:37:12.278 INFO:teuthology.orchestra.run.smithi029.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-16T19:37:12.387 INFO:teuthology.orchestra.run.smithi029.stdout:(128/131): postgresql-server-10.21-2.module+el8 10 MB/s | 5.1 MB 00:00 2023-10-16T19:37:12.446 INFO:teuthology.orchestra.run.smithi029.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-16T19:37:12.663 INFO:teuthology.orchestra.run.smithi029.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 8.1 MB/s | 3.7 MB 00:00 2023-10-16T19:37:12.764 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2023-10-16T19:37:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T19:37:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T19:37:13.324 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:37:13.441 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:37:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:37:13.971 INFO:teuthology.orchestra.run.smithi029.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.2 MB/s | 3.7 MB 00:01 2023-10-16T19:37:13.974 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:37:13.975 INFO:teuthology.orchestra.run.smithi029.stdout:Total 10 MB/s | 209 MB 00:20 2023-10-16T19:37:14.117 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:37:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:37:14.824 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-10-16T19:37:14.843 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:37:14.957 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-10-16T19:37:14.957 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-10-16T19:37:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:37:15.206 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:37:15.424 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:37:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:37:15.860 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:37:16.052 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T19:37:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-10-16T19:37:16.214 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-10-16T19:37:16.312 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T19:37:16.521 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T19:37:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T19:37:17.225 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T19:37:17.407 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:37:17.540 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:37:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:37:17.868 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:37:18.054 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T19:37:18.264 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T19:37:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T19:37:18.582 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:37:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:37:18.890 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:37:19.550 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:37:19.732 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:37:20.356 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:37:20.765 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:37:21.441 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-10-16T19:37:21.520 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:37:21.821 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T19:37:21.893 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T19:37:22.011 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T19:37:22.112 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T19:37:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:37:22.373 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T19:37:22.436 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:37:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T19:37:22.686 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:37:22.728 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T19:37:22.973 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T19:37:23.127 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:37:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:37:23.378 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:37:23.811 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:37:24.019 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:37:24.152 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:37:24.378 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:37:24.476 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:37:24.671 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:37:24.878 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T19:37:25.064 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:37:25.128 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T19:37:25.339 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T19:37:25.814 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T19:37:26.061 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T19:37:26.189 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T19:37:26.252 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:37:26.375 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:37:26.548 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T19:37:26.561 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:37:26.718 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:37:26.839 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T19:37:26.890 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T19:37:27.061 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T19:37:27.076 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T19:37:27.297 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T19:37:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T19:37:27.444 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:37:27.494 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T19:37:27.589 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:37:27.663 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T19:37:27.735 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:37:27.846 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T19:37:28.005 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T19:37:28.176 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T19:37:28.389 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:37:28.394 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:37:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:37:28.602 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:37:28.701 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T19:37:28.927 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T19:37:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:37:29.197 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:37:29.235 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:37:29.406 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T19:37:29.452 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:37:29.577 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T19:37:29.766 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T19:37:29.951 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T19:37:30.117 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T19:37:30.229 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:37:30.261 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T19:37:30.500 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T19:37:30.564 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T19:37:30.709 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T19:37:30.765 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T19:37:30.983 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T19:37:31.079 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T19:37:31.150 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T19:37:31.272 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T19:37:31.358 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T19:37:31.532 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T19:37:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T19:37:31.718 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:37:31.833 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T19:37:32.054 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T19:37:32.407 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T19:37:32.639 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T19:37:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T19:37:33.055 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T19:37:33.264 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T19:37:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T19:37:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T19:37:33.920 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:37:34.038 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T19:37:34.314 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T19:37:34.524 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T19:37:34.663 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T19:37:34.885 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T19:37:35.023 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T19:37:35.164 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T19:37:35.358 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T19:37:35.412 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T19:37:35.568 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T19:37:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T19:37:35.734 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T19:37:35.846 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T19:37:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T19:37:36.061 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T19:37:36.273 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T19:37:36.287 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T19:37:36.469 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T19:37:36.520 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T19:37:36.667 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T19:37:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T19:37:36.803 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T19:37:36.877 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T19:37:37.024 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T19:37:37.048 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T19:37:37.235 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T19:37:37.242 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:37:37.312 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:37:37.444 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T19:37:37.552 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T19:37:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T19:37:37.769 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T19:37:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:37:37.963 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T19:37:38.010 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:37:38.122 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T19:37:38.270 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T19:37:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T19:37:38.446 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T19:37:38.637 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T19:37:38.834 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T19:37:39.004 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T19:37:39.140 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T19:37:39.378 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T19:37:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T19:37:39.586 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T19:37:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T19:37:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T19:37:40.006 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T19:37:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T19:37:40.279 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T19:37:40.488 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T19:37:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T19:37:40.736 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T19:37:40.851 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T19:37:40.966 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T19:37:41.353 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T19:37:41.559 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T19:37:41.722 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T19:37:41.776 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T19:37:41.896 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:37:41.971 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:37:42.006 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T19:37:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T19:37:42.182 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T19:37:42.376 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T19:37:42.692 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T19:37:43.005 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T19:37:43.250 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T19:37:43.486 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T19:37:43.659 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T19:37:43.839 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T19:37:44.121 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T19:37:44.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T19:37:44.530 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T19:37:44.688 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T19:37:44.872 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T19:37:45.074 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T19:37:45.281 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T19:37:45.446 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T19:37:45.582 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T19:37:45.818 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T19:37:46.081 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T19:37:46.084 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:46.262 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:46.273 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T19:37:46.544 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T19:37:46.758 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T19:37:46.933 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T19:37:46.956 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:47.155 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T19:37:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:37:47.340 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:37:47.486 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:37:48.300 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T19:37:48.557 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T19:37:48.793 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T19:37:49.077 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T19:37:49.384 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T19:37:49.613 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T19:37:50.477 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T19:37:50.691 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:37:50.763 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:37:50.941 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T19:37:54.997 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:55.200 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:55.841 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:37:56.141 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:37:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:37:56.416 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:38:06.971 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:38:06.971 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /run 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2023-10-16T19:38:06.972 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2023-10-16T19:38:06.973 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2023-10-16T19:38:06.973 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-10-16T19:38:06.973 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:07.342 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:38:09.041 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:38:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:38:09.435 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:38:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:38:10.100 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:38:10.325 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:38:10.343 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:38:12.154 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:38:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:38:12.490 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T19:38:12.718 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T19:38:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:38:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:38:13.460 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:38:14.490 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:38:14.691 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:38:14.790 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:38:15.302 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T19:38:15.469 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:38:15.505 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:38:15.666 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:38:15.678 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:38:17.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T19:38:17.417 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:38:17.453 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:38:17.641 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:38:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:38:17.833 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:38:17.837 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:38:17.837 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2023-10-16T19:38:17.837 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2023-10-16T19:38:17.838 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-16T19:38:17.838 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /run 2023-10-16T19:38:17.838 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2023-10-16T19:38:17.838 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2023-10-16T19:38:17.839 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2023-10-16T19:38:17.839 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2023-10-16T19:38:17.839 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-16T19:38:17.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:18.205 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:38:18.227 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:38:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:38:19.902 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:38:20.072 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:38:20.305 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:38:20.480 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:38:20.974 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:38:21.171 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:38:21.189 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:38:23.077 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:38:23.266 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:38:23.347 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:38:23.436 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T19:38:23.631 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T19:38:23.821 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:38:24.049 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:38:24.339 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T19:38:24.380 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:38:24.674 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T19:38:24.861 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T19:38:25.094 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T19:38:25.306 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:38:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:38:25.514 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:38:25.562 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:38:25.657 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:38:25.753 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T19:38:25.944 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T19:38:26.058 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T19:38:26.207 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T19:38:26.263 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:38:26.301 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:38:26.511 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:38:26.524 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:38:27.937 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T19:38:28.210 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:38:28.245 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:38:28.396 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:38:28.440 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:38:28.596 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:38:28.757 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:28.987 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:38:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:29.137 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:38:29.407 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T19:38:29.565 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T19:38:29.886 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T19:38:30.235 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T19:38:30.456 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:38:30.539 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:38:30.722 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:38:30.735 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:38:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:38:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:38:31.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T19:38:31.092 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:31.284 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:31.285 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:38:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:38:31.722 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T19:38:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T19:38:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T19:38:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T19:38:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T19:38:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:38:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:38:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:38:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T19:38:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T19:38:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T19:38:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T19:38:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T19:38:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T19:38:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T19:38:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T19:38:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T19:38:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T19:38:32.245 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T19:38:32.246 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T19:38:32.246 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T19:38:32.254 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T19:38:32.255 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T19:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T19:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T19:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T19:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T19:38:32.256 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T19:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T19:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T19:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T19:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T19:38:32.257 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T19:38:32.258 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T19:38:32.258 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T19:38:32.258 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T19:38:32.258 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T19:38:32.258 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T19:38:32.259 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T19:38:32.259 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T19:38:32.259 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T19:38:32.259 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T19:38:32.259 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T19:38:32.260 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T19:38:32.260 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T19:38:32.260 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T19:38:32.260 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T19:38:32.260 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T19:38:32.261 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T19:38:32.262 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T19:38:32.262 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T19:38:32.262 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T19:38:32.262 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T19:38:32.262 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T19:38:32.263 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T19:38:32.264 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T19:38:32.264 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T19:38:32.264 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T19:38:32.264 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T19:38:32.264 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T19:38:32.265 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T19:38:32.266 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T19:38:32.266 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T19:38:32.266 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T19:38:32.266 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T19:38:32.266 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T19:38:32.267 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T19:38:32.267 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T19:38:32.267 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T19:38:32.267 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T19:38:32.267 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T19:38:32.268 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T19:38:32.269 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T19:38:32.270 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T19:38:32.270 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T19:38:32.270 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T19:38:32.270 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T19:38:32.270 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T19:38:32.271 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T19:38:32.272 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T19:38:32.273 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T19:38:32.273 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T19:38:32.273 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T19:38:32.273 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T19:38:32.273 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T19:38:32.274 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T19:38:32.274 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:32.274 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T19:38:34.168 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:38:34.889 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:34.890 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:55 ago on Mon 16 Oct 2023 07:36:39 PM UTC. 2023-10-16T19:38:35.096 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T19:38:35.428 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T19:38:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T19:38:35.916 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T19:38:36.085 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:38:36.324 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:38:36.549 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T19:38:36.731 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T19:38:36.887 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T19:38:37.584 INFO:teuthology.orchestra.run.smithi053.stdout:Installed products updated. 2023-10-16T19:38:37.831 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:37.831 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2023-10-16T19:38:37.831 INFO:teuthology.orchestra.run.smithi053.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T19:38:37.831 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T19:38:37.832 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.833 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.834 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T19:38:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T19:38:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T19:38:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T19:38:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: jq-1.6-3.el8.x86_64 2023-10-16T19:38:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.838 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T19:38:37.839 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:38:37.839 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T19:38:37.839 INFO:teuthology.orchestra.run.smithi053.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T19:38:37.839 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:38:37.839 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T19:38:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T19:38:37.841 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T19:38:37.842 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T19:38:37.843 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T19:38:37.844 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T19:38:37.844 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T19:38:37.844 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.844 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.844 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T19:38:37.845 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T19:38:37.846 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T19:38:37.847 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T19:38:37.847 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T19:38:37.847 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T19:38:37.847 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T19:38:37.847 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T19:38:37.848 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T19:38:37.848 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T19:38:37.848 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T19:38:37.848 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T19:38:37.848 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T19:38:37.849 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T19:38:37.850 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T19:38:37.850 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.850 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.850 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T19:38:37.850 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T19:38:37.851 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.851 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T19:38:37.851 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T19:38:37.851 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T19:38:37.851 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T19:38:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T19:38:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T19:38:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T19:38:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T19:38:37.855 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T19:38:37.855 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T19:38:37.855 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T19:38:37.856 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T19:38:37.856 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T19:38:37.856 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.857 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.857 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:37.857 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T19:38:37.857 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T19:38:37.858 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T19:38:37.858 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T19:38:37.858 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T19:38:37.859 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T19:38:37.860 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:37.860 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-10-16T19:38:38.044 DEBUG:teuthology.parallel:result is None 2023-10-16T19:38:39.281 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:39.535 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:39.554 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:38:39.728 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T19:38:39.978 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T19:38:40.309 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T19:38:40.739 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T19:38:40.935 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:38:41.028 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:38:41.227 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:38:41.241 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:38:41.402 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:38:41.412 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:38:41.546 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T19:38:41.547 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:41.747 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:41.747 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:38:42.056 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:38:42.260 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:42.800 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T19:38:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T19:38:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T19:38:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T19:38:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T19:38:42.802 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:38:42.802 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:38:42.802 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:38:42.802 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T19:38:42.802 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T19:38:42.803 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T19:38:42.803 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T19:38:42.803 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T19:38:42.803 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T19:38:42.803 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T19:38:42.804 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T19:38:42.804 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T19:38:42.804 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T19:38:42.804 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T19:38:42.804 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T19:38:42.805 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T19:38:42.805 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T19:38:42.805 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T19:38:42.805 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T19:38:42.805 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T19:38:42.806 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T19:38:42.806 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T19:38:42.806 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T19:38:42.806 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T19:38:42.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T19:38:42.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T19:38:42.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T19:38:42.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T19:38:42.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T19:38:42.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T19:38:42.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T19:38:42.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T19:38:42.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T19:38:42.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T19:38:42.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T19:38:42.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T19:38:42.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T19:38:42.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T19:38:42.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T19:38:42.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T19:38:42.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T19:38:42.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T19:38:42.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T19:38:42.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T19:38:42.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T19:38:42.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T19:38:42.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T19:38:42.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T19:38:42.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T19:38:42.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T19:38:42.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T19:38:42.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T19:38:42.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T19:38:42.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T19:38:42.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T19:38:42.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T19:38:42.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T19:38:42.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T19:38:42.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T19:38:42.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T19:38:42.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T19:38:42.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T19:38:42.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T19:38:42.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T19:38:42.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T19:38:42.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T19:38:42.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T19:38:42.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T19:38:42.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T19:38:42.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T19:38:42.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T19:38:42.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T19:38:42.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T19:38:42.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T19:38:42.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T19:38:42.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T19:38:42.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T19:38:42.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T19:38:42.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T19:38:42.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T19:38:42.820 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T19:38:42.820 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T19:38:42.820 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T19:38:42.820 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T19:38:42.820 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T19:38:42.821 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T19:38:42.821 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T19:38:42.821 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T19:38:42.821 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T19:38:42.821 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T19:38:42.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T19:38:42.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T19:38:42.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T19:38:42.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T19:38:42.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T19:38:42.823 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T19:38:42.823 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T19:38:42.823 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T19:38:42.823 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T19:38:42.823 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T19:38:42.824 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T19:38:42.825 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T19:38:42.825 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T19:38:42.825 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T19:38:42.825 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T19:38:42.825 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T19:38:42.826 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T19:38:42.826 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T19:38:42.826 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T19:38:42.826 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T19:38:42.826 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T19:38:42.827 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:38:42.827 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T19:38:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:38:51.513 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Oct 2023 07:36:40 PM UTC. 2023-10-16T19:38:54.343 INFO:teuthology.orchestra.run.smithi029.stdout:Installed products updated. 2023-10-16T19:38:54.583 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:54.583 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2023-10-16T19:38:54.583 INFO:teuthology.orchestra.run.smithi029.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T19:38:54.583 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.584 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.584 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-10-16T19:38:54.584 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T19:38:54.584 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T19:38:54.584 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T19:38:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.586 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.586 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.586 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.586 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.586 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.587 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.587 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.587 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.587 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.587 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.589 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.589 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.589 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:38:54.589 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T19:38:54.589 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T19:38:54.590 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T19:38:54.590 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T19:38:54.590 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-3.el8.x86_64 2023-10-16T19:38:54.590 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T19:38:54.590 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T19:38:54.591 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T19:38:54.591 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.591 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.591 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.591 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T19:38:54.592 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.593 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.593 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T19:38:54.593 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.593 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T19:38:54.593 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T19:38:54.594 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T19:38:54.594 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T19:38:54.594 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T19:38:54.594 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T19:38:54.594 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T19:38:54.595 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T19:38:54.595 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T19:38:54.595 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T19:38:54.595 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T19:38:54.595 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T19:38:54.596 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T19:38:54.596 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T19:38:54.596 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:54.596 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:54.596 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:38:54.597 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T19:38:54.597 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T19:38:54.597 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T19:38:54.597 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T19:38:54.597 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T19:38:54.598 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.598 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.598 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.598 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T19:38:54.598 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T19:38:54.599 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T19:38:54.600 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T19:38:54.600 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T19:38:54.600 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T19:38:54.600 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T19:38:54.600 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T19:38:54.601 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T19:38:54.601 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T19:38:54.601 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T19:38:54.601 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T19:38:54.601 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T19:38:54.602 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T19:38:54.603 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T19:38:54.603 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T19:38:54.603 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T19:38:54.603 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T19:38:54.604 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T19:38:54.604 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.604 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.604 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T19:38:54.604 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T19:38:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T19:38:54.606 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T19:38:54.606 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T19:38:54.606 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T19:38:54.606 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T19:38:54.606 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T19:38:54.607 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T19:38:54.607 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T19:38:54.607 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T19:38:54.607 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.607 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.608 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:38:54.608 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T19:38:54.608 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T19:38:54.608 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T19:38:54.608 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T19:38:54.609 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T19:38:54.609 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T19:38:54.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:54.609 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-16T19:38:54.752 DEBUG:teuthology.parallel:result is None 2023-10-16T19:38:54.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:38:54.918 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:38:54.942 INFO:teuthology.orchestra.run.smithi029.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T19:38:54.943 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T19:38:54.943 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:38:54.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:38:55.192 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:38:55.221 INFO:teuthology.orchestra.run.smithi053.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T19:38:55.221 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T19:38:55.221 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:38:55.222 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T19:38:55.222 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:55.223 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:38:55.269 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:55.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:38:55.318 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T19:38:55.318 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:55.319 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:38:55.349 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:38:55.419 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:55.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:38:55.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:38:55.520 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T19:38:55.521 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:55.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:38:55.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:38:55.619 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:55.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:38:55.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:38:55.720 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T19:38:55.720 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:55.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:38:55.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:38:55.817 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:55.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:38:55.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:38:55.919 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T19:38:55.989 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T19:38:55.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2023-10-16T19:38:55.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2023-10-16T19:38:56.022 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T19:38:56.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:38:56.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:38:56.089 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T19:38:56.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:38:56.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:38:56.332 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T19:38:56.332 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T19:38:56.333 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T19:38:56.333 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:56.333 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:38:56.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:38:56.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:38:56.835 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:56.835 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:38:56.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:38:57.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:38:57.082 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T19:38:57.083 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T19:38:57.083 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071', 'branch': 'rishabh-2023oct13', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': None, 'first_in_suite': False, 'job_id': '7430071', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-qa2', 'sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-qa2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_18:49:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T19:38:57.084 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:38:57.086 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:38:57.136 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:38:57.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:38:57.205 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:57.206 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:38:57.238 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:38:57.238 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-10-16T19:38:57.298 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:38:57.299 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:57.299 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 396525 Links: 1 2023-10-16T19:38:57.299 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:57.299 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:57.299 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-16 19:38:42.477420895 +0000 2023-10-16T19:38:57.300 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-16 19:35:53.729883132 +0000 2023-10-16T19:38:57.300 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-16 19:35:53.729883132 +0000 2023-10-16T19:38:57.300 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-16T19:38:57.300 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:38:57.368 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-16T19:38:57.369 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-16T19:38:57.369 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.00012615 s, 4.1 MB/s 2023-10-16T19:38:57.370 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:38:57.431 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-10-16T19:38:57.490 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:38:57.490 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 392687 Links: 1 2023-10-16T19:38:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-16 19:38:42.477420895 +0000 2023-10-16T19:38:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-16 19:35:54.237874143 +0000 2023-10-16T19:38:57.492 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-16 19:35:54.237874143 +0000 2023-10-16T19:38:57.492 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-16T19:38:57.492 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:38:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-16T19:38:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-16T19:38:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000117527 s, 4.4 MB/s 2023-10-16T19:38:57.560 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:38:57.620 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-10-16T19:38:57.680 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:38:57.680 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:57.680 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 395790 Links: 1 2023-10-16T19:38:57.680 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:57.681 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:57.681 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-16 19:38:42.477420895 +0000 2023-10-16T19:38:57.681 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-16 19:35:54.738865277 +0000 2023-10-16T19:38:57.681 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-16 19:35:54.738865277 +0000 2023-10-16T19:38:57.681 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-16T19:38:57.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:38:57.747 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-16T19:38:57.748 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-16T19:38:57.748 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000108904 s, 4.7 MB/s 2023-10-16T19:38:57.749 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:38:57.809 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-10-16T19:38:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:38:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:57.867 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 399526 Links: 1 2023-10-16T19:38:57.867 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:57.868 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:57.868 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-16 19:38:42.477420895 +0000 2023-10-16T19:38:57.868 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-16 19:35:55.282855650 +0000 2023-10-16T19:38:57.868 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-16 19:35:55.282855650 +0000 2023-10-16T19:38:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-16T19:38:57.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:38:57.935 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-16T19:38:57.935 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-16T19:38:57.935 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000114877 s, 4.5 MB/s 2023-10-16T19:38:57.936 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:38:57.995 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:38:57.996 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:57.996 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:38:58.017 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:38:58.018 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-10-16T19:38:58.079 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:38:58.079 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:58.079 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 392062 Links: 1 2023-10-16T19:38:58.079 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:58.080 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:58.080 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-10-16 19:38:31.925284306 +0000 2023-10-16T19:38:58.080 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-10-16 19:35:49.249891779 +0000 2023-10-16T19:38:58.080 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-10-16 19:35:49.249891779 +0000 2023-10-16T19:38:58.080 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-10-16T19:38:58.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:38:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-10-16T19:38:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-10-16T19:38:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000139829 s, 3.7 MB/s 2023-10-16T19:38:58.151 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:38:58.213 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-10-16T19:38:58.272 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:38:58.272 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:58.272 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 392424 Links: 1 2023-10-16T19:38:58.272 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:58.273 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:58.273 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-10-16 19:38:31.925284306 +0000 2023-10-16T19:38:58.273 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-10-16 19:35:49.773881061 +0000 2023-10-16T19:38:58.273 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-10-16 19:35:49.773881061 +0000 2023-10-16T19:38:58.273 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-10-16T19:38:58.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:38:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-10-16T19:38:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-10-16T19:38:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.00012532 s, 4.1 MB/s 2023-10-16T19:38:58.343 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:38:58.403 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-10-16T19:38:58.462 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:38:58.463 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:58.463 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 392473 Links: 1 2023-10-16T19:38:58.463 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:58.463 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:58.464 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-10-16 19:38:31.925284306 +0000 2023-10-16T19:38:58.464 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-10-16 19:35:50.277870752 +0000 2023-10-16T19:38:58.464 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-10-16 19:35:50.277870752 +0000 2023-10-16T19:38:58.464 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-10-16T19:38:58.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:38:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-10-16T19:38:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-10-16T19:38:58.532 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000108639 s, 4.7 MB/s 2023-10-16T19:38:58.533 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:38:58.591 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-10-16T19:38:58.650 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:38:58.650 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:38:58.650 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 387997 Links: 1 2023-10-16T19:38:58.650 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:38:58.651 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:38:58.651 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-10-16 19:38:31.925284306 +0000 2023-10-16T19:38:58.651 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-10-16 19:35:50.785860359 +0000 2023-10-16T19:38:58.651 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-10-16 19:35:50.785860359 +0000 2023-10-16T19:38:58.651 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-10-16T19:38:58.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:38:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-10-16T19:38:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-10-16T19:38:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000118588 s, 4.3 MB/s 2023-10-16T19:38:58.718 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:38:58.777 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:38:58.778 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:38:58.778 INFO:tasks.ceph:Generating config... 2023-10-16T19:38:58.779 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T19:38:58.780 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T19:38:58.780 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T19:38:58.780 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T19:38:58.780 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T19:38:58.780 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-16T19:38:58.781 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T19:38:58.781 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T19:38:58.781 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T19:38:58.781 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T19:38:58.782 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T19:38:58.782 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T19:38:58.782 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T19:38:58.783 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T19:38:58.783 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T19:38:58.783 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T19:38:58.783 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T19:38:58.783 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T19:38:58.784 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T19:38:58.784 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T19:38:58.784 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T19:38:58.784 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T19:38:58.785 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T19:38:58.785 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T19:38:58.785 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T19:38:58.785 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T19:38:58.786 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T19:38:58.786 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T19:38:58.786 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T19:38:58.786 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T19:38:58.787 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T19:38:58.787 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T19:38:58.787 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T19:38:58.787 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T19:38:58.788 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T19:38:58.788 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T19:38:58.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T19:38:58.855 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T19:38:58.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T19:38:58.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:38:58.935 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.53'), ('mon.c', '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]')] 2023-10-16T19:38:58.935 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T19:38:58.936 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:58.936 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:38:58.992 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.53 --addv c '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:38:59.084 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:38:59.085 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid b5b71d99-0d95-4cc7-b379-31b38eac533d 2023-10-16T19:38:59.085 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2023-10-16T19:38:59.085 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2023-10-16T19:38:59.085 INFO:teuthology.orchestra.run.smithi029.stdout:fsid b5b71d99-0d95-4cc7-b379-31b38eac533d 2023-10-16T19:38:59.085 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2023-10-16T19:38:59.083843+0000 2023-10-16T19:38:59.086 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-10-16T19:38:59.083843+0000 2023-10-16T19:38:59.086 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2023-10-16T19:38:59.086 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2023-10-16T19:38:59.086 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2023-10-16T19:38:59.086 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.b 2023-10-16T19:38:59.087 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon.c 2023-10-16T19:38:59.087 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T19:38:59.088 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:38:59.105 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b5b71d99-0d95-4cc7-b379-31b38eac533d... 2023-10-16T19:38:59.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:38:59.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:38:59.193 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-16T19:38:59.193 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-16T19:38:59.194 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:38:59.194 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-16T19:38:59.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.194 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-16T19:38:59.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.195 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-16T19:38:59.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.195 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-16T19:38:59.195 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-16T19:38:59.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-16T19:38:59.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.197 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:38:59.197 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:38:59.197 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.197 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-16T19:38:59.197 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-16T19:38:59.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-16T19:38:59.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:38:59.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:38:59.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-16T19:38:59.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-16T19:38:59.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on skipped message = False 2023-10-16T19:38:59.201 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = b5b71d99-0d95-4cc7-b379-31b38eac533d 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-16T19:38:59.202 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-16T19:38:59.204 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-16T19:38:59.204 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-16T19:38:59.204 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.204 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-16T19:38:59.204 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.205 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-16T19:38:59.206 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.206 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:38:59.206 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-16T19:38:59.206 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.206 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2023-10-16T19:38:59.207 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-16T19:38:59.208 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-16T19:38:59.208 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2023-10-16T19:38:59.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:38:59.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-16T19:38:59.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:38:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-16T19:38:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-16T19:38:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-16T19:38:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:38:59.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-16T19:38:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-16T19:38:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-16T19:38:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-16T19:38:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-16T19:38:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:38:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:38:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-16T19:38:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:38:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:38:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-16T19:38:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:38:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:38:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-16T19:38:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-16T19:38:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-16T19:38:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-16T19:38:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-16T19:38:59.218 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-16T19:38:59.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-16T19:38:59.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-16T19:38:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-16T19:38:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2023-10-16T19:38:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-16T19:38:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-16T19:38:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-16T19:38:59.222 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2023-10-16T19:38:59.222 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2023-10-16T19:38:59.222 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:38:59.223 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2023-10-16T19:38:59.223 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.223 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2023-10-16T19:38:59.223 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.223 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2023-10-16T19:38:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:38:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:38:59.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.226 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2023-10-16T19:38:59.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.226 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2023-10-16T19:38:59.226 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2023-10-16T19:38:59.227 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:38:59.227 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:38:59.227 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2023-10-16T19:38:59.227 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:38:59.227 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:38:59.228 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.229 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2023-10-16T19:38:59.229 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.229 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2023-10-16T19:38:59.229 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.229 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.29,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on skipped message = False 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = b5b71d99-0d95-4cc7-b379-31b38eac533d 2023-10-16T19:38:59.230 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.231 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2023-10-16T19:38:59.231 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2023-10-16T19:38:59.231 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.231 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2023-10-16T19:38:59.231 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.232 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2023-10-16T19:38:59.233 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2023-10-16T19:38:59.234 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2023-10-16T19:38:59.235 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2023-10-16T19:38:59.236 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2023-10-16T19:38:59.236 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 20 2023-10-16T19:38:59.236 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 20 2023-10-16T19:38:59.236 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-10-16T19:38:59.236 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 10 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2023-10-16T19:38:59.237 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2023-10-16T19:38:59.238 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.239 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2023-10-16T19:38:59.240 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2023-10-16T19:38:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:38:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2023-10-16T19:38:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2023-10-16T19:38:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:38:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:38:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2023-10-16T19:38:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-10-16T19:38:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-10-16T19:38:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-10-16T19:38:59.246 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2023-10-16T19:38:59.246 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2023-10-16T19:38:59.246 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2023-10-16T19:38:59.246 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-10-16T19:38:59.247 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-10-16T19:38:59.247 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-10-16T19:38:59.247 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-10-16T19:38:59.247 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2023-10-16T19:38:59.247 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2023-10-16T19:38:59.248 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2023-10-16T19:38:59.249 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-10-16T19:38:59.249 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-10-16T19:38:59.249 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-10-16T19:38:59.249 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T19:38:59.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T19:38:59.321 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T19:38:59.321 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:59.322 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T19:38:59.338 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:59.339 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T19:38:59.395 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:38:59.395 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:59.396 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:38:59.396 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:38:59.473 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:38:59.473 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:38:59.529 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:38:59.529 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:59.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:38:59.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:38:59.575 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:38:59.576 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:38:59.635 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T19:38:59.635 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T19:38:59.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:38:59.690 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:38:59.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:38:59.765 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:38:59.768 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T19:38:59.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:38:59.824 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:38:59.826 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T19:38:59.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:38:59.950 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:38:59.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T19:38:59.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:39:00.046 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:39:00.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T19:39:00.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:39:00.176 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:39:00.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T19:39:00.207 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T19:39:00.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T19:39:00.253 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T19:39:00.267 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T19:39:00.311 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T19:39:00.324 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T19:39:00.325 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:39:00.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:00.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:00.353 INFO:tasks.ceph:role: osd.0 2023-10-16T19:39:00.354 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:39:00.354 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:39:00.420 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:00.421 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:00.421 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:00.421 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:00.421 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:00.421 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:00.422 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:00.422 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:00.422 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:00.422 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:00.443 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-16T19:39:00.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-16T19:39:00.445 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:00.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:00.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:00.666 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:00.667 INFO:tasks.ceph:role: osd.1 2023-10-16T19:39:00.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:39:00.667 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:39:00.733 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:00.734 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:00.734 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:00.734 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:00.734 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:00.735 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:00.735 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:00.735 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:00.735 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:00.735 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:00.757 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-16T19:39:00.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-16T19:39:00.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:00.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:00.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:00.978 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:00.978 INFO:tasks.ceph:role: osd.2 2023-10-16T19:39:00.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:39:00.979 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:39:01.045 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:01.046 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:01.047 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:01.047 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:01.047 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:01.068 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-16T19:39:01.069 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-16T19:39:01.070 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:01.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:01.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:01.288 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:01.288 INFO:tasks.ceph:role: osd.3 2023-10-16T19:39:01.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:39:01.289 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:39:01.355 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:01.355 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:01.356 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:01.356 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:01.356 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:01.356 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:01.356 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:01.357 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:01.357 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:01.357 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:01.378 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-16T19:39:01.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-16T19:39:01.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:01.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:01.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:01.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T19:39:01.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T19:39:01.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:01.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:01.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T19:39:01.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:01.640+0000 7f8c6b557640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T19:39:04.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T19:39:04.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.627+0000 7f61afc34640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T19:39:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.627+0000 7f61afc34640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T19:39:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.627+0000 7f61afc34640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.627+0000 7f61afc34640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.627+0000 7f61afc34640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T19:39:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:04.628+0000 7f61afc34640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T19:39:07.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T19:39:07.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:07.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T19:39:07.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T19:39:07.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:07.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:07.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T19:39:07.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:07.626+0000 7f6e59fc6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T19:39:10.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T19:39:10.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:10.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T19:39:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T19:39:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T19:39:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:10.614+0000 7fed48997640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T19:39:13.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T19:39:13.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:13.551 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:13.552 INFO:tasks.ceph:role: osd.4 2023-10-16T19:39:13.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:39:13.552 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:39:13.624 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:13.625 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:13.625 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:13.626 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:13.626 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:13.647 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-10-16T19:39:13.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-10-16T19:39:13.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:13.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:13.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:13.873 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:13.874 INFO:tasks.ceph:role: osd.5 2023-10-16T19:39:13.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:39:13.874 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:39:13.941 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:13.942 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:13.942 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:13.942 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:13.942 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:13.943 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:13.943 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:13.943 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:13.943 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:13.943 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:13.964 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-10-16T19:39:13.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-10-16T19:39:13.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:14.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:14.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:14.184 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:14.184 INFO:tasks.ceph:role: osd.6 2023-10-16T19:39:14.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:39:14.185 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:39:14.251 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:14.251 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:14.252 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:14.252 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:14.252 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:14.252 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:14.252 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:14.253 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:14.253 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:14.253 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:14.273 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-10-16T19:39:14.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-10-16T19:39:14.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:14.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:14.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:14.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:39:14.495 INFO:tasks.ceph:role: osd.7 2023-10-16T19:39:14.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:39:14.496 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:39:14.562 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:39:14.562 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:39:14.562 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:39:14.562 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:39:14.563 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:39:14.563 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:39:14.563 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:39:14.563 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:39:14.564 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:39:14.564 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:39:14.585 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-10-16T19:39:14.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-10-16T19:39:14.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:14.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:14.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.861+0000 7f8409637640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T19:39:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.861+0000 7f8409637640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T19:39:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.861+0000 7f8409637640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:14.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.862+0000 7f8409637640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:14.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.862+0000 7f8409637640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T19:39:14.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:14.862+0000 7f8409637640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T19:39:17.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T19:39:17.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:17.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T19:39:17.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T19:39:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T19:39:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:17.849+0000 7f1ffe84d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T19:39:20.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T19:39:20.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T19:39:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T19:39:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T19:39:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:20.839+0000 7f6baa250640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T19:39:23.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T19:39:23.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:23.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.831+0000 7f68ec25c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T19:39:23.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.832+0000 7f68ec25c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T19:39:23.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.832+0000 7f68ec25c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:23.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.832+0000 7f68ec25c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:23.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.832+0000 7f68ec25c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T19:39:23.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:23.832+0000 7f68ec25c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T19:39:26.690 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T19:39:26.723 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T19:39:26.724 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:26.724 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T19:39:26.760 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:26.760 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T19:39:26.831 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:26.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T19:39:26.904 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:26.904 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T19:39:26.977 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:26.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T19:39:27.047 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:27.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T19:39:27.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:27.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:27.119 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:27.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T19:39:27.187 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T19:39:27.219 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T19:39:27.290 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T19:39:27.360 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T19:39:27.430 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T19:39:27.500 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T19:39:27.569 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T19:39:27.638 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:27.638 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T19:39:27.659 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:27.659 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T19:39:27.696 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T19:39:27.696 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:39:27.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:39:27.739 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2023-10-16T19:39:27.739 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTkS1lKUMjKRAAXYxYFRQ3K4A3ctGLk9SfiQ== 2023-10-16T19:39:27.740 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-16T19:39:27.740 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTkS1lnK4WMRAAff5bUjhlsh9+Y/wl+nnKdw== 2023-10-16T19:39:27.740 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-16T19:39:27.740 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTkS1lxX2SOBAAHRyJ98rm8g6A/CAUqUI5UQ== 2023-10-16T19:39:27.740 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2023-10-16T19:39:27.741 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBVkS1lUOc2JhAAOwrLnI7XgQJa0uYPXhMrAQ== 2023-10-16T19:39:27.741 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2023-10-16T19:39:27.741 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBYkS1lQNt4JRAA/eEj06pEmUcu2wumPSft7w== 2023-10-16T19:39:27.741 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2023-10-16T19:39:27.741 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBbkS1loCh1JRAAGrY0qOVVlY/YLBzM4f41DQ== 2023-10-16T19:39:27.742 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2023-10-16T19:39:27.742 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBekS1lz+SuJBAAEzT4gxg3ZiGoUHwn2vdDSw== 2023-10-16T19:39:27.742 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2023-10-16T19:39:27.742 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTkS1lxMCOLRAAwXhHcrxfe4byJOMayA685g== 2023-10-16T19:39:27.742 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-16T19:39:27.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUkS1lM5a8AhAAsmoxUyjWymlYozp1zlJ4Ng== 2023-10-16T19:39:27.743 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-16T19:39:27.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUkS1l5x6BChAARHBcmYXiFiPxVfa2Qd3JjA== 2023-10-16T19:39:27.743 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2023-10-16T19:39:27.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBikS1lPd1rMxAAXrCCNmvT7lR3/T481JeX2g== 2023-10-16T19:39:27.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2023-10-16T19:39:27.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBlkS1lVSiuMhAAxzLeS0Kt2b7XEL7lDRVZoA== 2023-10-16T19:39:27.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2023-10-16T19:39:27.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBokS1lawoWMhAACKPYp7aIdgbk48wdlcERVQ== 2023-10-16T19:39:27.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2023-10-16T19:39:27.745 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBrkS1lB8akMRAAzezftIRUNUdJ5yMjbOdWtQ== 2023-10-16T19:39:27.745 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-16T19:39:27.745 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUkS1lF9wWDxAAg1bVqXLjGOgEIq3Eu3eYsQ== 2023-10-16T19:39:27.745 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2023-10-16T19:39:27.745 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUkS1lIeSGEhAAVqMQh+Vp8VLN4DwAJu0w1g== 2023-10-16T19:39:27.762 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2023-10-16T19:39:27.762 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTkS1lKUMjKRAAXYxYFRQ3K4A3ctGLk9SfiQ== 2023-10-16T19:39:27.762 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-10-16T19:39:27.762 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTkS1lnK4WMRAAff5bUjhlsh9+Y/wl+nnKdw== 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTkS1lxX2SOBAAHRyJ98rm8g6A/CAUqUI5UQ== 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBVkS1lUOc2JhAAOwrLnI7XgQJa0uYPXhMrAQ== 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2023-10-16T19:39:27.763 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBYkS1lQNt4JRAA/eEj06pEmUcu2wumPSft7w== 2023-10-16T19:39:27.764 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2023-10-16T19:39:27.764 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBbkS1loCh1JRAAGrY0qOVVlY/YLBzM4f41DQ== 2023-10-16T19:39:27.764 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2023-10-16T19:39:27.764 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBekS1lz+SuJBAAEzT4gxg3ZiGoUHwn2vdDSw== 2023-10-16T19:39:27.764 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2023-10-16T19:39:27.765 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTkS1lxMCOLRAAwXhHcrxfe4byJOMayA685g== 2023-10-16T19:39:27.765 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-10-16T19:39:27.765 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBUkS1lM5a8AhAAsmoxUyjWymlYozp1zlJ4Ng== 2023-10-16T19:39:27.765 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-10-16T19:39:27.765 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBUkS1l5x6BChAARHBcmYXiFiPxVfa2Qd3JjA== 2023-10-16T19:39:27.766 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2023-10-16T19:39:27.766 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBikS1lPd1rMxAAXrCCNmvT7lR3/T481JeX2g== 2023-10-16T19:39:27.766 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2023-10-16T19:39:27.766 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBlkS1lVSiuMhAAxzLeS0Kt2b7XEL7lDRVZoA== 2023-10-16T19:39:27.766 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2023-10-16T19:39:27.767 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBokS1lawoWMhAACKPYp7aIdgbk48wdlcERVQ== 2023-10-16T19:39:27.767 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2023-10-16T19:39:27.767 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBrkS1lB8akMRAAzezftIRUNUdJ5yMjbOdWtQ== 2023-10-16T19:39:27.767 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-10-16T19:39:27.767 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBUkS1lF9wWDxAAg1bVqXLjGOgEIq3Eu3eYsQ== 2023-10-16T19:39:27.768 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2023-10-16T19:39:27.768 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBUkS1lIeSGEhAAVqMQh+Vp8VLN4DwAJu0w1g== 2023-10-16T19:39:27.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:27.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:27.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:27.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:27.926 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:27.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:27.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:27.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.158 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:28.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:39:28.271 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:28.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:28.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:28.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:39:28.392 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:39:28.619 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:28.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:28.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:28.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:39:28.739 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T19:39:28.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T19:39:28.767 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:28.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T19:39:28.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T19:39:28.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:29.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T19:39:29.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T19:39:29.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:39:29.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T19:39:29.246 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:29.248 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:39:29.302 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T19:39:29.303 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T19:39:29.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T19:39:29.307 INFO:tasks.ceph.mon.a:Started 2023-10-16T19:39:29.308 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T19:39:29.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T19:39:29.344 INFO:tasks.ceph.mon.b:Started 2023-10-16T19:39:29.345 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T19:39:29.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T19:39:29.347 INFO:tasks.ceph.mon.c:Started 2023-10-16T19:39:29.348 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T19:39:29.348 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T19:39:29.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T19:39:29.350 INFO:tasks.ceph.mgr.y:Started 2023-10-16T19:39:29.351 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T19:39:29.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T19:39:29.353 INFO:tasks.ceph.mgr.x:Started 2023-10-16T19:39:29.354 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T19:39:29.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T19:39:29.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.479+0000 7f235a5c0700 1 Processor -- start 2023-10-16T19:39:29.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.479+0000 7f235a5c0700 1 -- start start 2023-10-16T19:39:29.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f235a5c0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:29.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f235a5c0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:29.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f235a5c0700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235406e780 con 0x7f2354154a50 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f235a5c0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235406d320 con 0x7f235406adc0 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f235a5c0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2354154f10 con 0x7f235413d660 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50578/0 (socket says 172.21.15.29:50578) 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 learned_addr learned my addr 172.21.15.29:0/2567388426 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:29.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:29.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T19:39:29.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:29.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:29.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:39:29.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:39:29.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:29.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:29.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.480+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:39:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:39:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:39:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T19:39:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:29.681+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:39:30.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:30.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:39:30.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:30.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:30.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:39:30.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:30.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T19:39:30.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:30.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:30.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.082+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:39:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:39:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:39:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T19:39:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2353fff700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:30.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:30.883+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:39:32.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 msgr2=0x7f235406a880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:39:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f235413d660 0x7f235406a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 msgr2=0x7f2354158ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:39:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.29:3300/0 conn(0x7f235406adc0 0x7f2354158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:32.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 -- 172.21.15.29:0/2567388426 >> v1:172.21.15.53:6789/0 conn(0x7f2354154a50 legacy=0x7f23541583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 -- 172.21.15.29:0/2567388426 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23541551f0 con 0x7f2340003770 2023-10-16T19:39:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f2351ffb700 1 -- 172.21.15.29:0/2567388426 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235406d320 con 0x7f23400073e0 2023-10-16T19:39:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:32.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:39:32.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:32.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:32.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.480+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:39:32.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.681+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:32.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.681+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:39:32.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.681+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:32.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.681+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:32.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:32.681+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T19:39:33.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.082+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:33.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.082+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:39:33.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.082+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:33.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.082+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:33.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.082+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T19:39:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.883+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.883+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:39:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.883+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:39:33.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.883+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:39:33.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:33.883+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T19:39:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.677+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231811049 0 0) 0x7f23541551f0 con 0x7f2340003770 2023-10-16T19:39:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.677+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f233c0035b0 con 0x7f2340003770 2023-10-16T19:39:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063870777 0 0) 0x7f233c0035b0 con 0x7f2340003770 2023-10-16T19:39:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 msgr2=0x7f23400098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:39:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 --2- 172.21.15.29:0/2567388426 >> v2:172.21.15.53:3300/0 conn(0x7f23400073e0 0x7f23400098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234000afa0 con 0x7f2340003770 2023-10-16T19:39:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f234400e590 con 0x7f2340003770 2023-10-16T19:39:34.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 >> v1:172.21.15.29:6789/0 conn(0x7f2340003770 legacy=0x7f2340005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:34.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2358b5d700 1 -- 172.21.15.29:0/2567388426 reap_dead start 2023-10-16T19:39:34.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f233c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f233c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f233c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235406d320 con 0x7f233c004850 2023-10-16T19:39:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c00c280 con 0x7f233c005330 2023-10-16T19:39:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c00c440 con 0x7f233c003a00 2023-10-16T19:39:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f233c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2353fff700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f233c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f2358b5d700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f233c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 msgr2=0x7f233c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f233c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 msgr2=0x7f233c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f233c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.678+0000 7f23537fe700 1 -- 172.21.15.29:0/2567388426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0035b0 con 0x7f233c004850 2023-10-16T19:39:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.679+0000 7f23537fe700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f233c004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2348007cc0 tx=0x7f233c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13966b1d224b2320 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.679+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234801b030 con 0x7f233c004850 2023-10-16T19:39:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.679+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348003e50 con 0x7f233c004850 2023-10-16T19:39:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.679+0000 7f2352ffd700 1 -- 172.21.15.29:0/2567388426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348016670 con 0x7f233c004850 2023-10-16T19:39:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 -- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 msgr2=0x7f233c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f233c004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2348007cc0 tx=0x7f233c005880 comp rx=0 tx=0).stop 2023-10-16T19:39:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 -- 172.21.15.29:0/2567388426 shutdown_connections 2023-10-16T19:39:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f233c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f233c004cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 --2- 172.21.15.29:0/2567388426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f233c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 -- 172.21.15.29:0/2567388426 >> 172.21.15.29:0/2567388426 conn(0x7f23540c7110 msgr2=0x7f23540c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 -- 172.21.15.29:0/2567388426 shutdown_connections 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.680+0000 7f235a5c0700 1 -- 172.21.15.29:0/2567388426 wait complete. 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.681+0000 7f235a5c0700 1 Processor -- start 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 -- start start 2023-10-16T19:39:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f23541ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f23541de260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541545b0 con 0x7f233c004850 2023-10-16T19:39:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.682+0000 7f235a5c0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541ed450 con 0x7f233c005330 2023-10-16T19:39:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f235a5c0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23541e9d30 con 0x7f233c003a00 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50636/0 (socket says 172.21.15.29:50636) 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 -- 172.21.15.29:0/534840921 learned_addr learned my addr 172.21.15.29:0/534840921 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2353fff700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f23541ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2358b5d700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f23541de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 -- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 msgr2=0x7f23541ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f23541ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 -- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 msgr2=0x7f23541de260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f23541de260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 -- 172.21.15.29:0/534840921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23541e9fb0 con 0x7f233c004850 2023-10-16T19:39:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2358b5d700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f23541de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f23537fe700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2348003c40 tx=0x7f2348001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348000ed0 con 0x7f233c004850 2023-10-16T19:39:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348021620 con 0x7f233c004850 2023-10-16T19:39:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23541545b0 con 0x7f233c004850 2023-10-16T19:39:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.683+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480219d0 con 0x7f233c004850 2023-10-16T19:39:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.684+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23541574c0 con 0x7f233c004850 2023-10-16T19:39:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.684+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f234801e070 con 0x7f233c004850 2023-10-16T19:39:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.684+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f234801c070 con 0x7f233c004850 2023-10-16T19:39:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.685+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23540c3740 con 0x7f233c004850 2023-10-16T19:39:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.687+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2348049b40 con 0x7f233c004850 2023-10-16T19:39:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.765+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f235404f400 con 0x7f233c004850 2023-10-16T19:39:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.767+0000 7f2350ff9700 1 -- 172.21.15.29:0/534840921 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2348038020 con 0x7f233c004850 2023-10-16T19:39:34.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 msgr2=0x7f23541e97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:34.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2348003c40 tx=0x7f2348001120 comp rx=0 tx=0).stop 2023-10-16T19:39:34.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 shutdown_connections 2023-10-16T19:39:34.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f233c005330 0x7f23541de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f233c003a00 0x7f23541ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 --2- 172.21.15.29:0/534840921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f233c004850 0x7f23541e97f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:34.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 >> 172.21.15.29:0/534840921 conn(0x7f23540c7110 msgr2=0x7f235406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:34.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 shutdown_connections 2023-10-16T19:39:34.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:34.768+0000 7f235a5c0700 1 -- 172.21.15.29:0/534840921 wait complete. 2023-10-16T19:39:34.772 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2023-10-16T19:39:34.782 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T19:39:34.783 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T19:39:34.783 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:34.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T19:39:34.811 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:34.809+0000 7f86492f1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:39:34.812 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:34.812 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T19:39:34.879 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:34.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T19:39:34.880 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:34.878+0000 7f86492f1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:39:34.946 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:39:34.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T19:39:34.960 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:34.958+0000 7f86492f1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:39:35.013 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:35.014 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T19:39:35.041 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:35.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T19:39:35.045 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.044+0000 7f86492f1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:39:35.071 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:35.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T19:39:35.139 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:39:35.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T19:39:35.197 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.195+0000 7f86492f1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:39:35.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 06866353-b172-43cf-b49c-f51bea367ed6 0 2023-10-16T19:39:35.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.368+0000 7f17eff87700 1 Processor -- start 2023-10-16T19:39:35.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.368+0000 7f17eff87700 1 -- start start 2023-10-16T19:39:35.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 0x7f17e81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e806d320 con 0x7f17e8154a50 2023-10-16T19:39:35.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8158e40 con 0x7f17e813d660 2023-10-16T19:39:35.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17eff87700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e806e780 con 0x7f17e806adc0 2023-10-16T19:39:35.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17ee524700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17edd23700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17ee524700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56298/0 (socket says 172.21.15.53:56298) 2023-10-16T19:39:35.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17ee524700 1 -- 172.21.15.53:0/463598588 learned_addr learned my addr 172.21.15.53:0/463598588 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.369+0000 7f17edd23700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44444/0 (socket says 172.21.15.53:44444) 2023-10-16T19:39:35.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ed522700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 0x7f17e81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 -- 172.21.15.53:0/463598588 >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 msgr2=0x7f17e806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 -- 172.21.15.53:0/463598588 >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 msgr2=0x7f17e81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 0x7f17e81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 -- 172.21.15.53:0/463598588 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8154f10 con 0x7f17e806adc0 2023-10-16T19:39:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ed522700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 0x7f17e81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:39:35.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17edd23700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:35.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ee524700 1 --2- 172.21.15.53:0/463598588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17e80c15e0 tx=0x7f17e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f01fd597b6cfbd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ecd21700 1 -- 172.21.15.53:0/463598588 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000e070 con 0x7f17e806adc0 2023-10-16T19:39:35.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ecd21700 1 -- 172.21.15.53:0/463598588 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e000b910 con 0x7f17e806adc0 2023-10-16T19:39:35.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.370+0000 7f17ecd21700 1 -- 172.21.15.53:0/463598588 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000bcc0 con 0x7f17e806adc0 2023-10-16T19:39:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 -- 172.21.15.53:0/463598588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 msgr2=0x7f17e8158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 --2- 172.21.15.53:0/463598588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17e80c15e0 tx=0x7f17e000b330 comp rx=0 tx=0).stop 2023-10-16T19:39:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 -- 172.21.15.53:0/463598588 shutdown_connections 2023-10-16T19:39:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 --2- 172.21.15.53:0/463598588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e806adc0 0x7f17e8158900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.53:3300/0 conn(0x7f17e813d660 0x7f17e806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 --2- 172.21.15.53:0/463598588 >> v2:172.21.15.29:3300/0 conn(0x7f17e8154a50 0x7f17e81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 -- 172.21.15.53:0/463598588 >> 172.21.15.53:0/463598588 conn(0x7f17e80c7110 msgr2=0x7f17e80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 -- 172.21.15.53:0/463598588 shutdown_connections 2023-10-16T19:39:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.371+0000 7f17eff87700 1 -- 172.21.15.53:0/463598588 wait complete. 2023-10-16T19:39:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.372+0000 7f17eff87700 1 Processor -- start 2023-10-16T19:39:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.372+0000 7f17eff87700 1 -- start start 2023-10-16T19:39:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 0x7f17e8155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17e8154a50 0x7f17e80c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8138800 con 0x7f17e8154a50 2023-10-16T19:39:35.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80ac0e0 con 0x7f17e806adc0 2023-10-16T19:39:35.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17eff87700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e81531c0 con 0x7f17e813d660 2023-10-16T19:39:35.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44450/0 (socket says 172.21.15.53:44450) 2023-10-16T19:39:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 -- 172.21.15.53:0/3649212837 learned_addr learned my addr 172.21.15.53:0/3649212837 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17ed522700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 0x7f17e8155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17ee524700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17e8154a50 0x7f17e80c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 -- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 msgr2=0x7f17e8155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 0x7f17e8155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 -- 172.21.15.53:0/3649212837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17e8154a50 msgr2=0x7f17e80c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17e8154a50 0x7f17e80c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 -- 172.21.15.53:0/3649212837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40094a0 con 0x7f17e806adc0 2023-10-16T19:39:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17ed522700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 0x7f17e8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.373+0000 7f17edd23700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17e400ec10 tx=0x7f17e400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4009780 con 0x7f17e806adc0 2023-10-16T19:39:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400c850 con 0x7f17e806adc0 2023-10-16T19:39:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400cbe0 con 0x7f17e806adc0 2023-10-16T19:39:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e0009b30 con 0x7f17e806adc0 2023-10-16T19:39:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8137d80 con 0x7f17e806adc0 2023-10-16T19:39:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f17e4005a20 con 0x7f17e806adc0 2023-10-16T19:39:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.374+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f17e40137b0 con 0x7f17e806adc0 2023-10-16T19:39:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.375+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e80ac3c0 con 0x7f17e806adc0 2023-10-16T19:39:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.379+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f17e4021060 con 0x7f17e806adc0 2023-10-16T19:39:35.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.464+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "06866353-b172-43cf-b49c-f51bea367ed6", "id": 0} v 0) v1 -- 0x7f17e80c3780 con 0x7f17e806adc0 2023-10-16T19:39:35.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.468+0000 7f17de7fc700 1 -- 172.21.15.53:0/3649212837 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06866353-b172-43cf-b49c-f51bea367ed6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17e4017070 con 0x7f17e806adc0 2023-10-16T19:39:35.470 INFO:teuthology.orchestra.run.smithi053.stdout:0 2023-10-16T19:39:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.468+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 msgr2=0x7f17e81ed700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.468+0000 7f17eff87700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17e400ec10 tx=0x7f17e400ef20 comp rx=0 tx=0).stop 2023-10-16T19:39:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 shutdown_connections 2023-10-16T19:39:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17e8154a50 0x7f17e80c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17e806adc0 0x7f17e81ed700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 --2- 172.21.15.53:0/3649212837 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f17e813d660 0x7f17e8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 >> 172.21.15.53:0/3649212837 conn(0x7f17e80c7110 msgr2=0x7f17e8136010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 shutdown_connections 2023-10-16T19:39:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.469+0000 7f17eff87700 1 -- 172.21.15.53:0/3649212837 wait complete. 2023-10-16T19:39:35.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 1c40f570-d9a4-459c-8117-ec0ceeb6ac21 1 2023-10-16T19:39:35.556 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:35.554+0000 7fccd482f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:39:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.604+0000 7f03545c0700 1 Processor -- start 2023-10-16T19:39:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.604+0000 7f03545c0700 1 -- start start 2023-10-16T19:39:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f03545c0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f03545c0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f034c06bd60 0x7f034c0a8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f03545c0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c070d90 con 0x7f034c0a86a0 2023-10-16T19:39:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f03545c0700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c155610 con 0x7f034c06bd60 2023-10-16T19:39:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f03545c0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0708a0 con 0x7f034c072580 2023-10-16T19:39:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f0351b5b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f034c06bd60 0x7f034c0a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56306/0 (socket says 172.21.15.53:56306) 2023-10-16T19:39:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 -- 172.21.15.53:0/2763821334 learned_addr learned my addr 172.21.15.53:0/2763821334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 -- 172.21.15.53:0/2763821334 >> v2:172.21.15.53:3300/0 conn(0x7f034c06bd60 msgr2=0x7f034c0a8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 --2- 172.21.15.53:0/2763821334 >> v2:172.21.15.53:3300/0 conn(0x7f034c06bd60 0x7f034c0a8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 -- 172.21.15.53:0/2763821334 >> v1:172.21.15.29:6789/0 conn(0x7f034c0a86a0 legacy=0x7f034c0bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.605+0000 7f035235c700 1 -- 172.21.15.53:0/2763821334 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c070ab0 con 0x7f034c072580 2023-10-16T19:39:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f035235c700 1 --2- 172.21.15.53:0/2763821334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f034800bb90 tx=0x7f034800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35153716b3536b66 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f035135a700 1 -- 172.21.15.53:0/2763821334 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800dd30 con 0x7f034c072580 2023-10-16T19:39:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f035135a700 1 -- 172.21.15.53:0/2763821334 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800de90 con 0x7f034c072580 2023-10-16T19:39:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f035135a700 1 -- 172.21.15.53:0/2763821334 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348010690 con 0x7f034c072580 2023-10-16T19:39:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 -- 172.21.15.53:0/2763821334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 msgr2=0x7f034c072960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 --2- 172.21.15.53:0/2763821334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f034800bb90 tx=0x7f034800bea0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 -- 172.21.15.53:0/2763821334 shutdown_connections 2023-10-16T19:39:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 --2- 172.21.15.53:0/2763821334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c072580 0x7f034c072960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 --2- 172.21.15.53:0/2763821334 >> v2:172.21.15.53:3300/0 conn(0x7f034c06bd60 0x7f034c0a8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 -- 172.21.15.53:0/2763821334 >> 172.21.15.53:0/2763821334 conn(0x7f034c0c30c0 msgr2=0x7f034c0c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 -- 172.21.15.53:0/2763821334 shutdown_connections 2023-10-16T19:39:35.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.606+0000 7f03545c0700 1 -- 172.21.15.53:0/2763821334 wait complete. 2023-10-16T19:39:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 Processor -- start 2023-10-16T19:39:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 -- start start 2023-10-16T19:39:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 0x7f034c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034c0a86a0 0x7f034c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1ea3c0 con 0x7f034c0a86a0 2023-10-16T19:39:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1e97d0 con 0x7f034c072580 2023-10-16T19:39:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f03545c0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1e9a90 con 0x7f034c06bd60 2023-10-16T19:39:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f0351b5b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f035235c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 0x7f034c0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f0351b5b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44464/0 (socket says 172.21.15.53:44464) 2023-10-16T19:39:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f0351b5b700 1 -- 172.21.15.53:0/3477619600 learned_addr learned my addr 172.21.15.53:0/3477619600 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.608+0000 7f0352b5d700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034c0a86a0 0x7f034c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 -- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 msgr2=0x7f034c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 -- 172.21.15.53:0/3477619600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034c0a86a0 msgr2=0x7f034c151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034c0a86a0 0x7f034c151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 -- 172.21.15.53:0/3477619600 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034800b7f0 con 0x7f034c06bd60 2023-10-16T19:39:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0351b5b700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f035235c700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 0x7f034c0a9800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0348018000 tx=0x7f0348004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348003b70 con 0x7f034c06bd60 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348003cf0 con 0x7f034c06bd60 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f03545c0700 1 -- 172.21.15.53:0/3477619600 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c1e9d70 con 0x7f034c06bd60 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480106b0 con 0x7f034c06bd60 2023-10-16T19:39:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f03545c0700 1 -- 172.21.15.53:0/3477619600 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c0a9d40 con 0x7f034c06bd60 2023-10-16T19:39:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0348010b10 con 0x7f034c06bd60 2023-10-16T19:39:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.609+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0348019dd0 con 0x7f034c06bd60 2023-10-16T19:39:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.610+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03280052f0 con 0x7f034c06bd60 2023-10-16T19:39:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.614+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0348019400 con 0x7f034c06bd60 2023-10-16T19:39:35.625 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:35.623+0000 7fccd482f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:39:35.642 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.640+0000 7f86492f1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:39:35.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.700+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1c40f570-d9a4-459c-8117-ec0ceeb6ac21", "id": 1} v 0) v1 -- 0x7f0328005910 con 0x7f034c06bd60 2023-10-16T19:39:35.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.703+0000 7f0342ffd700 1 -- 172.21.15.53:0/3477619600 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c40f570-d9a4-459c-8117-ec0ceeb6ac21", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f034802b420 con 0x7f034c06bd60 2023-10-16T19:39:35.705 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-10-16T19:39:35.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 msgr2=0x7f034c0a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 0x7f034c0a9800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0348018000 tx=0x7f0348004750 comp rx=0 tx=0).stop 2023-10-16T19:39:35.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 shutdown_connections 2023-10-16T19:39:35.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034c0a86a0 0x7f034c151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f034c06bd60 0x7f034c0a9800 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 --2- 172.21.15.53:0/3477619600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f034c072580 0x7f034c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 >> 172.21.15.53:0/3477619600 conn(0x7f034c0c30c0 msgr2=0x7f034c14e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 shutdown_connections 2023-10-16T19:39:35.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.704+0000 7f0340ff9700 1 -- 172.21.15.53:0/3477619600 wait complete. 2023-10-16T19:39:35.708 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:35.705+0000 7fccd482f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:39:35.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new ab4e905e-cd2e-4796-a59b-687c97a91693 2 2023-10-16T19:39:35.769 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.768+0000 7f86492f1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:39:35.789 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:35.787+0000 7fccd482f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:39:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.841+0000 7f0265ceb700 1 Processor -- start 2023-10-16T19:39:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.841+0000 7f0265ceb700 1 -- start start 2023-10-16T19:39:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f0265ceb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f0265ceb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0260155e00 0x7f0260156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f0265ceb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02600bd0e0 con 0x7f02600c4f50 2023-10-16T19:39:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f0265ceb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02600c3000 con 0x7f0260155e00 2023-10-16T19:39:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f0265ceb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600c5330 con 0x7f02600c7bb0 2023-10-16T19:39:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f025ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0260155e00 0x7f0260156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f025effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f025ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0260155e00 0x7f0260156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44472/0 (socket says 172.21.15.53:44472) 2023-10-16T19:39:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f025f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f02600c4f50 0x7f0260070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48270/0 (socket says 172.21.15.53:48270) 2023-10-16T19:39:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.842+0000 7f025ffff700 1 -- 172.21.15.53:0/1303970806 learned_addr learned my addr 172.21.15.53:0/1303970806 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025ffff700 1 -- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 msgr2=0x7f0260153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025ffff700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025ffff700 1 -- 172.21.15.53:0/1303970806 >> v1:172.21.15.53:6789/0 conn(0x7f02600c4f50 legacy=0x7f0260070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025ffff700 1 -- 172.21.15.53:0/1303970806 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600c2a40 con 0x7f0260155e00 2023-10-16T19:39:35.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025e7fc700 1 -- 172.21.15.53:0/1303970806 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237836430 0 0) 0x7f02600bd0e0 con 0x7f02600c4f50 2023-10-16T19:39:35.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025effd700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:35.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025ffff700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f0260156290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0258009e50 tx=0x7f025800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50031201331b0ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025e7fc700 1 -- 172.21.15.53:0/1303970806 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800e070 con 0x7f0260155e00 2023-10-16T19:39:35.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025e7fc700 1 -- 172.21.15.53:0/1303970806 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800b910 con 0x7f0260155e00 2023-10-16T19:39:35.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.843+0000 7f025e7fc700 1 -- 172.21.15.53:0/1303970806 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800bcc0 con 0x7f0260155e00 2023-10-16T19:39:35.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 -- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 msgr2=0x7f0260156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f0260156290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0258009e50 tx=0x7f025800b330 comp rx=0 tx=0).stop 2023-10-16T19:39:35.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 -- 172.21.15.53:0/1303970806 shutdown_connections 2023-10-16T19:39:35.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f0260156290 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 --2- 172.21.15.53:0/1303970806 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 -- 172.21.15.53:0/1303970806 >> 172.21.15.53:0/1303970806 conn(0x7f02600a9cd0 msgr2=0x7f02600aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 -- 172.21.15.53:0/1303970806 shutdown_connections 2023-10-16T19:39:35.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.844+0000 7f0265ceb700 1 -- 172.21.15.53:0/1303970806 wait complete. 2023-10-16T19:39:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.845+0000 7f0265ceb700 1 Processor -- start 2023-10-16T19:39:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.845+0000 7f0265ceb700 1 -- start start 2023-10-16T19:39:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02600c4f50 0x7f02600c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f02601eade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260152810 con 0x7f02600c4f50 2023-10-16T19:39:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600bf470 con 0x7f0260155e00 2023-10-16T19:39:35.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0265ceb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600c0710 con 0x7f02600c7bb0 2023-10-16T19:39:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f02601eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56326/0 (socket says 172.21.15.53:56326) 2023-10-16T19:39:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025effd700 1 -- 172.21.15.53:0/3723159411 learned_addr learned my addr 172.21.15.53:0/3723159411 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:35.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025f7fe700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02600c4f50 0x7f02600c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 -- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 msgr2=0x7f0260151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 -- 172.21.15.53:0/3723159411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02600c4f50 msgr2=0x7f02600c01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02600c4f50 0x7f02600c01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 -- 172.21.15.53:0/3723159411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540094a0 con 0x7f0260155e00 2023-10-16T19:39:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025effd700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f025ffff700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f02601eade0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0258015000 tx=0x7f0258004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258004880 con 0x7f0260155e00 2023-10-16T19:39:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580099b0 con 0x7f0260155e00 2023-10-16T19:39:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.846+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025801b670 con 0x7f0260155e00 2023-10-16T19:39:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.847+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0258009b30 con 0x7f0260155e00 2023-10-16T19:39:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.847+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0260152ab0 con 0x7f0260155e00 2023-10-16T19:39:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.847+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f025801bad0 con 0x7f0260155e00 2023-10-16T19:39:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.847+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f025801bd80 con 0x7f0260155e00 2023-10-16T19:39:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.847+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026004f400 con 0x7f0260155e00 2023-10-16T19:39:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.850+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0258042b40 con 0x7f0260155e00 2023-10-16T19:39:35.860 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.858+0000 7f86492f1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:39:35.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.935+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab4e905e-cd2e-4796-a59b-687c97a91693", "id": 2} v 0) v1 -- 0x7f02600c8290 con 0x7f0260155e00 2023-10-16T19:39:35.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.938+0000 7f0247fff700 1 -- 172.21.15.53:0/3723159411 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab4e905e-cd2e-4796-a59b-687c97a91693", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0258031070 con 0x7f0260155e00 2023-10-16T19:39:35.940 INFO:teuthology.orchestra.run.smithi053.stdout:2 2023-10-16T19:39:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 msgr2=0x7f02601eade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f02601eade0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0258015000 tx=0x7f0258004ad0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 shutdown_connections 2023-10-16T19:39:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0260155e00 0x7f02601eade0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02600c4f50 0x7f02600c01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 --2- 172.21.15.53:0/3723159411 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02600c7bb0 0x7f0260151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:35.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 >> 172.21.15.53:0/3723159411 conn(0x7f02600a9cd0 msgr2=0x7f02600aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:35.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 shutdown_connections 2023-10-16T19:39:35.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:35.939+0000 7f0265ceb700 1 -- 172.21.15.53:0/3723159411 wait complete. 2023-10-16T19:39:35.943 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:35.939+0000 7fccd482f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:39:35.946 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:35.944+0000 7f86492f1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:39:35.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new e7423588-87f9-46e0-abe9-d6d07cb76ec2 3 2023-10-16T19:39:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.077+0000 7f4fae580700 1 Processor -- start 2023-10-16T19:39:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.077+0000 7f4fae580700 1 -- start start 2023-10-16T19:39:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fae580700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4fa814ec50 0x7f4fa81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fae580700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fae580700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa8155af0 con 0x7f4fa80c3350 2023-10-16T19:39:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fae580700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa8152300 con 0x7f4fa814ec50 2023-10-16T19:39:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fae580700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c2e40 con 0x7f4fa806db00 2023-10-16T19:39:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4facb1d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fa7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4fa814ec50 0x7f4fa81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4facb1d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56334/0 (socket says 172.21.15.53:56334) 2023-10-16T19:39:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4fa7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4fa814ec50 0x7f4fa81555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44480/0 (socket says 172.21.15.53:44480) 2023-10-16T19:39:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.078+0000 7f4facb1d700 1 -- 172.21.15.53:0/776928572 learned_addr learned my addr 172.21.15.53:0/776928572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa7fff700 1 -- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 msgr2=0x7f4fa806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa7fff700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa7fff700 1 -- 172.21.15.53:0/776928572 >> v1:172.21.15.29:6789/0 conn(0x7f4fa80c3350 legacy=0x7f4fa8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa7fff700 1 -- 172.21.15.53:0/776928572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa814f030 con 0x7f4fa814ec50 2023-10-16T19:39:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4facb1d700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa7fff700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81555b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009840 tx=0x7f4f98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b84381d1d2d7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa6ffd700 1 -- 172.21.15.53:0/776928572 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98011830 con 0x7f4fa814ec50 2023-10-16T19:39:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa6ffd700 1 -- 172.21.15.53:0/776928572 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f98011990 con 0x7f4fa814ec50 2023-10-16T19:39:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.079+0000 7f4fa6ffd700 1 -- 172.21.15.53:0/776928572 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98011d20 con 0x7f4fa814ec50 2023-10-16T19:39:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 -- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 msgr2=0x7f4fa81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81555b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009840 tx=0x7f4f98009b50 comp rx=0 tx=0).stop 2023-10-16T19:39:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 -- 172.21.15.53:0/776928572 shutdown_connections 2023-10-16T19:39:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa806db00 0x7f4fa806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 --2- 172.21.15.53:0/776928572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81555b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 -- 172.21.15.53:0/776928572 >> 172.21.15.53:0/776928572 conn(0x7f4fa80c7110 msgr2=0x7f4fa80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 -- 172.21.15.53:0/776928572 shutdown_connections 2023-10-16T19:39:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.080+0000 7f4fae580700 1 -- 172.21.15.53:0/776928572 wait complete. 2023-10-16T19:39:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.081+0000 7f4fae580700 1 Processor -- start 2023-10-16T19:39:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.082+0000 7f4fae580700 1 -- start start 2023-10-16T19:39:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 0x7f4fa8142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 0x7f4fa81dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81ddac0 con 0x7f4fa806db00 2023-10-16T19:39:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c5400 con 0x7f4fa814ec50 2023-10-16T19:39:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fae580700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c4c10 con 0x7f4fa80c3350 2023-10-16T19:39:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fa77fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 0x7f4fa81dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fa7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 0x7f4fa8142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44490/0 (socket says 172.21.15.53:44490) 2023-10-16T19:39:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fa77fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 0x7f4fa81dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56338/0 (socket says 172.21.15.53:56338) 2023-10-16T19:39:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4fa7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 0x7f4fa8142e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.53:59204/0 (socket says 172.21.15.53:59204) 2023-10-16T19:39:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 -- 172.21.15.53:0/1100113543 learned_addr learned my addr 172.21.15.53:0/1100113543 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 -- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 msgr2=0x7f4fa81dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 0x7f4fa81dd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 -- 172.21.15.53:0/1100113543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 msgr2=0x7f4fa8142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 0x7f4fa8142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 -- 172.21.15.53:0/1100113543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa000bd40 con 0x7f4fa814ec50 2023-10-16T19:39:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.083+0000 7f4facb1d700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e370 tx=0x7f4fa000e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0018070 con 0x7f4fa814ec50 2023-10-16T19:39:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0009380 con 0x7f4fa814ec50 2023-10-16T19:39:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0010040 con 0x7f4fa814ec50 2023-10-16T19:39:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f980094a0 con 0x7f4fa814ec50 2023-10-16T19:39:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa8150d30 con 0x7f4fa814ec50 2023-10-16T19:39:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4fa000b0d0 con 0x7f4fa814ec50 2023-10-16T19:39:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.084+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4fa0004020 con 0x7f4fa814ec50 2023-10-16T19:39:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.085+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa8151250 con 0x7f4fa814ec50 2023-10-16T19:39:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.087+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4fa8151250 con 0x7f4fa814ec50 2023-10-16T19:39:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.172+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7423588-87f9-46e0-abe9-d6d07cb76ec2", "id": 3} v 0) v1 -- 0x7f4fa8151430 con 0x7f4fa814ec50 2023-10-16T19:39:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.175+0000 7f4fa4ff9700 1 -- 172.21.15.53:0/1100113543 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7423588-87f9-46e0-abe9-d6d07cb76ec2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4fa0009600 con 0x7f4fa814ec50 2023-10-16T19:39:36.177 INFO:teuthology.orchestra.run.smithi053.stdout:3 2023-10-16T19:39:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 msgr2=0x7f4fa81dd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e370 tx=0x7f4fa000e680 comp rx=0 tx=0).stop 2023-10-16T19:39:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 shutdown_connections 2023-10-16T19:39:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa814ec50 0x7f4fa81dd580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4fa806db00 0x7f4fa8142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 --2- 172.21.15.53:0/1100113543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fa80c3350 0x7f4fa81dd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 >> 172.21.15.53:0/1100113543 conn(0x7f4fa80c7110 msgr2=0x7f4fa806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 shutdown_connections 2023-10-16T19:39:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.176+0000 7f4fae580700 1 -- 172.21.15.53:0/1100113543 wait complete. 2023-10-16T19:39:36.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new c07bcb23-0ea5-4925-8f3c-10b958cad730 4 2023-10-16T19:39:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.311+0000 7f058af7d700 1 Processor -- start 2023-10-16T19:39:36.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.311+0000 7f058af7d700 1 -- start start 2023-10-16T19:39:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.312+0000 7f058af7d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.312+0000 7f058af7d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f058413dd00 0x7f0584158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f058af7d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0584158e40 con 0x7f058413d660 2023-10-16T19:39:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f058af7d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058406d320 con 0x7f058413dd00 2023-10-16T19:39:36.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f058af7d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058406e780 con 0x7f0584154a50 2023-10-16T19:39:36.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56344/0 (socket says 172.21.15.53:56344) 2023-10-16T19:39:36.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 -- 172.21.15.53:0/3745283290 learned_addr learned my addr 172.21.15.53:0/3745283290 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f058951a700 1 --2- 172.21.15.53:0/3745283290 >> v2:172.21.15.29:3300/0 conn(0x7f058413dd00 0x7f0584158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f05837fe700 1 -- 172.21.15.53:0/3745283290 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144159199 0 0) 0x7f0584158e40 con 0x7f058413d660 2023-10-16T19:39:36.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 -- 172.21.15.53:0/3745283290 >> v2:172.21.15.29:3300/0 conn(0x7f058413dd00 msgr2=0x7f0584158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:36.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 --2- 172.21.15.53:0/3745283290 >> v2:172.21.15.29:3300/0 conn(0x7f058413dd00 0x7f0584158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 -- 172.21.15.53:0/3745283290 >> v1:172.21.15.53:6789/0 conn(0x7f058413d660 legacy=0x7f058406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 -- 172.21.15.53:0/3745283290 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584154f10 con 0x7f0584154a50 2023-10-16T19:39:36.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f0583fff700 1 --2- 172.21.15.53:0/3745283290 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05700098f0 tx=0x7f0570009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdccc34fa5263b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f05837fe700 1 -- 172.21.15.53:0/3745283290 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011830 con 0x7f0584154a50 2023-10-16T19:39:36.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f05837fe700 1 -- 172.21.15.53:0/3745283290 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570011990 con 0x7f0584154a50 2023-10-16T19:39:36.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.313+0000 7f05837fe700 1 -- 172.21.15.53:0/3745283290 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011d20 con 0x7f0584154a50 2023-10-16T19:39:36.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 -- 172.21.15.53:0/3745283290 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 msgr2=0x7f05841583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 --2- 172.21.15.53:0/3745283290 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05700098f0 tx=0x7f0570009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:36.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 -- 172.21.15.53:0/3745283290 shutdown_connections 2023-10-16T19:39:36.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 --2- 172.21.15.53:0/3745283290 >> v2:172.21.15.29:3300/0 conn(0x7f058413dd00 0x7f0584158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 --2- 172.21.15.53:0/3745283290 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841583c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 -- 172.21.15.53:0/3745283290 >> 172.21.15.53:0/3745283290 conn(0x7f05840c7110 msgr2=0x7f05840c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 -- 172.21.15.53:0/3745283290 shutdown_connections 2023-10-16T19:39:36.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.314+0000 7f058af7d700 1 -- 172.21.15.53:0/3745283290 wait complete. 2023-10-16T19:39:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.316+0000 7f058af7d700 1 Processor -- start 2023-10-16T19:39:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.316+0000 7f058af7d700 1 -- start start 2023-10-16T19:39:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f058413dd00 0x7f05840c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0584156ee0 con 0x7f058413dd00 2023-10-16T19:39:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0584155a60 con 0x7f058413d660 2023-10-16T19:39:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058af7d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05841578f0 con 0x7f0584154a50 2023-10-16T19:39:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058951a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058951a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56352/0 (socket says 172.21.15.53:56352) 2023-10-16T19:39:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44498/0 (socket says 172.21.15.53:44498) 2023-10-16T19:39:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058951a700 1 -- 172.21.15.53:0/63786244 learned_addr learned my addr 172.21.15.53:0/63786244 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0583fff700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f058413dd00 0x7f05840c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 -- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 msgr2=0x7f05841537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 -- 172.21.15.53:0/63786244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f058413dd00 msgr2=0x7f05840c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f058413dd00 0x7f05840c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 -- 172.21.15.53:0/63786244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009550 con 0x7f058413d660 2023-10-16T19:39:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f058951a700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f0588d19700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f057800c3e0 tx=0x7f057800c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.317+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780052d0 con 0x7f058413d660 2023-10-16T19:39:36.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578005430 con 0x7f058413d660 2023-10-16T19:39:36.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0584157bd0 con 0x7f058413d660 2023-10-16T19:39:36.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780038a0 con 0x7f058413d660 2023-10-16T19:39:36.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05840c2f10 con 0x7f058413d660 2023-10-16T19:39:36.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0578003d00 con 0x7f058413d660 2023-10-16T19:39:36.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.318+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0578012910 con 0x7f058413d660 2023-10-16T19:39:36.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.319+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584138340 con 0x7f058413d660 2023-10-16T19:39:36.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.321+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0578017070 con 0x7f058413d660 2023-10-16T19:39:36.361 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:36.359+0000 7fccd482f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:39:36.407 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:36.405+0000 7f86492f1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:39:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.406+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c07bcb23-0ea5-4925-8f3c-10b958cad730", "id": 4} v 0) v1 -- 0x7f05840c3760 con 0x7f058413d660 2023-10-16T19:39:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.409+0000 7f05817fa700 1 -- 172.21.15.53:0/63786244 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c07bcb23-0ea5-4925-8f3c-10b958cad730", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0578012d20 con 0x7f058413d660 2023-10-16T19:39:36.411 INFO:teuthology.orchestra.run.smithi053.stdout:4 2023-10-16T19:39:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 msgr2=0x7f0584156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f057800c3e0 tx=0x7f057800c6f0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 shutdown_connections 2023-10-16T19:39:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0584154a50 0x7f05841537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f058413d660 0x7f0584156800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 --2- 172.21.15.53:0/63786244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f058413dd00 0x7f05840c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 >> 172.21.15.53:0/63786244 conn(0x7f05840c7110 msgr2=0x7f0584136070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 shutdown_connections 2023-10-16T19:39:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.410+0000 7f058af7d700 1 -- 172.21.15.53:0/63786244 wait complete. 2023-10-16T19:39:36.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new d72ef02a-fb95-4fc4-a63e-28b1a61eccf4 5 2023-10-16T19:39:36.484 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:36.482+0000 7fccd482f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:39:36.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.549+0000 7fd624343700 1 Processor -- start 2023-10-16T19:39:36.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.549+0000 7fd624343700 1 -- start start 2023-10-16T19:39:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd624343700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd624343700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd61c0c57c0 0x7fd61c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd624343700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0c5580 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd624343700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0c5310 con 0x7fd61c0c57c0 2023-10-16T19:39:36.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd624343700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c06c480 con 0x7fd61c151fa0 2023-10-16T19:39:36.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6220df700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd61c0c57c0 0x7fd61c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6220df700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56354/0 (socket says 172.21.15.53:56354) 2023-10-16T19:39:36.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6220df700 1 -- 172.21.15.53:0/2232134237 learned_addr learned my addr 172.21.15.53:0/2232134237 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 -- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 msgr2=0x7fd61c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:36.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 -- 172.21.15.53:0/2232134237 >> v1:172.21.15.29:6789/0 conn(0x7fd61c0c4dd0 legacy=0x7fd61c157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 -- 172.21.15.53:0/2232134237 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c06b980 con 0x7fd61c0c57c0 2023-10-16T19:39:36.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6220df700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:36.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.550+0000 7fd6228e0700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c0c57c0 0x7fd61c1586b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd614009d90 tx=0x7fd61400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be08ccb46f4e59cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd6210dd700 1 -- 172.21.15.53:0/2232134237 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400e070 con 0x7fd61c0c57c0 2023-10-16T19:39:36.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd6210dd700 1 -- 172.21.15.53:0/2232134237 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400bb20 con 0x7fd61c0c57c0 2023-10-16T19:39:36.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd6210dd700 1 -- 172.21.15.53:0/2232134237 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614012430 con 0x7fd61c0c57c0 2023-10-16T19:39:36.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 -- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c0c57c0 msgr2=0x7fd61c1586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c0c57c0 0x7fd61c1586b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd614009d90 tx=0x7fd61400b330 comp rx=0 tx=0).stop 2023-10-16T19:39:36.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 -- 172.21.15.53:0/2232134237 shutdown_connections 2023-10-16T19:39:36.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c0c57c0 0x7fd61c1586b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 --2- 172.21.15.53:0/2232134237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c151fa0 0x7fd61c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 -- 172.21.15.53:0/2232134237 >> 172.21.15.53:0/2232134237 conn(0x7fd61c0abf40 msgr2=0x7fd61c0ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 -- 172.21.15.53:0/2232134237 shutdown_connections 2023-10-16T19:39:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.551+0000 7fd624343700 1 -- 172.21.15.53:0/2232134237 wait complete. 2023-10-16T19:39:36.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.552+0000 7fd624343700 1 Processor -- start 2023-10-16T19:39:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.552+0000 7fd624343700 1 -- start start 2023-10-16T19:39:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 0x7fd61c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd61c0c57c0 0x7fd61c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c1700 con 0x7fd61c0c57c0 2023-10-16T19:39:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c14c3e0 con 0x7fd61c151fa0 2023-10-16T19:39:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd624343700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c14c6c0 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd6228e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd6228e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44514/0 (socket says 172.21.15.53:44514) 2023-10-16T19:39:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd6220df700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 0x7fd61c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd6228e0700 1 -- 172.21.15.53:0/89576716 learned_addr learned my addr 172.21.15.53:0/89576716 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.553+0000 7fd6218de700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd61c0c57c0 0x7fd61c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 -- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 msgr2=0x7fd61c14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 -- 172.21.15.53:0/89576716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd61c0c57c0 msgr2=0x7fd61c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd61c0c57c0 0x7fd61c156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 -- 172.21.15.53:0/89576716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618009550 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6228e0700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd6220df700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 0x7fd61c0c3f80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd61800e9a0 tx=0x7fd61800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618004030 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd618004190 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd614009a70 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618004520 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.554+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c157460 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.555+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd618005d20 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.555+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c14c240 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.555+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd618003c20 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.558+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd61c14c240 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.571 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:36.569+0000 7fccd482f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:39:36.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.643+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d72ef02a-fb95-4fc4-a63e-28b1a61eccf4", "id": 5} v 0) v1 -- 0x7fd61c04f400 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd612ffd700 1 -- 172.21.15.53:0/89576716 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d72ef02a-fb95-4fc4-a63e-28b1a61eccf4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd618020060 con 0x7fd61c0c4dd0 2023-10-16T19:39:36.648 INFO:teuthology.orchestra.run.smithi053.stdout:5 2023-10-16T19:39:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 msgr2=0x7fd61c0c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd624343700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 0x7fd61c0c3f80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd61800e9a0 tx=0x7fd61800ecb0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 shutdown_connections 2023-10-16T19:39:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd624343700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd61c151fa0 0x7fd61c14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.646+0000 7fd624343700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd61c0c4dd0 0x7fd61c0c3f80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.647+0000 7fd624343700 1 --2- 172.21.15.53:0/89576716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd61c0c57c0 0x7fd61c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.647+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 >> 172.21.15.53:0/89576716 conn(0x7fd61c0abf40 msgr2=0x7fd61c1507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.647+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 shutdown_connections 2023-10-16T19:39:36.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.647+0000 7fd624343700 1 -- 172.21.15.53:0/89576716 wait complete. 2023-10-16T19:39:36.656 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:36.655+0000 7fccd482f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:39:36.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new ec63487a-5c95-434f-b496-45772807e42a 6 2023-10-16T19:39:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.784+0000 7f1a9c51d700 1 Processor -- start 2023-10-16T19:39:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.784+0000 7f1a9c51d700 1 -- start start 2023-10-16T19:39:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9c51d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a940c4f50 0x7f1a94153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9c51d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 0x7f1a94156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9c51d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940bd0e0 con 0x7f1a940c7bb0 2023-10-16T19:39:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9c51d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940c3000 con 0x7f1a94155e00 2023-10-16T19:39:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9c51d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940c5330 con 0x7f1a940c4f50 2023-10-16T19:39:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a940c4f50 0x7f1a94153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a940c4f50 0x7f1a94153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44516/0 (socket says 172.21.15.53:44516) 2023-10-16T19:39:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/225185089 learned_addr learned my addr 172.21.15.53:0/225185089 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9aaba700 1 --2- 172.21.15.53:0/225185089 >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 0x7f1a94156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/225185089 >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 msgr2=0x7f1a94156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 --2- 172.21.15.53:0/225185089 >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 0x7f1a94156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/225185089 >> v1:172.21.15.53:6789/0 conn(0x7f1a940c7bb0 legacy=0x7f1a94070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/225185089 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940c2a40 con 0x7f1a940c4f50 2023-10-16T19:39:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a992b7700 1 -- 172.21.15.53:0/225185089 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702793632 0 0) 0x7f1a940bd0e0 con 0x7f1a940c7bb0 2023-10-16T19:39:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.786+0000 7f1a9aaba700 1 --2- 172.21.15.53:0/225185089 >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 0x7f1a94156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.787+0000 7f1a9a2b9700 1 --2- 172.21.15.53:0/225185089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a94153290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a900098f0 tx=0x7f1a90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd53d7dbc1b51b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.787+0000 7f1a992b7700 1 -- 172.21.15.53:0/225185089 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000b860 con 0x7f1a940c4f50 2023-10-16T19:39:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.787+0000 7f1a992b7700 1 -- 172.21.15.53:0/225185089 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9000b9c0 con 0x7f1a940c4f50 2023-10-16T19:39:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.787+0000 7f1a992b7700 1 -- 172.21.15.53:0/225185089 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000bd50 con 0x7f1a940c4f50 2023-10-16T19:39:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 -- 172.21.15.53:0/225185089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 msgr2=0x7f1a94153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/225185089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a94153290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a900098f0 tx=0x7f1a90009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 -- 172.21.15.53:0/225185089 shutdown_connections 2023-10-16T19:39:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/225185089 >> v2:172.21.15.29:3300/0 conn(0x7f1a94155e00 0x7f1a94156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/225185089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a94153290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 -- 172.21.15.53:0/225185089 >> 172.21.15.53:0/225185089 conn(0x7f1a940a9cd0 msgr2=0x7f1a940aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 -- 172.21.15.53:0/225185089 shutdown_connections 2023-10-16T19:39:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.788+0000 7f1a9c51d700 1 -- 172.21.15.53:0/225185089 wait complete. 2023-10-16T19:39:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.790+0000 7f1a9c51d700 1 Processor -- start 2023-10-16T19:39:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.790+0000 7f1a9c51d700 1 -- start start 2023-10-16T19:39:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94155e00 0x7f1a940c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940c02d0 con 0x7f1a94155e00 2023-10-16T19:39:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94151dd0 con 0x7f1a940c4f50 2023-10-16T19:39:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941e8b10 con 0x7f1a940c7bb0 2023-10-16T19:39:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a99ab8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a99ab8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56374/0 (socket says 172.21.15.53:56374) 2023-10-16T19:39:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44522/0 (socket says 172.21.15.53:44522) 2023-10-16T19:39:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a99ab8700 1 -- 172.21.15.53:0/4234315728 learned_addr learned my addr 172.21.15.53:0/4234315728 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9aaba700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94155e00 0x7f1a940c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 msgr2=0x7f1a940bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/4234315728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94155e00 msgr2=0x7f1a940c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94155e00 0x7f1a940c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 -- 172.21.15.53:0/4234315728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009550 con 0x7f1a940c4f50 2023-10-16T19:39:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a99ab8700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9a2b9700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a90016000 tx=0x7f1a90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90004300 con 0x7f1a940c4f50 2023-10-16T19:39:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9001f070 con 0x7f1a940c4f50 2023-10-16T19:39:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.791+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a941514a0 con 0x7f1a940c4f50 2023-10-16T19:39:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.792+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900036a0 con 0x7f1a940c4f50 2023-10-16T19:39:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.792+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94151a60 con 0x7f1a940c4f50 2023-10-16T19:39:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.792+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a90021030 con 0x7f1a940c4f50 2023-10-16T19:39:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.792+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1a9001ae00 con 0x7f1a940c4f50 2023-10-16T19:39:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.792+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a94151bf0 con 0x7f1a940c4f50 2023-10-16T19:39:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.796+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1a90015020 con 0x7f1a940c4f50 2023-10-16T19:39:36.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.927+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec63487a-5c95-434f-b496-45772807e42a", "id": 6} v 0) v1 -- 0x7f1a9404f400 con 0x7f1a940c4f50 2023-10-16T19:39:36.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.930+0000 7f1a8affd700 1 -- 172.21.15.53:0/4234315728 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec63487a-5c95-434f-b496-45772807e42a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a90003c40 con 0x7f1a940c4f50 2023-10-16T19:39:36.932 INFO:teuthology.orchestra.run.smithi053.stdout:6 2023-10-16T19:39:36.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 msgr2=0x7f1a941e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:36.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a90016000 tx=0x7f1a90004750 comp rx=0 tx=0).stop 2023-10-16T19:39:36.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 shutdown_connections 2023-10-16T19:39:36.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94155e00 0x7f1a940c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a940c4f50 0x7f1a941e53a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 --2- 172.21.15.53:0/4234315728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1a940c7bb0 0x7f1a940bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:36.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 >> 172.21.15.53:0/4234315728 conn(0x7f1a940a9cd0 msgr2=0x7f1a94156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:36.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 shutdown_connections 2023-10-16T19:39:36.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:36.931+0000 7f1a9c51d700 1 -- 172.21.15.53:0/4234315728 wait complete. 2023-10-16T19:39:36.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6 7 2023-10-16T19:39:37.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.070+0000 7f772b28e700 1 Processor -- start 2023-10-16T19:39:37.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.071+0000 7f772b28e700 1 -- start start 2023-10-16T19:39:37.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772b28e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77240be280 0x7f77240c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772b28e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 0x7f77240a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772b28e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7724158e30 con 0x7f77240c2a40 2023-10-16T19:39:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772b28e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7724158b50 con 0x7f77240be280 2023-10-16T19:39:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772b28e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772406ba30 con 0x7f77240c7c10 2023-10-16T19:39:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772982b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 0x7f77240a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f7728829700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f77240c2a40 0x7f77240a6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48332/0 (socket says 172.21.15.53:48332) 2023-10-16T19:39:37.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f7728829700 1 -- 172.21.15.53:0/3592845152 learned_addr learned my addr 172.21.15.53:0/3592845152 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-10-16T19:39:37.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772902a700 1 --2- 172.21.15.53:0/3592845152 >> v2:172.21.15.29:3300/0 conn(0x7f77240be280 0x7f77240c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772982b700 1 -- 172.21.15.53:0/3592845152 >> v2:172.21.15.29:3300/0 conn(0x7f77240be280 msgr2=0x7f77240c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:37.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772982b700 1 --2- 172.21.15.53:0/3592845152 >> v2:172.21.15.29:3300/0 conn(0x7f77240be280 0x7f77240c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772982b700 1 -- 172.21.15.53:0/3592845152 >> v1:172.21.15.53:6789/0 conn(0x7f77240c2a40 legacy=0x7f77240a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f771bfff700 1 -- 172.21.15.53:0/3592845152 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562997101 0 0) 0x7f7724158e30 con 0x7f77240c2a40 2023-10-16T19:39:37.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.072+0000 7f772982b700 1 -- 172.21.15.53:0/3592845152 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772406bd10 con 0x7f77240c7c10 2023-10-16T19:39:37.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772982b700 1 --2- 172.21.15.53:0/3592845152 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 0x7f77240a75e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f771c009d90 tx=0x7f771c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f9e855ca217ded server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:37.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f771bfff700 1 -- 172.21.15.53:0/3592845152 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c00e070 con 0x7f77240c7c10 2023-10-16T19:39:37.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f771bfff700 1 -- 172.21.15.53:0/3592845152 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c00bb20 con 0x7f77240c7c10 2023-10-16T19:39:37.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f771bfff700 1 -- 172.21.15.53:0/3592845152 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c012430 con 0x7f77240c7c10 2023-10-16T19:39:37.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 -- 172.21.15.53:0/3592845152 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 msgr2=0x7f77240a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 --2- 172.21.15.53:0/3592845152 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 0x7f77240a75e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f771c009d90 tx=0x7f771c00b330 comp rx=0 tx=0).stop 2023-10-16T19:39:37.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 -- 172.21.15.53:0/3592845152 shutdown_connections 2023-10-16T19:39:37.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 --2- 172.21.15.53:0/3592845152 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240c7c10 0x7f77240a75e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 --2- 172.21.15.53:0/3592845152 >> v2:172.21.15.29:3300/0 conn(0x7f77240be280 0x7f77240c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 -- 172.21.15.53:0/3592845152 >> 172.21.15.53:0/3592845152 conn(0x7f77240a9cd0 msgr2=0x7f77240aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:37.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 -- 172.21.15.53:0/3592845152 shutdown_connections 2023-10-16T19:39:37.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.073+0000 7f772b28e700 1 -- 172.21.15.53:0/3592845152 wait complete. 2023-10-16T19:39:37.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.075+0000 7f772b28e700 1 Processor -- start 2023-10-16T19:39:37.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.075+0000 7f772b28e700 1 -- start start 2023-10-16T19:39:37.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 0x7f77240a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77240c7c10 0x7f77241ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240acec0 con 0x7f77240c7c10 2023-10-16T19:39:37.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240abb50 con 0x7f77240c2a40 2023-10-16T19:39:37.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772b28e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240abe30 con 0x7f77240be280 2023-10-16T19:39:37.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f7728829700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 0x7f77240a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:56384/0 (socket says 172.21.15.53:56384) 2023-10-16T19:39:37.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 -- 172.21.15.53:0/2071472943 learned_addr learned my addr 172.21.15.53:0/2071472943 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-10-16T19:39:37.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772982b700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77240c7c10 0x7f77241ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 -- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 msgr2=0x7f77240a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 0x7f77240a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 -- 172.21.15.53:0/2071472943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77240c7c10 msgr2=0x7f77241ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77240c7c10 0x7f77241ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f772902a700 1 -- 172.21.15.53:0/2071472943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c009a70 con 0x7f77240be280 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.076+0000 7f7728829700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 0x7f77240a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f772902a700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f772000e8a0 tx=0x7f772000ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720009590 con 0x7f77240be280 2023-10-16T19:39:37.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720013680 con 0x7f77240be280 2023-10-16T19:39:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77241e9ab0 con 0x7f77240be280 2023-10-16T19:39:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200139f0 con 0x7f77240be280 2023-10-16T19:39:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241e97a0 con 0x7f77240be280 2023-10-16T19:39:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7720005a20 con 0x7f77240be280 2023-10-16T19:39:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.077+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7720006660 con 0x7f77240be280 2023-10-16T19:39:37.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.078+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240ac000 con 0x7f77240be280 2023-10-16T19:39:37.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.080+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7720021060 con 0x7f77240be280 2023-10-16T19:39:37.101 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:37.099+0000 7f86492f1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:39:37.117 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:37.115+0000 7fccd482f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:39:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.166+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6", "id": 7} v 0) v1 -- 0x7f772404f400 con 0x7f77240be280 2023-10-16T19:39:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.169+0000 7f7719ffb700 1 -- 172.21.15.53:0/2071472943 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7720017070 con 0x7f77240be280 2023-10-16T19:39:37.171 INFO:teuthology.orchestra.run.smithi053.stdout:7 2023-10-16T19:39:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 msgr2=0x7f77241ea2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f772000e8a0 tx=0x7f772000ebb0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 shutdown_connections 2023-10-16T19:39:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77240c7c10 0x7f77241ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77240be280 0x7f77241ea2b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 --2- 172.21.15.53:0/2071472943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77240c2a40 0x7f77240a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 >> 172.21.15.53:0/2071472943 conn(0x7f77240a9cd0 msgr2=0x7f77240c2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 shutdown_connections 2023-10-16T19:39:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-10-16T19:39:37.170+0000 7f772b28e700 1 -- 172.21.15.53:0/2071472943 wait complete. 2023-10-16T19:39:37.174 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:37.172+0000 7f86492f1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:39:37.184 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T19:39:37.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T19:39:37.186 INFO:tasks.ceph.osd.0:Started 2023-10-16T19:39:37.187 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T19:39:37.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T19:39:37.189 INFO:tasks.ceph.osd.1:Started 2023-10-16T19:39:37.189 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T19:39:37.189 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T19:39:37.191 INFO:tasks.ceph.osd.2:Started 2023-10-16T19:39:37.192 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T19:39:37.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T19:39:37.194 INFO:tasks.ceph.osd.3:Started 2023-10-16T19:39:37.195 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T19:39:37.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T19:39:37.197 INFO:tasks.ceph.osd.4:Started 2023-10-16T19:39:37.197 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T19:39:37.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T19:39:37.199 INFO:tasks.ceph.osd.5:Started 2023-10-16T19:39:37.200 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T19:39:37.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T19:39:37.202 INFO:tasks.ceph.osd.6:Started 2023-10-16T19:39:37.202 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T19:39:37.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T19:39:37.205 INFO:tasks.ceph.osd.7:Started 2023-10-16T19:39:37.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.364+0000 7fa6fb153700 1 Processor -- start 2023-10-16T19:39:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.364+0000 7fa6fb153700 1 -- start start 2023-10-16T19:39:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6fb153700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f4153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6fb153700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40bd0e0 con 0x7fa6f4155e00 2023-10-16T19:39:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6fb153700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40c5330 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6fb153700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40c3000 con 0x7fa6f40c4f50 2023-10-16T19:39:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f96f0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa6f4155e00 0x7fa6f4156290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36122/0 (socket says 172.21.15.29:36122) 2023-10-16T19:39:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f96f0700 1 -- 172.21.15.29:0/3760912437 learned_addr learned my addr 172.21.15.29:0/3760912437 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f8eef700 1 --2- 172.21.15.29:0/3760912437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f4153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214494783 0 0) 0x7fa6f40bd0e0 con 0x7fa6f4155e00 2023-10-16T19:39:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e40035b0 con 0x7fa6f4155e00 2023-10-16T19:39:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873904800 0 0) 0x7fa6f40c5330 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f40bd0e0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f8eef700 1 -- 172.21.15.29:0/3760912437 >> v1:172.21.15.53:6789/0 conn(0x7fa6f40c7bb0 legacy=0x7fa6f4070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f8eef700 1 -- 172.21.15.29:0/3760912437 >> v1:172.21.15.29:6789/0 conn(0x7fa6f4155e00 legacy=0x7fa6f4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.365+0000 7fa6f8eef700 1 -- 172.21.15.29:0/3760912437 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40c2a40 con 0x7fa6f40c4f50 2023-10-16T19:39:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6f8eef700 1 --2- 172.21.15.29:0/3760912437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f4153290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009870 tx=0x7fa6e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf4bbd8d0e1c9d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8011830 con 0x7fa6f40c4f50 2023-10-16T19:39:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8011990 con 0x7fa6f40c4f50 2023-10-16T19:39:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6f37fe700 1 -- 172.21.15.29:0/3760912437 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8011d20 con 0x7fa6f40c4f50 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6fb153700 1 -- 172.21.15.29:0/3760912437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 msgr2=0x7fa6f4153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6fb153700 1 --2- 172.21.15.29:0/3760912437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f4153290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009870 tx=0x7fa6e8009b80 comp rx=0 tx=0).stop 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6fb153700 1 -- 172.21.15.29:0/3760912437 shutdown_connections 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6fb153700 1 --2- 172.21.15.29:0/3760912437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f4153290 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.366+0000 7fa6fb153700 1 -- 172.21.15.29:0/3760912437 >> 172.21.15.29:0/3760912437 conn(0x7fa6f40a9cd0 msgr2=0x7fa6f40aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.367+0000 7fa6fb153700 1 -- 172.21.15.29:0/3760912437 shutdown_connections 2023-10-16T19:39:37.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.367+0000 7fa6fb153700 1 -- 172.21.15.29:0/3760912437 wait complete. 2023-10-16T19:39:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.368+0000 7fa6fb153700 1 Processor -- start 2023-10-16T19:39:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.368+0000 7fa6fb153700 1 -- start start 2023-10-16T19:39:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f40ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f4155e00 0x7fa6f40c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4152f20 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40aae40 con 0x7fa6f4155e00 2023-10-16T19:39:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6fb153700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41e8400 con 0x7fa6f40c4f50 2023-10-16T19:39:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6f3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6f8eef700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f40ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6f3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50680/0 (socket says 172.21.15.29:50680) 2023-10-16T19:39:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6f3fff700 1 -- 172.21.15.29:0/800179842 learned_addr learned my addr 172.21.15.29:0/800179842 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.369+0000 7fa6f96f0700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f4155e00 0x7fa6f40c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 -- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 msgr2=0x7fa6f40ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f40ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 -- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f4155e00 msgr2=0x7fa6f40c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f4155e00 0x7fa6f40c0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 -- 172.21.15.29:0/800179842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80094a0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f8eef700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f40ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f3fff700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000c520 tx=0x7fa6e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00052d0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0005430 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40ab0e0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00038c0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f4142a20 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa6e0003d20 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.370+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa6e0012af0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.371+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4142bb0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.373+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa6e0017070 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.444+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f40ab2d0 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.445+0000 7fa6f17fa700 1 -- 172.21.15.29:0/800179842 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa6e0011590 con 0x7fa6f40c7bb0 2023-10-16T19:39:37.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:37.448 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:37.168111+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 msgr2=0x7fa6f40c0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000c520 tx=0x7fa6e000c830 comp rx=0 tx=0).stop 2023-10-16T19:39:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 shutdown_connections 2023-10-16T19:39:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f4155e00 0x7fa6f40c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6f40c4f50 0x7fa6f40ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 --2- 172.21.15.29:0/800179842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6f40c7bb0 0x7fa6f40c0770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 >> 172.21.15.29:0/800179842 conn(0x7fa6f40a9cd0 msgr2=0x7fa6f40c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 shutdown_connections 2023-10-16T19:39:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:37.446+0000 7fa6fb153700 1 -- 172.21.15.29:0/800179842 wait complete. 2023-10-16T19:39:37.460 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T19:39:37.461 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T19:39:37.806 INFO:tasks.ceph.osd.5.smithi053.stderr:2023-10-16T19:39:37.803+0000 7f7ebf90d640 -1 Falling back to public interface 2023-10-16T19:39:37.810 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-16T19:39:37.808+0000 7f6b5f759640 -1 Falling back to public interface 2023-10-16T19:39:37.823 INFO:tasks.ceph.osd.6.smithi053.stderr:2023-10-16T19:39:37.820+0000 7ff8171e6640 -1 Falling back to public interface 2023-10-16T19:39:37.823 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-16T19:39:37.821+0000 7fca94ab8640 -1 Falling back to public interface 2023-10-16T19:39:37.833 INFO:tasks.ceph.osd.4.smithi053.stderr:2023-10-16T19:39:37.830+0000 7fce9dac8640 -1 Falling back to public interface 2023-10-16T19:39:37.836 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-16T19:39:37.834+0000 7fdc07ad6640 -1 Falling back to public interface 2023-10-16T19:39:37.837 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-16T19:39:37.835+0000 7fddf507e640 -1 Falling back to public interface 2023-10-16T19:39:37.846 INFO:tasks.ceph.osd.7.smithi053.stderr:2023-10-16T19:39:37.843+0000 7f2fa84e2640 -1 Falling back to public interface 2023-10-16T19:39:37.860 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:37.858+0000 7fccd482f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:39:37.923 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:37.921+0000 7f86492f1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:39:37.932 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:37.931+0000 7fccd482f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:39:38.004 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.001+0000 7f86492f1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:39:38.150 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.148+0000 7f86492f1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:39:38.266 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:38.381 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.379+0000 7fa0852a7700 1 Processor -- start 2023-10-16T19:39:38.382 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.379+0000 7fa0852a7700 1 -- start start 2023-10-16T19:39:38.384 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa0852a7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa08006d2f0 0x7fa0800c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:38.384 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa0852a7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa080072a20 con 0x7fa08006d990 2023-10-16T19:39:38.384 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa0852a7700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08006b5d0 con 0x7fa080152150 2023-10-16T19:39:38.384 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa0852a7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08006b140 con 0x7fa08006d2f0 2023-10-16T19:39:38.384 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa07e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa08006d2f0 0x7fa0800c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:38.385 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa07f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa08006d990 0x7fa0800c2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36134/0 (socket says 172.21.15.29:36134) 2023-10-16T19:39:38.385 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa07e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa08006d2f0 0x7fa0800c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50688/0 (socket says 172.21.15.29:50688) 2023-10-16T19:39:38.385 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.380+0000 7fa07f7fe700 1 -- 172.21.15.29:0/2281891491 learned_addr learned my addr 172.21.15.29:0/2281891491 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:38.385 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07e7fc700 1 -- 172.21.15.29:0/2281891491 >> v1:172.21.15.53:6789/0 conn(0x7fa080152150 legacy=0x7fa0800ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.385 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07e7fc700 1 -- 172.21.15.29:0/2281891491 >> v1:172.21.15.29:6789/0 conn(0x7fa08006d990 legacy=0x7fa0800c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.386 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07e7fc700 1 -- 172.21.15.29:0/2281891491 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080072740 con 0x7fa08006d2f0 2023-10-16T19:39:38.386 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07e7fc700 1 --2- 172.21.15.29:0/2281891491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d2f0 0x7fa0800c29a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa068009840 tx=0x7fa068009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ea37dc484bb855 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:38.386 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07dffb700 1 -- 172.21.15.29:0/2281891491 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068011830 con 0x7fa08006d2f0 2023-10-16T19:39:38.386 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07dffb700 1 -- 172.21.15.29:0/2281891491 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068011990 con 0x7fa08006d2f0 2023-10-16T19:39:38.386 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.381+0000 7fa07dffb700 1 -- 172.21.15.29:0/2281891491 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068011d20 con 0x7fa08006d2f0 2023-10-16T19:39:38.387 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 -- 172.21.15.29:0/2281891491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d2f0 msgr2=0x7fa0800c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.387 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 --2- 172.21.15.29:0/2281891491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d2f0 0x7fa0800c29a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa068009840 tx=0x7fa068009b50 comp rx=0 tx=0).stop 2023-10-16T19:39:38.387 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 -- 172.21.15.29:0/2281891491 shutdown_connections 2023-10-16T19:39:38.387 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 --2- 172.21.15.29:0/2281891491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d2f0 0x7fa0800c29a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.387 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 -- 172.21.15.29:0/2281891491 >> 172.21.15.29:0/2281891491 conn(0x7fa080071310 msgr2=0x7fa0800716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:38.388 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 -- 172.21.15.29:0/2281891491 shutdown_connections 2023-10-16T19:39:38.388 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.382+0000 7fa0852a7700 1 -- 172.21.15.29:0/2281891491 wait complete. 2023-10-16T19:39:38.390 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.383+0000 7fa0852a7700 1 Processor -- start 2023-10-16T19:39:38.390 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.383+0000 7fa0852a7700 1 -- start start 2023-10-16T19:39:38.391 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa08006d2f0 0x7fa080150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:38.391 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:38.391 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa080152150 0x7fa080145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:38.391 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0801ee900 con 0x7fa08006d990 2023-10-16T19:39:38.391 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800c5770 con 0x7fa080152150 2023-10-16T19:39:38.392 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa0852a7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800c62d0 con 0x7fa08006d2f0 2023-10-16T19:39:38.392 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:38.392 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50694/0 (socket says 172.21.15.29:50694) 2023-10-16T19:39:38.392 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 -- 172.21.15.29:0/1875156093 learned_addr learned my addr 172.21.15.29:0/1875156093 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:38.392 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07effd700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa08006d2f0 0x7fa080150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:38.393 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07f7fe700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa080152150 0x7fa080145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:38.393 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 -- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa08006d2f0 msgr2=0x7fa080150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.393 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa08006d2f0 0x7fa080150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.393 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 -- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa080152150 msgr2=0x7fa080145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.393 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa080152150 0x7fa080145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.394 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.384+0000 7fa07e7fc700 1 -- 172.21.15.29:0/1875156093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680094a0 con 0x7fa08006d990 2023-10-16T19:39:38.394 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa07e7fc700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa080072cc0 tx=0x7fa068004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:38.394 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680036a0 con 0x7fa08006d990 2023-10-16T19:39:38.394 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06801f070 con 0x7fa08006d990 2023-10-16T19:39:38.394 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068003a60 con 0x7fa08006d990 2023-10-16T19:39:38.395 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa080145890 con 0x7fa08006d990 2023-10-16T19:39:38.395 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0800c5c80 con 0x7fa08006d990 2023-10-16T19:39:38.395 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa068026480 con 0x7fa08006d990 2023-10-16T19:39:38.395 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.385+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa068021070 con 0x7fa08006d990 2023-10-16T19:39:38.395 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.386+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08006f290 con 0x7fa08006d990 2023-10-16T19:39:38.396 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.388+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa06802b020 con 0x7fa08006d990 2023-10-16T19:39:38.399 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.396+0000 7f86492f1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:39:38.463 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.461+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0800c6410 con 0x7fa08006d990 2023-10-16T19:39:38.463 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.461+0000 7fa0777fe700 1 -- 172.21.15.29:0/1875156093 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa068015020 con 0x7fa08006d990 2023-10-16T19:39:38.464 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-16T19:39:38.464 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:37.168111+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:38.465 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 msgr2=0x7fa080144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:38.465 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa080072cc0 tx=0x7fa068004750 comp rx=0 tx=0).stop 2023-10-16T19:39:38.466 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 shutdown_connections 2023-10-16T19:39:38.466 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa080152150 0x7fa080145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.466 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa08006d2f0 0x7fa080150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.466 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 --2- 172.21.15.29:0/1875156093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa08006d990 0x7fa080144e10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:38.466 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 >> 172.21.15.29:0/1875156093 conn(0x7fa080071310 msgr2=0x7fa080152820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:38.467 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 shutdown_connections 2023-10-16T19:39:38.467 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:38.462+0000 7fa0852a7700 1 -- 172.21.15.29:0/1875156093 wait complete. 2023-10-16T19:39:38.476 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T19:39:38.618 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.615+0000 7f86492f1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:39:38.668 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:38.666+0000 7fccd482f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:39:38.750 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:38.749+0000 7fccd482f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:39:38.758 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.755+0000 7f86492f1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:39:38.899 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:38.897+0000 7fccd482f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:39:38.986 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:38.983+0000 7f86492f1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:39:39.146 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:39.144+0000 7fccd482f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:39:39.148 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:39.146+0000 7f86492f1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:39:39.269 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:39.267+0000 7f86492f1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:39:39.366 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:39.364+0000 7fccd482f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:39:39.506 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:39.504+0000 7fccd482f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:39:39.604 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:39.601+0000 7f86492f1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:39:39.708 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:39.705+0000 7f86492f1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:39:39.736 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:39.734+0000 7fccd482f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:39:39.898 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:39.897+0000 7fccd482f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:39:39.903 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:39.900+0000 7f86492f1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:39:40.019 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:40.017+0000 7fccd482f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:39:40.360 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:40.358+0000 7fccd482f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:39:40.464 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:40.462+0000 7fccd482f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:39:40.531 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:40.528+0000 7f86492f1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:39:40.695 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:40.693+0000 7fccd482f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:39:41.301 INFO:tasks.ceph.osd.5.smithi053.stderr:2023-10-16T19:39:41.299+0000 7f7ebf90d640 -1 osd.5 0 log_to_monitors true 2023-10-16T19:39:41.338 INFO:tasks.ceph.osd.6.smithi053.stderr:2023-10-16T19:39:41.335+0000 7ff8171e6640 -1 osd.6 0 log_to_monitors true 2023-10-16T19:39:41.348 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-16T19:39:41.346+0000 7f6b5f759640 -1 osd.0 0 log_to_monitors true 2023-10-16T19:39:41.350 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-16T19:39:41.347+0000 7fccd482f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:39:41.372 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-16T19:39:41.370+0000 7fca94ab8640 -1 osd.2 0 log_to_monitors true 2023-10-16T19:39:41.385 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-16T19:39:41.383+0000 7fddf507e640 -1 osd.3 0 log_to_monitors true 2023-10-16T19:39:41.386 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-16T19:39:41.383+0000 7fdc07ad6640 -1 osd.1 0 log_to_monitors true 2023-10-16T19:39:41.400 INFO:tasks.ceph.osd.7.smithi053.stderr:2023-10-16T19:39:41.396+0000 7f2fa84e2640 -1 osd.7 0 log_to_monitors true 2023-10-16T19:39:41.430 INFO:tasks.ceph.osd.4.smithi053.stderr:2023-10-16T19:39:41.426+0000 7fce9dac8640 -1 osd.4 0 log_to_monitors true 2023-10-16T19:39:41.558 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:41.555+0000 7f860127f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T19:39:41.559 INFO:tasks.ceph.mgr.x.smithi053.stderr:2023-10-16T19:39:41.555+0000 7f860127f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T19:39:43.887 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-16T19:39:43.885+0000 7f6b53b11700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T19:39:43.898 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-16T19:39:43.896+0000 7f6b4b6eb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:43.905 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-16T19:39:43.901+0000 7fdbfbe8e700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T19:39:43.914 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-16T19:39:43.913+0000 7fdbf3a68700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:43.937 INFO:tasks.ceph.osd.7.smithi053.stderr:2023-10-16T19:39:43.934+0000 7f2f9c89a700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T19:39:43.947 INFO:tasks.ceph.osd.4.smithi053.stderr:2023-10-16T19:39:43.944+0000 7fce91e80700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T19:39:43.957 INFO:tasks.ceph.osd.7.smithi053.stderr:2023-10-16T19:39:43.955+0000 7f2f94474700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:43.964 INFO:tasks.ceph.osd.4.smithi053.stderr:2023-10-16T19:39:43.962+0000 7fce89a5a700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:43.975 INFO:tasks.ceph.osd.6.smithi053.stderr:2023-10-16T19:39:43.972+0000 7ff80b59e700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T19:39:43.990 INFO:tasks.ceph.osd.6.smithi053.stderr:2023-10-16T19:39:43.988+0000 7ff803178700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:43.991 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-16T19:39:43.989+0000 7fdde9436700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T19:39:44.007 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-16T19:39:44.005+0000 7fdde1010700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:44.130 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-16T19:39:44.128+0000 7fca88e70700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T19:39:44.144 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-16T19:39:44.142+0000 7fca80a4a700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:44.541 INFO:tasks.ceph.osd.5.smithi053.stderr:2023-10-16T19:39:44.538+0000 7f7eb3cc5700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T19:39:44.558 INFO:tasks.ceph.osd.5.smithi053.stderr:2023-10-16T19:39:44.557+0000 7f7eab89f700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:39:45.282 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:45.411 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.409+0000 7fde979ad700 1 Processor -- start 2023-10-16T19:39:45.412 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 -- start start 2023-10-16T19:39:45.414 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.414 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 0x7fde900c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.415 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde90072a20 con 0x7fde9006d2f0 2023-10-16T19:39:45.415 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9006b140 con 0x7fde900acde0 2023-10-16T19:39:45.415 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.410+0000 7fde979ad700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9006b5d0 con 0x7fde90152150 2023-10-16T19:39:45.415 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95f4a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 0x7fde900c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.415 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.416 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:43316/0 (socket says 172.21.15.29:43316) 2023-10-16T19:39:45.416 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 -- 172.21.15.29:0/594282926 learned_addr learned my addr 172.21.15.29:0/594282926 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:45.416 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95f4a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 0x7fde900c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41152/0 (socket says 172.21.15.29:41152) 2023-10-16T19:39:45.416 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde94f48700 1 --1- 172.21.15.29:0/594282926 >> v1:172.21.15.53:6789/0 conn(0x7fde9006d2f0 0x7fde900c29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:59132/0 (socket says 172.21.15.29:59132) 2023-10-16T19:39:45.416 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 -- 172.21.15.29:0/594282926 >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 msgr2=0x7fde900c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:45.417 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 --2- 172.21.15.29:0/594282926 >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 0x7fde900c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.417 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 -- 172.21.15.29:0/594282926 >> v1:172.21.15.53:6789/0 conn(0x7fde9006d2f0 legacy=0x7fde900c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.417 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 -- 172.21.15.29:0/594282926 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90072740 con 0x7fde90152150 2023-10-16T19:39:45.417 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde95749700 1 --2- 172.21.15.29:0/594282926 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0098f0 tx=0x7fde8c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61edc96afd074c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.417 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.411+0000 7fde87fff700 1 -- 172.21.15.29:0/594282926 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011830 con 0x7fde90152150 2023-10-16T19:39:45.418 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde87fff700 1 -- 172.21.15.29:0/594282926 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c011990 con 0x7fde90152150 2023-10-16T19:39:45.418 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde87fff700 1 -- 172.21.15.29:0/594282926 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011d20 con 0x7fde90152150 2023-10-16T19:39:45.418 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 -- 172.21.15.29:0/594282926 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 msgr2=0x7fde900ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.418 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 --2- 172.21.15.29:0/594282926 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0098f0 tx=0x7fde8c009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:45.418 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 -- 172.21.15.29:0/594282926 shutdown_connections 2023-10-16T19:39:45.419 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 --2- 172.21.15.29:0/594282926 >> v2:172.21.15.53:3300/0 conn(0x7fde900acde0 0x7fde900c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.419 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 --2- 172.21.15.29:0/594282926 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde90152150 0x7fde900ac8a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.419 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 -- 172.21.15.29:0/594282926 >> 172.21.15.29:0/594282926 conn(0x7fde90071310 msgr2=0x7fde900716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:45.419 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 -- 172.21.15.29:0/594282926 shutdown_connections 2023-10-16T19:39:45.419 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.412+0000 7fde979ad700 1 -- 172.21.15.29:0/594282926 wait complete. 2023-10-16T19:39:45.422 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.413+0000 7fde979ad700 1 Processor -- start 2023-10-16T19:39:45.422 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.413+0000 7fde979ad700 1 -- start start 2023-10-16T19:39:45.422 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 0x7fde901eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.423 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900acde0 0x7fde901ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.423 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.423 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90158ef0 con 0x7fde90152150 2023-10-16T19:39:45.423 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90156700 con 0x7fde900acde0 2023-10-16T19:39:45.423 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde979ad700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde901ea030 con 0x7fde9006d2f0 2023-10-16T19:39:45.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde95f4a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde95749700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 0x7fde901eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde95f4a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50872/0 (socket says 172.21.15.29:50872) 2023-10-16T19:39:45.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde95f4a700 1 -- 172.21.15.29:0/2570028078 learned_addr learned my addr 172.21.15.29:0/2570028078 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:45.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.414+0000 7fde94f48700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900acde0 0x7fde901ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 -- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900acde0 msgr2=0x7fde901ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900acde0 0x7fde901ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 -- 172.21.15.29:0/2570028078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 msgr2=0x7fde90153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 -- 172.21.15.29:0/2570028078 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009550 con 0x7fde9006d2f0 2023-10-16T19:39:45.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95f4a700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:45.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde95749700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 0x7fde901eaab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde8c016000 tx=0x7fde8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0036a0 con 0x7fde9006d2f0 2023-10-16T19:39:45.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c003800 con 0x7fde9006d2f0 2023-10-16T19:39:45.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c003b90 con 0x7fde9006d2f0 2023-10-16T19:39:45.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde901eaff0 con 0x7fde9006d2f0 2023-10-16T19:39:45.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.415+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90156420 con 0x7fde9006d2f0 2023-10-16T19:39:45.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.416+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9006f290 con 0x7fde9006d2f0 2023-10-16T19:39:45.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.417+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fde8c021070 con 0x7fde9006d2f0 2023-10-16T19:39:45.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.417+0000 7fde85ffb700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 0x7fde7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.428 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.417+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fde8c08a3a0 con 0x7fde9006d2f0 2023-10-16T19:39:45.428 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.417+0000 7fde94f48700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 0x7fde7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.428 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.418+0000 7fde94f48700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 0x7fde7406d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde9014f6d0 tx=0x7fde80007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.428 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.423+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde8c0559f0 con 0x7fde9006d2f0 2023-10-16T19:39:45.626 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.624+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde900c35d0 con 0x7fde9006d2f0 2023-10-16T19:39:45.626 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.625+0000 7fde85ffb700 1 -- 172.21.15.29:0/2570028078 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10836 (secure 0 0 0) 0x7fde8c029090 con 0x7fde9006d2f0 2023-10-16T19:39:45.627 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-16T19:39:45.627 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":13,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:44.907934+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:45.629 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 msgr2=0x7fde7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.629 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 0x7fde7406d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde9014f6d0 tx=0x7fde80007ed0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.630 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 msgr2=0x7fde901eaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.630 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 0x7fde901eaab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde8c016000 tx=0x7fde8c004750 comp rx=0 tx=0).stop 2023-10-16T19:39:45.630 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 shutdown_connections 2023-10-16T19:39:45.630 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde7406ae70 0x7fde7406d330 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.630 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde90152150 0x7fde90153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.631 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde9006d2f0 0x7fde901eaab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.631 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 --2- 172.21.15.29:0/2570028078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900acde0 0x7fde901ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.631 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 >> 172.21.15.29:0/2570028078 conn(0x7fde90071310 msgr2=0x7fde9006dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:45.631 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 shutdown_connections 2023-10-16T19:39:45.631 INFO:teuthology.misc.health.smithi029.stderr:2023-10-16T19:39:45.627+0000 7fde979ad700 1 -- 172.21.15.29:0/2570028078 wait complete. 2023-10-16T19:39:45.640 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T19:39:45.641 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T19:39:45.641 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T19:39:45.641 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T19:39:45.644 INFO:tasks.ceph.mds.a:Started 2023-10-16T19:39:45.644 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T19:39:45.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T19:39:45.646 INFO:tasks.ceph.mds.c:Started 2023-10-16T19:39:45.647 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T19:39:45.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T19:39:45.649 INFO:tasks.ceph.mds.b:Started 2023-10-16T19:39:45.650 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T19:39:45.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T19:39:45.652 INFO:tasks.ceph.mds.d:Started 2023-10-16T19:39:45.653 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T19:39:45.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:45.726 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-16T19:39:45.727 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-16T19:39:45.739 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2023-10-16T19:39:45.740 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2023-10-16T19:39:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.785+0000 7ff4327bd700 1 Processor -- start 2023-10-16T19:39:45.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.785+0000 7ff4327bd700 1 -- start start 2023-10-16T19:39:45.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff4327bd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c1555b0 0x7ff42c06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff4327bd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c152300 con 0x7ff42c0c3350 2023-10-16T19:39:45.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff4327bd700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0c2e40 con 0x7ff42c14ec50 2023-10-16T19:39:45.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff4327bd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c14f030 con 0x7ff42c1555b0 2023-10-16T19:39:45.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c1555b0 0x7ff42c06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff42c1555b0 0x7ff42c06e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50914/0 (socket says 172.21.15.29:50914) 2023-10-16T19:39:45.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff42b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff42c0c3350 0x7ff42c06db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36356/0 (socket says 172.21.15.29:36356) 2023-10-16T19:39:45.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 -- 172.21.15.29:0/1679325899 learned_addr learned my addr 172.21.15.29:0/1679325899 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 -- 172.21.15.29:0/1679325899 >> v1:172.21.15.53:6789/0 conn(0x7ff42c14ec50 legacy=0x7ff42c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 -- 172.21.15.29:0/1679325899 >> v1:172.21.15.29:6789/0 conn(0x7ff42c0c3350 legacy=0x7ff42c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff430d5a700 1 -- 172.21.15.29:0/1679325899 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c1516f0 con 0x7ff42c1555b0 2023-10-16T19:39:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.786+0000 7ff42affd700 1 -- 172.21.15.29:0/1679325899 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561313591 0 0) 0x7ff42c0c2e40 con 0x7ff42c14ec50 2023-10-16T19:39:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff430d5a700 1 --2- 172.21.15.29:0/1679325899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c1555b0 0x7ff42c06e210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff424009e50 tx=0x7ff42400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b555e0b25cd1124b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff42affd700 1 -- 172.21.15.29:0/1679325899 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400e070 con 0x7ff42c1555b0 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff42affd700 1 -- 172.21.15.29:0/1679325899 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400b9c0 con 0x7ff42c1555b0 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff42affd700 1 -- 172.21.15.29:0/1679325899 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400bd70 con 0x7ff42c1555b0 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 -- 172.21.15.29:0/1679325899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c1555b0 msgr2=0x7ff42c06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 --2- 172.21.15.29:0/1679325899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c1555b0 0x7ff42c06e210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff424009e50 tx=0x7ff42400b330 comp rx=0 tx=0).stop 2023-10-16T19:39:45.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 -- 172.21.15.29:0/1679325899 shutdown_connections 2023-10-16T19:39:45.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 --2- 172.21.15.29:0/1679325899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c1555b0 0x7ff42c06e210 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 -- 172.21.15.29:0/1679325899 >> 172.21.15.29:0/1679325899 conn(0x7ff42c0c7110 msgr2=0x7ff42c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:45.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 -- 172.21.15.29:0/1679325899 shutdown_connections 2023-10-16T19:39:45.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.787+0000 7ff4327bd700 1 -- 172.21.15.29:0/1679325899 wait complete. 2023-10-16T19:39:45.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.789+0000 7ff4327bd700 1 Processor -- start 2023-10-16T19:39:45.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.789+0000 7ff4327bd700 1 -- start start 2023-10-16T19:39:45.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.789+0000 7ff4327bd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff42c0c3350 0x7ff42c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.789+0000 7ff4327bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.789+0000 7ff4327bd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff42c1555b0 0x7ff42c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff4327bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1552e0 con 0x7ff42c14ec50 2023-10-16T19:39:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff4327bd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1424b0 con 0x7ff42c1555b0 2023-10-16T19:39:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff4327bd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c154ac0 con 0x7ff42c0c3350 2023-10-16T19:39:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50918/0 (socket says 172.21.15.29:50918) 2023-10-16T19:39:45.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 -- 172.21.15.29:0/3640245862 learned_addr learned my addr 172.21.15.29:0/3640245862 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:45.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42bfff700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff42c0c3350 0x7ff42c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff430d5a700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff42c1555b0 0x7ff42c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 -- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff42c0c3350 msgr2=0x7ff42c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff42c0c3350 0x7ff42c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 -- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff42c1555b0 msgr2=0x7ff42c141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff42c1555b0 0x7ff42c141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 -- 172.21.15.29:0/3640245862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424009b30 con 0x7ff42c14ec50 2023-10-16T19:39:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff42b7fe700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c3f0 tx=0x7ff42000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420004a70 con 0x7ff42c14ec50 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420004bd0 con 0x7ff42c14ec50 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c152b00 con 0x7ff42c14ec50 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200070d0 con 0x7ff42c14ec50 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.790+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c1530c0 con 0x7ff42c14ec50 2023-10-16T19:39:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.791+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c04f400 con 0x7ff42c14ec50 2023-10-16T19:39:45.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.792+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff420007230 con 0x7ff42c14ec50 2023-10-16T19:39:45.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.792+0000 7ff428ff9700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 0x7ff41806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:45.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.792+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7ff4200886b0 con 0x7ff42c14ec50 2023-10-16T19:39:45.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.792+0000 7ff42bfff700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 0x7ff41806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:45.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.793+0000 7ff42bfff700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 0x7ff41806d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000f60 tx=0x7ff41c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:45.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:45.797+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff420053d10 con 0x7ff42c14ec50 2023-10-16T19:39:46.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.001+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff42c0a88d0 con 0x7ff42c14ec50 2023-10-16T19:39:46.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.002+0000 7ff428ff9700 1 -- 172.21.15.29:0/3640245862 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11020 (secure 0 0 0) 0x7ff420057330 con 0x7ff42c14ec50 2023-10-16T19:39:46.005 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:46.005 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":14,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:45.909799+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:46.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 msgr2=0x7ff41806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 0x7ff41806d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000f60 tx=0x7ff41c009040 comp rx=0 tx=0).stop 2023-10-16T19:39:46.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 msgr2=0x7ff42c141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c3f0 tx=0x7ff42000c700 comp rx=0 tx=0).stop 2023-10-16T19:39:46.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 shutdown_connections 2023-10-16T19:39:46.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff41806ae70 0x7ff41806d330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff42c1555b0 0x7ff42c141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff42c0c3350 0x7ff42c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 --2- 172.21.15.29:0/3640245862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42c14ec50 0x7ff42c141a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 >> 172.21.15.29:0/3640245862 conn(0x7ff42c0c7110 msgr2=0x7ff42c06a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:46.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.004+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 shutdown_connections 2023-10-16T19:39:46.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.005+0000 7ff4327bd700 1 -- 172.21.15.29:0/3640245862 wait complete. 2023-10-16T19:39:46.018 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-16T19:39:46.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:39:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.143+0000 7fcd1bdb2700 1 Processor -- start 2023-10-16T19:39:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.143+0000 7fcd1bdb2700 1 -- start start 2023-10-16T19:39:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1bdb2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd1406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1bdb2700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd14154a50 0x7fcd141583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1bdb2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1406e780 con 0x7fcd1406adc0 2023-10-16T19:39:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1bdb2700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1406d320 con 0x7fcd14154a50 2023-10-16T19:39:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1bdb2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14154f10 con 0x7fcd1413d660 2023-10-16T19:39:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1a34f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcd1406adc0 0x7fcd14158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36416/0 (socket says 172.21.15.29:36416) 2023-10-16T19:39:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1a34f700 1 -- 172.21.15.29:0/3841077527 learned_addr learned my addr 172.21.15.29:0/3841077527 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716556482 0 0) 0x7fcd1406e780 con 0x7fcd1406adc0 2023-10-16T19:39:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd1934d700 1 --2- 172.21.15.29:0/3841077527 >> v2:172.21.15.53:3300/0 conn(0x7fcd14154a50 0x7fcd141583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd000035b0 con 0x7fcd1406adc0 2023-10-16T19:39:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.144+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd1406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971845836 0 0) 0x7fcd000035b0 con 0x7fcd1406adc0 2023-10-16T19:39:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 msgr2=0x7fcd1406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd1406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 >> v2:172.21.15.53:3300/0 conn(0x7fcd14154a50 msgr2=0x7fcd141583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 --2- 172.21.15.29:0/3841077527 >> v2:172.21.15.53:3300/0 conn(0x7fcd14154a50 0x7fcd141583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd141551f0 con 0x7fcd1406adc0 2023-10-16T19:39:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fcd0c001a40 con 0x7fcd1406adc0 2023-10-16T19:39:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd1406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 >> v1:172.21.15.29:6789/0 conn(0x7fcd1406adc0 legacy=0x7fcd14158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd00003a00 0x7fcd00003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00004d90 0x7fcd00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1406d320 con 0x7fcd00003a00 2023-10-16T19:39:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14154f10 con 0x7fcd00004d90 2023-10-16T19:39:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0000ba10 con 0x7fcd1413d660 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd00003a00 0x7fcd00003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd1a34f700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00004d90 0x7fcd00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd1934d700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 -- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 msgr2=0x7fcd00004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413d660 0x7fcd00004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 -- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00004d90 msgr2=0x7fcd00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00004d90 0x7fcd00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 -- 172.21.15.29:0/3841077527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000035b0 con 0x7fcd00003a00 2023-10-16T19:39:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.145+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd00003a00 0x7fcd00003e20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009950 tx=0x7fcd00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521e714650c52cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400c070 con 0x7fcd00003a00 2023-10-16T19:39:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04013610 con 0x7fcd00003a00 2023-10-16T19:39:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd18b4c700 1 -- 172.21.15.29:0/3841077527 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040139a0 con 0x7fcd00003a00 2023-10-16T19:39:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/3841077527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd00003a00 msgr2=0x7fcd00003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/3841077527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd00003a00 0x7fcd00003e20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009950 tx=0x7fcd00005880 comp rx=0 tx=0).stop 2023-10-16T19:39:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1a34f700 1 -- 172.21.15.29:0/3841077527 reap_dead start 2023-10-16T19:39:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/3841077527 shutdown_connections 2023-10-16T19:39:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/3841077527 >> 172.21.15.29:0/3841077527 conn(0x7fcd140c7110 msgr2=0x7fcd140c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/3841077527 shutdown_connections 2023-10-16T19:39:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.146+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/3841077527 wait complete. 2023-10-16T19:39:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.147+0000 7fcd1bdb2700 1 Processor -- start 2023-10-16T19:39:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.147+0000 7fcd1bdb2700 1 -- start start 2023-10-16T19:39:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00003a00 0x7fcd141532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 0x7fcd141ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14153810 con 0x7fcd1413be50 2023-10-16T19:39:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1413ab40 con 0x7fcd00003a00 2023-10-16T19:39:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1bdb2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140c6910 con 0x7fcd1413ae40 2023-10-16T19:39:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1a34f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1a34f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50984/0 (socket says 172.21.15.29:50984) 2023-10-16T19:39:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1a34f700 1 -- 172.21.15.29:0/114413425 learned_addr learned my addr 172.21.15.29:0/114413425 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00003a00 0x7fcd141532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.148+0000 7fcd1934d700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 0x7fcd141ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 -- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 msgr2=0x7fcd141ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 0x7fcd141ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 -- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00003a00 msgr2=0x7fcd141532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00003a00 0x7fcd141532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 -- 172.21.15.29:0/114413425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1413d030 con 0x7fcd1413be50 2023-10-16T19:39:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1934d700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 0x7fcd141ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1a34f700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd14071290 tx=0x7fcd0c00a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ad50 con 0x7fcd1413be50 2023-10-16T19:39:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0133f0 con 0x7fcd1413be50 2023-10-16T19:39:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd141ee410 con 0x7fcd1413be50 2023-10-16T19:39:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c013780 con 0x7fcd1413be50 2023-10-16T19:39:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.149+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140c65a0 con 0x7fcd1413be50 2023-10-16T19:39:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.150+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd140c3780 con 0x7fcd1413be50 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.150+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fcd0c007d50 con 0x7fcd1413be50 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.151+0000 7fcd0a7fc700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 0x7fccf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.151+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fcd0c089510 con 0x7fcd1413be50 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.151+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 0x7fccf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.152+0000 7fcd19b4e700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 0x7fccf806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd04016040 tx=0x7fcd0401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.155+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd0c054c00 con 0x7fcd1413be50 2023-10-16T19:39:46.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.405+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd14071890 con 0x7fcd1413be50 2023-10-16T19:39:46.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.405+0000 7fcd0a7fc700 1 -- 172.21.15.29:0/114413425 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7fcd0c058220 con 0x7fcd1413be50 2023-10-16T19:39:46.408 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:46.408 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T19:39:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 msgr2=0x7fccf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 0x7fccf806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd04016040 tx=0x7fcd0401e040 comp rx=0 tx=0).stop 2023-10-16T19:39:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 msgr2=0x7fcd140c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd14071290 tx=0x7fcd0c00a5a0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 shutdown_connections 2023-10-16T19:39:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fccf806ae70 0x7fccf806d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd1413be50 0x7fcd140c54f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00003a00 0x7fcd141532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 --2- 172.21.15.29:0/114413425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd1413ae40 0x7fcd141ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 >> 172.21.15.29:0/114413425 conn(0x7fcd140c7110 msgr2=0x7fcd1406efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 shutdown_connections 2023-10-16T19:39:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:46.408+0000 7fcd1bdb2700 1 -- 172.21.15.29:0/114413425 wait complete. 2023-10-16T19:39:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2023-10-16T19:39:48.422 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:39:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.551+0000 7fb827ec0700 1 Processor -- start 2023-10-16T19:39:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.551+0000 7fb827ec0700 1 -- start start 2023-10-16T19:39:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb827ec0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb820154a50 0x7fb8201583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb827ec0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb827ec0700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb820158e40 con 0x7fb82013d660 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb827ec0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82006d320 con 0x7fb820154a50 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb827ec0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82006e780 con 0x7fb82013dd00 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb820154a50 0x7fb8201583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb820154a50 0x7fb8201583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51004/0 (socket says 172.21.15.29:51004) 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 -- 172.21.15.29:0/1652106474 learned_addr learned my addr 172.21.15.29:0/1652106474 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82645d700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 -- 172.21.15.29:0/1652106474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 msgr2=0x7fb820158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 -- 172.21.15.29:0/1652106474 >> v1:172.21.15.53:6789/0 conn(0x7fb82013d660 legacy=0x7fb82006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.552+0000 7fb82545b700 1 -- 172.21.15.29:0/1652106474 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820154f10 con 0x7fb820154a50 2023-10-16T19:39:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.553+0000 7fb82545b700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb820154a50 0x7fb8201583c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8100098f0 tx=0x7fb810009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c0908e67a30eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.553+0000 7fb824c5a700 1 -- 172.21.15.29:0/1652106474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000b8a0 con 0x7fb820154a50 2023-10-16T19:39:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.553+0000 7fb824c5a700 1 -- 172.21.15.29:0/1652106474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000ba00 con 0x7fb820154a50 2023-10-16T19:39:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.553+0000 7fb824c5a700 1 -- 172.21.15.29:0/1652106474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000bd90 con 0x7fb820154a50 2023-10-16T19:39:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 -- 172.21.15.29:0/1652106474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb820154a50 msgr2=0x7fb8201583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb820154a50 0x7fb8201583c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8100098f0 tx=0x7fb810009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 -- 172.21.15.29:0/1652106474 shutdown_connections 2023-10-16T19:39:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 --2- 172.21.15.29:0/1652106474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb820154a50 0x7fb8201583c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 -- 172.21.15.29:0/1652106474 >> 172.21.15.29:0/1652106474 conn(0x7fb8200c7110 msgr2=0x7fb8200c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 -- 172.21.15.29:0/1652106474 shutdown_connections 2023-10-16T19:39:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.554+0000 7fb827ec0700 1 -- 172.21.15.29:0/1652106474 wait complete. 2023-10-16T19:39:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.555+0000 7fb827ec0700 1 Processor -- start 2023-10-16T19:39:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 -- start start 2023-10-16T19:39:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820138120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb820154a50 0x7fb8200c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201ead00 con 0x7fb82013d660 2023-10-16T19:39:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201e9f40 con 0x7fb820154a50 2023-10-16T19:39:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.556+0000 7fb827ec0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201ea220 con 0x7fb82013dd00 2023-10-16T19:39:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51008/0 (socket says 172.21.15.29:51008) 2023-10-16T19:39:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 -- 172.21.15.29:0/3837171869 learned_addr learned my addr 172.21.15.29:0/3837171869 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb82545b700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb82645d700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb820154a50 0x7fb8200c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 -- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 msgr2=0x7fb820138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 -- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb820154a50 msgr2=0x7fb8200c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb820154a50 0x7fb8200c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 -- 172.21.15.29:0/3837171869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810009550 con 0x7fb82013d660 2023-10-16T19:39:48.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb825c5c700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00c4e0 tx=0x7fb81c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011790 con 0x7fb82013d660 2023-10-16T19:39:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8201ea500 con 0x7fb82013d660 2023-10-16T19:39:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0118f0 con 0x7fb82013d660 2023-10-16T19:39:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011c60 con 0x7fb82013d660 2023-10-16T19:39:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.557+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb820138660 con 0x7fb82013d660 2023-10-16T19:39:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.559+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8200c3760 con 0x7fb82013d660 2023-10-16T19:39:48.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.560+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fb81c005080 con 0x7fb82013d660 2023-10-16T19:39:48.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.560+0000 7fb8167fc700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 0x7fb80406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.560+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb81c089320 con 0x7fb82013d660 2023-10-16T19:39:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.565+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb81c0547f0 con 0x7fb82013d660 2023-10-16T19:39:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.572+0000 7fb82545b700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 0x7fb80406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.572+0000 7fb82545b700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 0x7fb80406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb810009c40 tx=0x7fb810008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.819+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb82004f400 con 0x7fb82013d660 2023-10-16T19:39:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.819+0000 7fb8167fc700 1 -- 172.21.15.29:0/3837171869 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3685 (secure 0 0 0) 0x7fb81c057e10 con 0x7fb82013d660 2023-10-16T19:39:48.822 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:48.822 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T19:39:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 msgr2=0x7fb80406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 0x7fb80406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb810009c40 tx=0x7fb810008030 comp rx=0 tx=0).stop 2023-10-16T19:39:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 msgr2=0x7fb82013a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00c4e0 tx=0x7fb81c00c7f0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 shutdown_connections 2023-10-16T19:39:48.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.821+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb80406ae70 0x7fb80406d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb820154a50 0x7fb8200c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb82013d660 0x7fb82013a6d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 --2- 172.21.15.29:0/3837171869 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb82013dd00 0x7fb820138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 >> 172.21.15.29:0/3837171869 conn(0x7fb8200c7110 msgr2=0x7fb8200c2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:48.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 shutdown_connections 2023-10-16T19:39:48.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.822+0000 7fb827ec0700 1 -- 172.21.15.29:0/3837171869 wait complete. 2023-10-16T19:39:48.826 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2023-10-16T19:39:48.836 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.961+0000 7f0c87e1d700 1 Processor -- start 2023-10-16T19:39:48.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.962+0000 7f0c87e1d700 1 -- start start 2023-10-16T19:39:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c87e1d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c80153290 0x7f0c80156510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c87e1d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800bd0e0 con 0x7f0c800c7bb0 2023-10-16T19:39:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c87e1d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800c5330 con 0x7f0c800c4f50 2023-10-16T19:39:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c87e1d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800c3000 con 0x7f0c80153290 2023-10-16T19:39:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c853b8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0c800c7bb0 0x7f0c80155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36462/0 (socket says 172.21.15.29:36462) 2023-10-16T19:39:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c863ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c80153290 0x7f0c80156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c853b8700 1 -- 172.21.15.29:0/3588864223 learned_addr learned my addr 172.21.15.29:0/3588864223 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:48.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c863ba700 1 -- 172.21.15.29:0/3588864223 >> v1:172.21.15.53:6789/0 conn(0x7f0c800c4f50 legacy=0x7f0c80070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c863ba700 1 -- 172.21.15.29:0/3588864223 >> v1:172.21.15.29:6789/0 conn(0x7f0c800c7bb0 legacy=0x7f0c80155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c863ba700 1 -- 172.21.15.29:0/3588864223 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800c2a40 con 0x7f0c80153290 2023-10-16T19:39:48.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c863ba700 1 --2- 172.21.15.29:0/3588864223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c80153290 0x7f0c80156510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009dc0 tx=0x7f0c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8409d952b5105c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c84bb7700 1 -- 172.21.15.29:0/3588864223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x7f0c80153290 2023-10-16T19:39:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c84bb7700 1 -- 172.21.15.29:0/3588864223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800bb90 con 0x7f0c80153290 2023-10-16T19:39:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.963+0000 7f0c84bb7700 1 -- 172.21.15.29:0/3588864223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78012430 con 0x7f0c80153290 2023-10-16T19:39:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3588864223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c80153290 msgr2=0x7f0c80156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3588864223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c80153290 0x7f0c80156510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009dc0 tx=0x7f0c7800b330 comp rx=0 tx=0).stop 2023-10-16T19:39:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3588864223 shutdown_connections 2023-10-16T19:39:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3588864223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c80153290 0x7f0c80156510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3588864223 >> 172.21.15.29:0/3588864223 conn(0x7f0c800a9cd0 msgr2=0x7f0c800aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3588864223 shutdown_connections 2023-10-16T19:39:48.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.964+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3588864223 wait complete. 2023-10-16T19:39:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.965+0000 7f0c87e1d700 1 Processor -- start 2023-10-16T19:39:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 -- start start 2023-10-16T19:39:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 0x7f0c800c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0c80153290 0x7f0c800abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800ad7c0 con 0x7f0c800c4f50 2023-10-16T19:39:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801564b0 con 0x7f0c800c7bb0 2023-10-16T19:39:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.966+0000 7f0c87e1d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80156940 con 0x7f0c80153290 2023-10-16T19:39:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51022/0 (socket says 172.21.15.29:51022) 2023-10-16T19:39:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 -- 172.21.15.29:0/3101948697 learned_addr learned my addr 172.21.15.29:0/3101948697 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c853b8700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 0x7f0c800c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c863ba700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0c80153290 0x7f0c800abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 -- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0c80153290 msgr2=0x7f0c800abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0c80153290 0x7f0c800abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 -- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 msgr2=0x7f0c800c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:48.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 0x7f0c800c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:48.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 -- 172.21.15.29:0/3101948697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009a70 con 0x7f0c800c4f50 2023-10-16T19:39:48.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c853b8700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 0x7f0c800c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c85bb9700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400c4e0 tx=0x7f0c7400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740052d0 con 0x7f0c800c4f50 2023-10-16T19:39:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c74005430 con 0x7f0c800c4f50 2023-10-16T19:39:48.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c80151eb0 con 0x7f0c800c4f50 2023-10-16T19:39:48.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740038c0 con 0x7f0c800c4f50 2023-10-16T19:39:48.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.967+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c800ad9f0 con 0x7f0c800c4f50 2023-10-16T19:39:48.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.968+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8004f400 con 0x7f0c800c4f50 2023-10-16T19:39:48.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.969+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f0c74003a20 con 0x7f0c800c4f50 2023-10-16T19:39:48.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.969+0000 7f0c727fc700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:48.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.969+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c74088590 con 0x7f0c800c4f50 2023-10-16T19:39:48.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.969+0000 7f0c853b8700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.970+0000 7f0c853b8700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 0x7f0c6406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c007fd0 tx=0x7f0c7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:48.973+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c74053a70 con 0x7f0c800c4f50 2023-10-16T19:39:49.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.176+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c800bed00 con 0x7f0c800c4f50 2023-10-16T19:39:49.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.177+0000 7f0c727fc700 1 -- 172.21.15.29:0/3101948697 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f0c74057090 con 0x7f0c800c4f50 2023-10-16T19:39:49.179 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:49.179 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:48.923272+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 msgr2=0x7f0c6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 0x7f0c6406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c007fd0 tx=0x7f0c7c009040 comp rx=0 tx=0).stop 2023-10-16T19:39:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 msgr2=0x7f0c800ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400c4e0 tx=0x7f0c7400c7f0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 shutdown_connections 2023-10-16T19:39:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0c80153290 0x7f0c800abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c800c4f50 0x7f0c800ad280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 --2- 172.21.15.29:0/3101948697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c800c7bb0 0x7f0c800c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 >> 172.21.15.29:0/3101948697 conn(0x7f0c800a9cd0 msgr2=0x7f0c800aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 shutdown_connections 2023-10-16T19:39:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.179+0000 7f0c87e1d700 1 -- 172.21.15.29:0/3101948697 wait complete. 2023-10-16T19:39:49.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:39:49.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:39:49.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.322+0000 7f021a0d7700 1 Processor -- start 2023-10-16T19:39:49.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.322+0000 7f021a0d7700 1 -- start start 2023-10-16T19:39:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f021a0d7700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02140c3350 0x7f02141555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f021a0d7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0214155af0 con 0x7f021414ec50 2023-10-16T19:39:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f021a0d7700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0214152300 con 0x7f021406db00 2023-10-16T19:39:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f021a0d7700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02140c2e40 con 0x7f02140c3350 2023-10-16T19:39:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f02137fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f021414ec50 0x7f0214071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36474/0 (socket says 172.21.15.29:36474) 2023-10-16T19:39:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f02137fe700 1 -- 172.21.15.29:0/3220079046 learned_addr learned my addr 172.21.15.29:0/3220079046 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.324+0000 7f0212ffd700 1 --2- 172.21.15.29:0/3220079046 >> v2:172.21.15.53:3300/0 conn(0x7f02140c3350 0x7f02141555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f0212ffd700 1 -- 172.21.15.29:0/3220079046 >> v1:172.21.15.53:6789/0 conn(0x7f021406db00 legacy=0x7f021406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f0212ffd700 1 -- 172.21.15.29:0/3220079046 >> v1:172.21.15.29:6789/0 conn(0x7f021414ec50 legacy=0x7f0214071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f0212ffd700 1 -- 172.21.15.29:0/3220079046 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021414f030 con 0x7f02140c3350 2023-10-16T19:39:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f02127fc700 1 -- 172.21.15.29:0/3220079046 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089912062 0 0) 0x7f0214152300 con 0x7f021406db00 2023-10-16T19:39:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f0212ffd700 1 --2- 172.21.15.29:0/3220079046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f02141555b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0208009840 tx=0x7f0208009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a02c99961f7ed8d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f02127fc700 1 -- 172.21.15.29:0/3220079046 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011830 con 0x7f02140c3350 2023-10-16T19:39:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f02127fc700 1 -- 172.21.15.29:0/3220079046 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208011990 con 0x7f02140c3350 2023-10-16T19:39:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.325+0000 7f02127fc700 1 -- 172.21.15.29:0/3220079046 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011d20 con 0x7f02140c3350 2023-10-16T19:39:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 -- 172.21.15.29:0/3220079046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 msgr2=0x7f02141555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3220079046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f02141555b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0208009840 tx=0x7f0208009b50 comp rx=0 tx=0).stop 2023-10-16T19:39:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 -- 172.21.15.29:0/3220079046 shutdown_connections 2023-10-16T19:39:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3220079046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f02141555b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 -- 172.21.15.29:0/3220079046 >> 172.21.15.29:0/3220079046 conn(0x7f02140c7110 msgr2=0x7f02140c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 -- 172.21.15.29:0/3220079046 shutdown_connections 2023-10-16T19:39:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.326+0000 7f021a0d7700 1 -- 172.21.15.29:0/3220079046 wait complete. 2023-10-16T19:39:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.328+0000 7f021a0d7700 1 Processor -- start 2023-10-16T19:39:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.328+0000 7f021a0d7700 1 -- start start 2023-10-16T19:39:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f021406db00 0x7f0214153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f021414ec50 0x7f021414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021406e790 con 0x7f021414ec50 2023-10-16T19:39:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214150490 con 0x7f02140c3350 2023-10-16T19:39:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f021a0d7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02141dac40 con 0x7f021406db00 2023-10-16T19:39:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0213fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f021414ec50 0x7f021414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41322/0 (socket says 172.21.15.29:41322) 2023-10-16T19:39:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 -- 172.21.15.29:0/3676976026 learned_addr learned my addr 172.21.15.29:0/3676976026 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f02137fe700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f021406db00 0x7f0214153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 -- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f021406db00 msgr2=0x7f0214153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f021406db00 0x7f0214153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 -- 172.21.15.29:0/3676976026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f021414ec50 msgr2=0x7f021414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f021414ec50 0x7f021414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.329+0000 7f0212ffd700 1 -- 172.21.15.29:0/3676976026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080094a0 con 0x7f02140c3350 2023-10-16T19:39:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f0212ffd700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f02080090b0 tx=0x7f0208004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020801a7e0 con 0x7f02140c3350 2023-10-16T19:39:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020801a940 con 0x7f02140c3350 2023-10-16T19:39:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02141e66f0 con 0x7f02140c3350 2023-10-16T19:39:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020801acb0 con 0x7f02140c3350 2023-10-16T19:39:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.330+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02141db1e0 con 0x7f02140c3350 2023-10-16T19:39:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.331+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021404f400 con 0x7f02140c3350 2023-10-16T19:39:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.331+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f0208022070 con 0x7f02140c3350 2023-10-16T19:39:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.332+0000 7f01fbfff700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 0x7f020006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.332+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f020808a2b0 con 0x7f02140c3350 2023-10-16T19:39:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.332+0000 7f02137fe700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 0x7f020006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.332+0000 7f02137fe700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 0x7f020006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f02040012e0 tx=0x7f0204001a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.337+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0208055940 con 0x7f02140c3350 2023-10-16T19:39:49.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.536+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02140a88d0 con 0x7f02140c3350 2023-10-16T19:39:49.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.539+0000 7f01fbfff700 1 -- 172.21.15.29:0/3676976026 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0208015020 con 0x7f02140c3350 2023-10-16T19:39:49.541 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:39:49.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 msgr2=0x7f020006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 0x7f020006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f02040012e0 tx=0x7f0204001a30 comp rx=0 tx=0).stop 2023-10-16T19:39:49.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 msgr2=0x7f021414fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f02080090b0 tx=0x7f0208004750 comp rx=0 tx=0).stop 2023-10-16T19:39:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 shutdown_connections 2023-10-16T19:39:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f020006ae70 0x7f020006d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f021414ec50 0x7f021414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f021406db00 0x7f0214153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 --2- 172.21.15.29:0/3676976026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02140c3350 0x7f021414fa10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.541+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 >> 172.21.15.29:0/3676976026 conn(0x7f02140c7110 msgr2=0x7f02140c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.542+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 shutdown_connections 2023-10-16T19:39:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.544+0000 7f021a0d7700 1 -- 172.21.15.29:0/3676976026 wait complete. 2023-10-16T19:39:49.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T19:39:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.682+0000 7f6025541700 1 Processor -- start 2023-10-16T19:39:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f6025541700 1 -- start start 2023-10-16T19:39:49.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f6025541700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f60200c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f6025541700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200ca540 con 0x7f60200bd8c0 2023-10-16T19:39:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f6025541700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020158c80 con 0x7f60200c8130 2023-10-16T19:39:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f6025541700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200ca790 con 0x7f6020151ea0 2023-10-16T19:39:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f601f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f60200bd8c0 0x7f6020155260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36492/0 (socket says 172.21.15.29:36492) 2023-10-16T19:39:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.683+0000 7f601f7fe700 1 -- 172.21.15.29:0/2719719979 learned_addr learned my addr 172.21.15.29:0/2719719979 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:49.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601effd700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f60200c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797465015 0 0) 0x7f60200ca540 con 0x7f60200bd8c0 2023-10-16T19:39:49.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c0035b0 con 0x7f60200bd8c0 2023-10-16T19:39:49.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617589292 0 0) 0x7f600c0035b0 con 0x7f60200bd8c0 2023-10-16T19:39:49.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 msgr2=0x7f60200c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:49.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f60200c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 >> v1:172.21.15.53:6789/0 conn(0x7f60200c8130 legacy=0x7f6020154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200caa70 con 0x7f60200bd8c0 2023-10-16T19:39:49.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f60180019f0 con 0x7f60200bd8c0 2023-10-16T19:39:49.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 >> v1:172.21.15.29:6789/0 conn(0x7f60200bd8c0 legacy=0x7f6020155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f600c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f600c004d90 0x7f600c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200ca790 con 0x7f600c004d90 2023-10-16T19:39:49.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bba0 con 0x7f600c003a30 2023-10-16T19:39:49.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bd30 con 0x7f6020151ea0 2023-10-16T19:39:49.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f600c004d90 0x7f600c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601effd700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601e7fc700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f600c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 -- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 msgr2=0x7f600c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020151ea0 0x7f600c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 -- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f600c003a30 msgr2=0x7f600c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601f7fe700 1 -- 172.21.15.29:0/2719719979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0035b0 con 0x7f600c004d90 2023-10-16T19:39:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.684+0000 7f601effd700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f601f7fe700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f600c004d90 0x7f600c005210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f601800a870 tx=0x7f600c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e0592cf67c7722 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018012600 con 0x7f600c004d90 2023-10-16T19:39:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018012780 con 0x7f600c004d90 2023-10-16T19:39:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f601dffb700 1 -- 172.21.15.29:0/2719719979 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018012b30 con 0x7f600c004d90 2023-10-16T19:39:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 -- 172.21.15.29:0/2719719979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f600c004d90 msgr2=0x7f600c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 --2- 172.21.15.29:0/2719719979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f600c004d90 0x7f600c005210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f601800a870 tx=0x7f600c005880 comp rx=0 tx=0).stop 2023-10-16T19:39:49.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f601f7fe700 1 -- 172.21.15.29:0/2719719979 reap_dead start 2023-10-16T19:39:49.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 -- 172.21.15.29:0/2719719979 shutdown_connections 2023-10-16T19:39:49.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 -- 172.21.15.29:0/2719719979 >> 172.21.15.29:0/2719719979 conn(0x7f6020072190 msgr2=0x7f60200725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 -- 172.21.15.29:0/2719719979 shutdown_connections 2023-10-16T19:39:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.685+0000 7f6025541700 1 -- 172.21.15.29:0/2719719979 wait complete. 2023-10-16T19:39:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 Processor -- start 2023-10-16T19:39:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 -- start start 2023-10-16T19:39:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 0x7f6020155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020156120 con 0x7f6020153c50 2023-10-16T19:39:49.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201ea950 con 0x7f60201552b0 2023-10-16T19:39:49.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f6025541700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200acf80 con 0x7f6020153870 2023-10-16T19:39:49.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.687+0000 7f601e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51058/0 (socket says 172.21.15.29:51058) 2023-10-16T19:39:49.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:43510/0 (socket says 172.21.15.29:43510) 2023-10-16T19:39:49.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 0x7f6020155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601e7fc700 1 -- 172.21.15.29:0/3748965370 learned_addr learned my addr 172.21.15.29:0/3748965370 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:49.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 -- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 msgr2=0x7f602014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 -- 172.21.15.29:0/3748965370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 msgr2=0x7f6020154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 -- 172.21.15.29:0/3748965370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200ad260 con 0x7f60201552b0 2023-10-16T19:39:49.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601e7fc700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:49.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601effd700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:39:49.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f601f7fe700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 0x7f6020155740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6018015000 tx=0x7f60200c5a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018012d00 con 0x7f60201552b0 2023-10-16T19:39:49.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018012e60 con 0x7f60201552b0 2023-10-16T19:39:49.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201ea5e0 con 0x7f60201552b0 2023-10-16T19:39:49.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801e670 con 0x7f60201552b0 2023-10-16T19:39:49.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.688+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201441b0 con 0x7f60201552b0 2023-10-16T19:39:49.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.689+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602014c9a0 con 0x7f60201552b0 2023-10-16T19:39:49.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.690+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f601801e7d0 con 0x7f60201552b0 2023-10-16T19:39:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.690+0000 7f60177fe700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.690+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f601808ada0 con 0x7f60201552b0 2023-10-16T19:39:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.690+0000 7f601effd700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.691+0000 7f601effd700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 0x7f600006d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60100144c0 tx=0x7f6010009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.695+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6018056270 con 0x7f60201552b0 2023-10-16T19:39:49.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.896+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60200cad20 con 0x7f60201552b0 2023-10-16T19:39:49.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.897+0000 7f60177fe700 1 -- 172.21.15.29:0/3748965370 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6018059890 con 0x7f60201552b0 2023-10-16T19:39:49.899 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:49.899 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-16T19:39:49.899 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:39:49.900 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-16T19:39:49.900 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-16T19:39:49.900 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:39:49.901 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-16T19:39:49.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.898+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 msgr2=0x7f600006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 0x7f600006d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60100144c0 tx=0x7f6010009210 comp rx=0 tx=0).stop 2023-10-16T19:39:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 msgr2=0x7f6020155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 0x7f6020155740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6018015000 tx=0x7f60200c5a80 comp rx=0 tx=0).stop 2023-10-16T19:39:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 shutdown_connections 2023-10-16T19:39:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f600006af00 0x7f600006d3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60201552b0 0x7f6020155740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6020153870 0x7f602014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 --2- 172.21.15.29:0/3748965370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6020153c50 0x7f6020154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 >> 172.21.15.29:0/3748965370 conn(0x7f6020072190 msgr2=0x7f60200c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 shutdown_connections 2023-10-16T19:39:49.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:49.899+0000 7f6025541700 1 -- 172.21.15.29:0/3748965370 wait complete. 2023-10-16T19:39:49.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T19:39:49.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T19:39:50.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.040+0000 7fd0b6238700 1 Processor -- start 2023-10-16T19:39:50.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.040+0000 7fd0b6238700 1 -- start start 2023-10-16T19:39:50.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0b6238700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd0b0071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0b6238700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b0157ed0 con 0x7fd0b006f180 2023-10-16T19:39:50.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0b6238700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b0158770 con 0x7fd0b0152000 2023-10-16T19:39:50.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0b6238700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01523e0 con 0x7fd0b0158c00 2023-10-16T19:39:50.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0affff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd0b006f180 0x7fd0b01548e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36512/0 (socket says 172.21.15.29:36512) 2023-10-16T19:39:50.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0affff700 1 -- 172.21.15.29:0/988852438 learned_addr learned my addr 172.21.15.29:0/988852438 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:50.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0aeffd700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd0b0071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424905477 0 0) 0x7fd0b0157ed0 con 0x7fd0b006f180 2023-10-16T19:39:50.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.041+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd09c0035b0 con 0x7fd0b006f180 2023-10-16T19:39:50.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3402332449 0 0) 0x7fd09c0035b0 con 0x7fd0b006f180 2023-10-16T19:39:50.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 msgr2=0x7fd0b0071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:50.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd0b0071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 >> v1:172.21.15.53:6789/0 conn(0x7fd0b0152000 legacy=0x7fd0b006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00723c0 con 0x7fd0b006f180 2023-10-16T19:39:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fd0a80019f0 con 0x7fd0b006f180 2023-10-16T19:39:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 >> v1:172.21.15.29:6789/0 conn(0x7fd0b006f180 legacy=0x7fd0b01548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd09c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd09c003fb0 0x7fd09c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd09c004d90 0x7fd09c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01523e0 con 0x7fd09c004d90 2023-10-16T19:39:50.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c00bc50 con 0x7fd09c003fb0 2023-10-16T19:39:50.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c00be10 con 0x7fd0b0158c00 2023-10-16T19:39:50.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd09c004d90 0x7fd09c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0aeffd700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd09c003fb0 0x7fd09c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0af7fe700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd09c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 -- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 msgr2=0x7fd09c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd0b0158c00 0x7fd09c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 -- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd09c003fb0 msgr2=0x7fd09c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:50.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd09c003fb0 0x7fd09c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 -- 172.21.15.29:0/988852438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0035b0 con 0x7fd09c004d90 2023-10-16T19:39:50.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0affff700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd09c004d90 0x7fd09c005210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800a830 tx=0x7fd09c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76179c7e3825bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:50.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800a2f0 con 0x7fd09c004d90 2023-10-16T19:39:50.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8012600 con 0x7fd09c004d90 2023-10-16T19:39:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.042+0000 7fd0ae7fc700 1 -- 172.21.15.29:0/988852438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80129b0 con 0x7fd09c004d90 2023-10-16T19:39:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 -- 172.21.15.29:0/988852438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd09c004d90 msgr2=0x7fd09c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 --2- 172.21.15.29:0/988852438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd09c004d90 0x7fd09c005210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800a830 tx=0x7fd09c005880 comp rx=0 tx=0).stop 2023-10-16T19:39:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0affff700 1 -- 172.21.15.29:0/988852438 reap_dead start 2023-10-16T19:39:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 -- 172.21.15.29:0/988852438 shutdown_connections 2023-10-16T19:39:50.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 -- 172.21.15.29:0/988852438 >> 172.21.15.29:0/988852438 conn(0x7fd0b00c7150 msgr2=0x7fd0b00c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:50.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 -- 172.21.15.29:0/988852438 shutdown_connections 2023-10-16T19:39:50.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.043+0000 7fd0b6238700 1 -- 172.21.15.29:0/988852438 wait complete. 2023-10-16T19:39:50.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.044+0000 7fd0b6238700 1 Processor -- start 2023-10-16T19:39:50.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.044+0000 7fd0b6238700 1 -- start start 2023-10-16T19:39:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd09c004d90 0x7fd0b00c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0b0149320 0x7fd0b01ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c1a80 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c3190 con 0x7fd0b0149320 2023-10-16T19:39:50.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0b6238700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01ead70 con 0x7fd09c004d90 2023-10-16T19:39:50.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51078/0 (socket says 172.21.15.29:51078) 2023-10-16T19:39:50.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0aeffd700 1 -- 172.21.15.29:0/335439620 learned_addr learned my addr 172.21.15.29:0/335439620 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:50.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0af7fe700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd09c004d90 0x7fd0b00c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0affff700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0b0149320 0x7fd0b01ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.045+0000 7fd0aeffd700 1 -- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd09c004d90 msgr2=0x7fd0b00c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0aeffd700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd09c004d90 0x7fd0b00c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0aeffd700 1 -- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0b0149320 msgr2=0x7fd0b01ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0aeffd700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0b0149320 0x7fd0b01ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0aeffd700 1 -- 172.21.15.29:0/335439620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00c58a0 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0aeffd700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd098011ad0 tx=0x7fd098011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800f8e0 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800fa40 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b00c5b80 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800fdf0 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.046+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b00c2d80 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.047+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b01ed780 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.047+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd098014440 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.048+0000 7fd0a7fff700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 0x7fd09006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.048+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd098089860 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.048+0000 7fd0af7fe700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 0x7fd09006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.048+0000 7fd0af7fe700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 0x7fd09006d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.052+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd098054d10 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.254+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd0b004f400 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.933+0000 7fd0a7fff700 1 -- 172.21.15.29:0/335439620 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd098058330 con 0x7fd0b01ea7d0 2023-10-16T19:39:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 msgr2=0x7fd09006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 0x7fd09006d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0009040 comp rx=0 tx=0).stop 2023-10-16T19:39:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 msgr2=0x7fd0b0148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd098011ad0 tx=0x7fd098011de0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 shutdown_connections 2023-10-16T19:39:50.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd09006af00 0x7fd09006d3c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0b0149320 0x7fd0b01ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd09c004d90 0x7fd0b00c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 --2- 172.21.15.29:0/335439620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b01ea7d0 0x7fd0b0148de0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:50.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 >> 172.21.15.29:0/335439620 conn(0x7fd0b00c7150 msgr2=0x7fd0b0071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:50.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.938+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 shutdown_connections 2023-10-16T19:39:50.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:50.939+0000 7fd0b6238700 1 -- 172.21.15.29:0/335439620 wait complete. 2023-10-16T19:39:50.945 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-16T19:39:50.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-16T19:39:51.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.096+0000 7f25b1e76700 1 Processor -- start 2023-10-16T19:39:51.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.096+0000 7f25b1e76700 1 -- start start 2023-10-16T19:39:51.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25b1e76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f25ac1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25b1e76700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac06e780 con 0x7f25ac13d660 2023-10-16T19:39:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25b1e76700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac154f10 con 0x7f25ac13dd00 2023-10-16T19:39:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25b1e76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac06d320 con 0x7f25ac154a50 2023-10-16T19:39:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25ab7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f25ac13d660 0x7f25ac06a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36528/0 (socket says 172.21.15.29:36528) 2023-10-16T19:39:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25ab7fe700 1 -- 172.21.15.29:0/2405461339 learned_addr learned my addr 172.21.15.29:0/2405461339 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.097+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857669646 0 0) 0x7f25ac06e780 con 0x7f25ac13d660 2023-10-16T19:39:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25980035b0 con 0x7f25ac13d660 2023-10-16T19:39:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aaffd700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f25ac1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373940524 0 0) 0x7f25980035b0 con 0x7f25ac13d660 2023-10-16T19:39:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 msgr2=0x7f25ac1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f25ac1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 >> v1:172.21.15.53:6789/0 conn(0x7f25ac13dd00 legacy=0x7f25ac158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac1551f0 con 0x7f25ac13d660 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f259c001670 con 0x7f25ac13d660 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 >> v1:172.21.15.29:6789/0 conn(0x7f25ac13d660 legacy=0x7f25ac06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f2598003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598003fb0 0x7f2598004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f2598005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac06d320 con 0x7f2598004d90 2023-10-16T19:39:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259800baf0 con 0x7f2598003fb0 2023-10-16T19:39:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259800bcb0 con 0x7f25ac154a50 2023-10-16T19:39:51.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f2598005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25ab7fe700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f2598003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25aaffd700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598003fb0 0x7f2598004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 -- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 msgr2=0x7f2598003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac154a50 0x7f2598003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 -- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598003fb0 msgr2=0x7f2598004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598003fb0 0x7f2598004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 -- 172.21.15.29:0/2405461339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980035b0 con 0x7f2598004d90 2023-10-16T19:39:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.098+0000 7f25abfff700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f2598005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c0e0 tx=0x7f2598005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23d6079ce1ec33a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4001da0 con 0x7f2598004d90 2023-10-16T19:39:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4003c50 con 0x7f2598004d90 2023-10-16T19:39:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25aa7fc700 1 -- 172.21.15.29:0/2405461339 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400ca20 con 0x7f2598004d90 2023-10-16T19:39:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 -- 172.21.15.29:0/2405461339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 msgr2=0x7f2598005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 --2- 172.21.15.29:0/2405461339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f2598005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c0e0 tx=0x7f2598005880 comp rx=0 tx=0).stop 2023-10-16T19:39:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25abfff700 1 -- 172.21.15.29:0/2405461339 reap_dead start 2023-10-16T19:39:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 -- 172.21.15.29:0/2405461339 shutdown_connections 2023-10-16T19:39:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 -- 172.21.15.29:0/2405461339 >> 172.21.15.29:0/2405461339 conn(0x7f25ac0c7110 msgr2=0x7f25ac0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 -- 172.21.15.29:0/2405461339 shutdown_connections 2023-10-16T19:39:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.099+0000 7f25b1e76700 1 -- 172.21.15.29:0/2405461339 wait complete. 2023-10-16T19:39:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.100+0000 7f25b1e76700 1 Processor -- start 2023-10-16T19:39:51.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 -- start start 2023-10-16T19:39:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac12c3e0 0x7f25ac130f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 0x7f25ac0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1573b0 con 0x7f2598004d90 2023-10-16T19:39:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac158020 con 0x7f25ac155dc0 2023-10-16T19:39:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25b1e76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac130160 con 0x7f25ac12c3e0 2023-10-16T19:39:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25ab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25ab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51096/0 (socket says 172.21.15.29:51096) 2023-10-16T19:39:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.101+0000 7f25ab7fe700 1 -- 172.21.15.29:0/1704143795 learned_addr learned my addr 172.21.15.29:0/1704143795 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 -- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac12c3e0 msgr2=0x7f25ac130f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac12c3e0 0x7f25ac130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 -- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 msgr2=0x7f25ac0c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25abfff700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 0x7f25ac0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 0x7f25ac0c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 -- 172.21.15.29:0/1704143795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac157650 con 0x7f2598004d90 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25abfff700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 0x7f25ac0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:39:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25ab7fe700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f259c0072c0 tx=0x7f259c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:51.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00f870 con 0x7f2598004d90 2023-10-16T19:39:51.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00f9d0 con 0x7f2598004d90 2023-10-16T19:39:51.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac131960 con 0x7f2598004d90 2023-10-16T19:39:51.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00fd80 con 0x7f2598004d90 2023-10-16T19:39:51.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.102+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac130690 con 0x7f2598004d90 2023-10-16T19:39:51.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.103+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac157930 con 0x7f2598004d90 2023-10-16T19:39:51.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.103+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f259c01d460 con 0x7f2598004d90 2023-10-16T19:39:51.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.104+0000 7f25a3fff700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 0x7f258c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.104+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f259c089450 con 0x7f2598004d90 2023-10-16T19:39:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.104+0000 7f25aaffd700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 0x7f258c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.105+0000 7f25aaffd700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 0x7f258c06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25ac136790 tx=0x7f2594009670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.109+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f259c054770 con 0x7f2598004d90 2023-10-16T19:39:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.311+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f25ac0c3760 con 0x7f2598004d90 2023-10-16T19:39:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.936+0000 7f25a3fff700 1 -- 172.21.15.29:0/1704143795 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f259c057d90 con 0x7f2598004d90 2023-10-16T19:39:51.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 msgr2=0x7f258c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 0x7f258c06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25ac136790 tx=0x7f2594009670 comp rx=0 tx=0).stop 2023-10-16T19:39:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 msgr2=0x7f25ac157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f259c0072c0 tx=0x7f259c007680 comp rx=0 tx=0).stop 2023-10-16T19:39:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 shutdown_connections 2023-10-16T19:39:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f258c06af00 0x7f258c06d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac155dc0 0x7f25ac0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2598004d90 0x7f25ac157ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 --2- 172.21.15.29:0/1704143795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac12c3e0 0x7f25ac130f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.939+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 >> 172.21.15.29:0/1704143795 conn(0x7f25ac0c7110 msgr2=0x7f25ac137090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.940+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 shutdown_connections 2023-10-16T19:39:51.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:51.940+0000 7f25b1e76700 1 -- 172.21.15.29:0/1704143795 wait complete. 2023-10-16T19:39:51.950 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-16T19:39:51.970 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T19:39:52.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.100+0000 7f5c7a343700 1 Processor -- start 2023-10-16T19:39:52.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 -- start start 2023-10-16T19:39:52.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c7413d660 0x7f5c7406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c74154a50 0x7f5c741583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7406e780 con 0x7f5c7406adc0 2023-10-16T19:39:52.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7406d320 con 0x7f5c7413d660 2023-10-16T19:39:52.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c7a343700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74154f10 con 0x7f5c74154a50 2023-10-16T19:39:52.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.101+0000 7f5c73fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c7413d660 0x7f5c7406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c788e0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5c7406adc0 0x7f5c74158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36552/0 (socket says 172.21.15.29:36552) 2023-10-16T19:39:52.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c788e0700 1 -- 172.21.15.29:0/800765624 learned_addr learned my addr 172.21.15.29:0/800765624 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:52.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c737fe700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c74154a50 0x7f5c741583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c73fff700 1 -- 172.21.15.29:0/800765624 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c74154a50 msgr2=0x7f5c741583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:52.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c73fff700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c74154a50 0x7f5c741583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c73fff700 1 -- 172.21.15.29:0/800765624 >> v1:172.21.15.29:6789/0 conn(0x7f5c7406adc0 legacy=0x7f5c74158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c73fff700 1 -- 172.21.15.29:0/800765624 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c741551f0 con 0x7f5c7413d660 2023-10-16T19:39:52.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c73fff700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c7413d660 0x7f5c7406a880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009840 tx=0x7f5c64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81398e7e4e8ffa84 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:52.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c72ffd700 1 -- 172.21.15.29:0/800765624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64011830 con 0x7f5c7413d660 2023-10-16T19:39:52.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c72ffd700 1 -- 172.21.15.29:0/800765624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64011990 con 0x7f5c7413d660 2023-10-16T19:39:52.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.102+0000 7f5c72ffd700 1 -- 172.21.15.29:0/800765624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64011d20 con 0x7f5c7413d660 2023-10-16T19:39:52.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 -- 172.21.15.29:0/800765624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c7413d660 msgr2=0x7f5c7406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c7413d660 0x7f5c7406a880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009840 tx=0x7f5c64009b50 comp rx=0 tx=0).stop 2023-10-16T19:39:52.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 -- 172.21.15.29:0/800765624 shutdown_connections 2023-10-16T19:39:52.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c7413d660 0x7f5c7406a880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 --2- 172.21.15.29:0/800765624 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c74154a50 0x7f5c741583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 -- 172.21.15.29:0/800765624 >> 172.21.15.29:0/800765624 conn(0x7f5c740c7110 msgr2=0x7f5c740c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:52.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 -- 172.21.15.29:0/800765624 shutdown_connections 2023-10-16T19:39:52.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.103+0000 7f5c7a343700 1 -- 172.21.15.29:0/800765624 wait complete. 2023-10-16T19:39:52.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.104+0000 7f5c7a343700 1 Processor -- start 2023-10-16T19:39:52.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.104+0000 7f5c7a343700 1 -- start start 2023-10-16T19:39:52.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c7406adc0 0x7f5c74157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 0x7f5c74133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740c66f0 con 0x7f5c74154a50 2023-10-16T19:39:52.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7413b330 con 0x7f5c7406adc0 2023-10-16T19:39:52.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c7a343700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7413ca20 con 0x7f5c7413d660 2023-10-16T19:39:52.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51114/0 (socket says 172.21.15.29:51114) 2023-10-16T19:39:52.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 -- 172.21.15.29:0/1603638412 learned_addr learned my addr 172.21.15.29:0/1603638412 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c73fff700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c7406adc0 0x7f5c74157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c737fe700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 0x7f5c74133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 -- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 msgr2=0x7f5c74133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 0x7f5c74133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 -- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c7406adc0 msgr2=0x7f5c74157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c7406adc0 0x7f5c74157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 -- 172.21.15.29:0/1603638412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640094a0 con 0x7f5c74154a50 2023-10-16T19:39:52.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c737fe700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 0x7f5c74133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:52.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c788e0700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00cb10 tx=0x7f5c6c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:52.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.105+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00aaa0 con 0x7f5c74154a50 2023-10-16T19:39:52.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.106+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c00ac00 con 0x7f5c74154a50 2023-10-16T19:39:52.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.106+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7413c290 con 0x7f5c74154a50 2023-10-16T19:39:52.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.106+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c012400 con 0x7f5c74154a50 2023-10-16T19:39:52.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.106+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74157ad0 con 0x7f5c74154a50 2023-10-16T19:39:52.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.106+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c740c6b40 con 0x7f5c74154a50 2023-10-16T19:39:52.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.107+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5c6c007d50 con 0x7f5c74154a50 2023-10-16T19:39:52.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.107+0000 7f5c70ff9700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 0x7f5c6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:52.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.108+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5c6c088e90 con 0x7f5c74154a50 2023-10-16T19:39:52.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.108+0000 7f5c73fff700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 0x7f5c6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:52.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.108+0000 7f5c73fff700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 0x7f5c6006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c640090b0 tx=0x7f5c64008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:52.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.112+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c740c6b40 con 0x7f5c74154a50 2023-10-16T19:39:52.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.362+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c740c6b40 con 0x7f5c74154a50 2023-10-16T19:39:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.961+0000 7f5c70ff9700 1 -- 172.21.15.29:0/1603638412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c740c6b40 con 0x7f5c74154a50 2023-10-16T19:39:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 msgr2=0x7f5c6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 0x7f5c6006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c640090b0 tx=0x7f5c64008030 comp rx=0 tx=0).stop 2023-10-16T19:39:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 msgr2=0x7f5c741e9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00cb10 tx=0x7f5c6c00ce20 comp rx=0 tx=0).stop 2023-10-16T19:39:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 shutdown_connections 2023-10-16T19:39:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5c6006af00 0x7f5c6006d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c74154a50 0x7f5c741e9b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c7406adc0 0x7f5c74157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 --2- 172.21.15.29:0/1603638412 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c7413d660 0x7f5c74133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 >> 172.21.15.29:0/1603638412 conn(0x7f5c740c7110 msgr2=0x7f5c7406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 shutdown_connections 2023-10-16T19:39:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:52.982+0000 7f5c7a343700 1 -- 172.21.15.29:0/1603638412 wait complete. 2023-10-16T19:39:52.987 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T19:39:52.999 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-16T19:39:53.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-16T19:39:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.133+0000 7f361b1c5700 1 Processor -- start 2023-10-16T19:39:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.133+0000 7f361b1c5700 1 -- start start 2023-10-16T19:39:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f361b1c5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36140c43b0 0x7f36140c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f361b1c5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3614152480 con 0x7f361406b990 2023-10-16T19:39:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f361b1c5700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3614158160 con 0x7f36141520a0 2023-10-16T19:39:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f361b1c5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361406c340 con 0x7f36140c43b0 2023-10-16T19:39:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36140c43b0 0x7f36140c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3613fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f361406b990 0x7f36141549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36580/0 (socket says 172.21.15.29:36580) 2023-10-16T19:39:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36140c43b0 0x7f36140c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51134/0 (socket says 172.21.15.29:51134) 2023-10-16T19:39:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3613fff700 1 -- 172.21.15.29:0/1013520111 learned_addr learned my addr 172.21.15.29:0/1013520111 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 -- 172.21.15.29:0/1013520111 >> v1:172.21.15.53:6789/0 conn(0x7f36141520a0 legacy=0x7f3614158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 -- 172.21.15.29:0/1013520111 >> v1:172.21.15.29:6789/0 conn(0x7f361406b990 legacy=0x7f36141549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 -- 172.21.15.29:0/1013520111 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361406d560 con 0x7f36140c43b0 2023-10-16T19:39:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.134+0000 7f3619762700 1 --2- 172.21.15.29:0/1013520111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140c76c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998cd38af2f7b03a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f36137fe700 1 -- 172.21.15.29:0/1013520111 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00e070 con 0x7f36140c43b0 2023-10-16T19:39:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f36137fe700 1 -- 172.21.15.29:0/1013520111 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c00bbd0 con 0x7f36140c43b0 2023-10-16T19:39:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f36137fe700 1 -- 172.21.15.29:0/1013520111 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c012430 con 0x7f36140c43b0 2023-10-16T19:39:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 -- 172.21.15.29:0/1013520111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 msgr2=0x7f36140c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 --2- 172.21.15.29:0/1013520111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140c76c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c00b330 comp rx=0 tx=0).stop 2023-10-16T19:39:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 -- 172.21.15.29:0/1013520111 shutdown_connections 2023-10-16T19:39:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 --2- 172.21.15.29:0/1013520111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140c76c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 -- 172.21.15.29:0/1013520111 >> 172.21.15.29:0/1013520111 conn(0x7f361406aeb0 msgr2=0x7f36140c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 -- 172.21.15.29:0/1013520111 shutdown_connections 2023-10-16T19:39:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.135+0000 7f361b1c5700 1 -- 172.21.15.29:0/1013520111 wait complete. 2023-10-16T19:39:53.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.136+0000 7f361b1c5700 1 Processor -- start 2023-10-16T19:39:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.136+0000 7f361b1c5700 1 -- start start 2023-10-16T19:39:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 0x7f36141ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 0x7f36140c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36141e9f20 con 0x7f36140c43b0 2023-10-16T19:39:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140bea60 con 0x7f361406b990 2023-10-16T19:39:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f361b1c5700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140c2320 con 0x7f36141520a0 2023-10-16T19:39:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f3613fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f3613fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51140/0 (socket says 172.21.15.29:51140) 2023-10-16T19:39:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.137+0000 7f3613fff700 1 -- 172.21.15.29:0/430423700 learned_addr learned my addr 172.21.15.29:0/430423700 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3619762700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 0x7f36140c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3618f61700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 0x7f36141ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 -- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 msgr2=0x7f36140c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 0x7f36140c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 -- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 msgr2=0x7f36141ea3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 0x7f36141ea3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 -- 172.21.15.29:0/430423700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009a70 con 0x7f36140c43b0 2023-10-16T19:39:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3619762700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 0x7f36140c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:39:53.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3618f61700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 0x7f36141ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:39:53.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f3613fff700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f360000c520 tx=0x7f360000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:53.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600005d70 con 0x7f36140c43b0 2023-10-16T19:39:53.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000070d0 con 0x7f36140c43b0 2023-10-16T19:39:53.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600007440 con 0x7f36140c43b0 2023-10-16T19:39:53.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36140bed00 con 0x7f36140c43b0 2023-10-16T19:39:53.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.138+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36141e9bb0 con 0x7f36140c43b0 2023-10-16T19:39:53.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.139+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36141ea090 con 0x7f36140c43b0 2023-10-16T19:39:53.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.139+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36000075a0 con 0x7f36140c43b0 2023-10-16T19:39:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.140+0000 7f36117fa700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 0x7f35f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.140+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3600088950 con 0x7f36140c43b0 2023-10-16T19:39:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.140+0000 7f3618f61700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 0x7f35f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.140+0000 7f3618f61700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 0x7f35f806d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.144+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3600053b40 con 0x7f36140c43b0 2023-10-16T19:39:53.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.354+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f361404f400 con 0x7f36140c43b0 2023-10-16T19:39:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.947+0000 7f36117fa700 1 -- 172.21.15.29:0/430423700 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f36000170e0 con 0x7f36140c43b0 2023-10-16T19:39:53.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 msgr2=0x7f35f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 0x7f35f806d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608009040 comp rx=0 tx=0).stop 2023-10-16T19:39:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 msgr2=0x7f36140bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f360000c520 tx=0x7f360000c8e0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 shutdown_connections 2023-10-16T19:39:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f35f806af00 0x7f35f806d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36141520a0 0x7f36140c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f361406b990 0x7f36141ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 --2- 172.21.15.29:0/430423700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36140c43b0 0x7f36140bf140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 >> 172.21.15.29:0/430423700 conn(0x7f361406aeb0 msgr2=0x7f36140c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 shutdown_connections 2023-10-16T19:39:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:53.950+0000 7f361b1c5700 1 -- 172.21.15.29:0/430423700 wait complete. 2023-10-16T19:39:53.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T19:39:54.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.105+0000 7fb05063b700 1 Processor -- start 2023-10-16T19:39:54.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.105+0000 7fb05063b700 1 -- start start 2023-10-16T19:39:54.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb05063b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0480c21a0 0x7fb048152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb05063b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0481533e0 con 0x7fb0480c1d10 2023-10-16T19:39:54.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb05063b700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04806d8a0 con 0x7fb04814fe90 2023-10-16T19:39:54.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb05063b700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480c25b0 con 0x7fb0480c21a0 2023-10-16T19:39:54.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04dbd6700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb0480c1d10 0x7fb048152790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36590/0 (socket says 172.21.15.29:36590) 2023-10-16T19:39:54.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04dbd6700 1 -- 172.21.15.29:0/2734579140 learned_addr learned my addr 172.21.15.29:0/2734579140 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:54.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/2734579140 >> v2:172.21.15.53:3300/0 conn(0x7fb0480c21a0 0x7fb048152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204458715 0 0) 0x7fb0481533e0 con 0x7fb0480c1d10 2023-10-16T19:39:54.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0340035b0 con 0x7fb0480c1d10 2023-10-16T19:39:54.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422255571 0 0) 0x7fb0340035b0 con 0x7fb0480c1d10 2023-10-16T19:39:54.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 >> v2:172.21.15.53:3300/0 conn(0x7fb0480c21a0 msgr2=0x7fb048152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:54.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 --2- 172.21.15.29:0/2734579140 >> v2:172.21.15.53:3300/0 conn(0x7fb0480c21a0 0x7fb048152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 >> v1:172.21.15.53:6789/0 conn(0x7fb04814fe90 legacy=0x7fb04806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04806db80 con 0x7fb0480c1d10 2023-10-16T19:39:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fb044001670 con 0x7fb0480c1d10 2023-10-16T19:39:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 >> v1:172.21.15.29:6789/0 conn(0x7fb0480c1d10 legacy=0x7fb048152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034003a00 0x7fb034003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb034004850 0x7fb034004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 0x7fb03400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480c25b0 con 0x7fb034005330 2023-10-16T19:39:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400c200 con 0x7fb034004850 2023-10-16T19:39:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400c3c0 con 0x7fb034003a00 2023-10-16T19:39:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.107+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 0x7fb03400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04dbd6700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb034004850 0x7fb034004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04e3d7700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034003a00 0x7fb034003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 -- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034003a00 msgr2=0x7fb034003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034003a00 0x7fb034003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 -- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb034004850 msgr2=0x7fb034004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:54.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb034004850 0x7fb034004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 -- 172.21.15.29:0/2734579140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340035b0 con 0x7fb034005330 2023-10-16T19:39:54.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 -- 172.21.15.29:0/2734579140 reap_dead start 2023-10-16T19:39:54.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 0x7fb03400ba10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb040009f90 tx=0x7fb034005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aca77b139e1a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:54.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040003a20 con 0x7fb034005330 2023-10-16T19:39:54.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000f040 con 0x7fb034005330 2023-10-16T19:39:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.108+0000 7fb04d3d5700 1 -- 172.21.15.29:0/2734579140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040003dc0 con 0x7fb034005330 2023-10-16T19:39:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 -- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 msgr2=0x7fb03400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 0x7fb03400ba10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb040009f90 tx=0x7fb034005880 comp rx=0 tx=0).stop 2023-10-16T19:39:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 -- 172.21.15.29:0/2734579140 shutdown_connections 2023-10-16T19:39:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 --2- 172.21.15.29:0/2734579140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb034005330 0x7fb03400ba10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 -- 172.21.15.29:0/2734579140 >> 172.21.15.29:0/2734579140 conn(0x7fb04806c150 msgr2=0x7fb0480c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 -- 172.21.15.29:0/2734579140 shutdown_connections 2023-10-16T19:39:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.109+0000 7fb05063b700 1 -- 172.21.15.29:0/2734579140 wait complete. 2023-10-16T19:39:54.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.110+0000 7fb05063b700 1 Processor -- start 2023-10-16T19:39:54.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.110+0000 7fb05063b700 1 -- start start 2023-10-16T19:39:54.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034005330 0x7fb048150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 0x7fb0481e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481518f0 con 0x7fb0481e9c30 2023-10-16T19:39:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480ac050 con 0x7fb0480c6620 2023-10-16T19:39:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb048151e50 con 0x7fb034005330 2023-10-16T19:39:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51160/0 (socket says 172.21.15.29:51160) 2023-10-16T19:39:54.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 -- 172.21.15.29:0/1366457238 learned_addr learned my addr 172.21.15.29:0/1366457238 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:54.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04e3d7700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034005330 0x7fb048150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04dbd6700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 0x7fb0481e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 -- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034005330 msgr2=0x7fb048150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:54.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034005330 0x7fb048150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 -- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 msgr2=0x7fb0481e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:54.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 0x7fb0481e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:54.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 -- 172.21.15.29:0/1366457238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048152080 con 0x7fb0481e9c30 2023-10-16T19:39:54.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04dbd6700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 0x7fb0481e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:54.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb04ebd8700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb04000eeb0 tx=0x7fb040004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:54.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040023070 con 0x7fb0481e9c30 2023-10-16T19:39:54.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040003e10 con 0x7fb0481e9c30 2023-10-16T19:39:54.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb048152360 con 0x7fb0481e9c30 2023-10-16T19:39:54.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040004230 con 0x7fb0481e9c30 2023-10-16T19:39:54.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.111+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb048152920 con 0x7fb0481e9c30 2023-10-16T19:39:54.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.112+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04804f400 con 0x7fb0481e9c30 2023-10-16T19:39:54.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.113+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb040004390 con 0x7fb0481e9c30 2023-10-16T19:39:54.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.113+0000 7fb03effd700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 0x7fb02c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:54.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.113+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb04008a5f0 con 0x7fb0481e9c30 2023-10-16T19:39:54.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.114+0000 7fb04e3d7700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 0x7fb02c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:54.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.114+0000 7fb04e3d7700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 0x7fb02c06d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb038007fd0 tx=0x7fb038009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:54.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.118+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0400555b0 con 0x7fb0481e9c30 2023-10-16T19:39:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:54.322+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb0481e93a0 con 0x7fb0481e9c30 2023-10-16T19:39:55.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.972+0000 7fb03effd700 1 -- 172.21.15.29:0/1366457238 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb040058bd0 con 0x7fb0481e9c30 2023-10-16T19:39:55.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 msgr2=0x7fb02c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:55.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 0x7fb02c06d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb038007fd0 tx=0x7fb038009040 comp rx=0 tx=0).stop 2023-10-16T19:39:55.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 msgr2=0x7fb0481440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:55.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb04000eeb0 tx=0x7fb040004b40 comp rx=0 tx=0).stop 2023-10-16T19:39:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 shutdown_connections 2023-10-16T19:39:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb02c06af00 0x7fb02c06d3c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb038007fd0 tx=0x7fb038009040 comp rx=0 tx=0).stop 2023-10-16T19:39:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0481e9c30 0x7fb0481440d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034005330 0x7fb048150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 --2- 172.21.15.29:0/1366457238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0480c6620 0x7fb0481e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:55.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.976+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 >> 172.21.15.29:0/1366457238 conn(0x7fb04806c150 msgr2=0x7fb0480c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:55.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.979+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 shutdown_connections 2023-10-16T19:39:55.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:55.979+0000 7fb05063b700 1 -- 172.21.15.29:0/1366457238 wait complete. 2023-10-16T19:39:55.986 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2023-10-16T19:39:56.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-16T19:39:56.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.128+0000 7ff0aef55700 1 Processor -- start 2023-10-16T19:39:56.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.128+0000 7ff0aef55700 1 -- start start 2023-10-16T19:39:56.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0aef55700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0a80adb20 0x7ff0a80c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0aef55700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80c7d10 con 0x7ff0a8152aa0 2023-10-16T19:39:56.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0aef55700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80c73e0 con 0x7ff0a80a9ed0 2023-10-16T19:39:56.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0aef55700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80c4990 con 0x7ff0a80adb20 2023-10-16T19:39:56.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0ad4f2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff0a8152aa0 0x7ff0a8152ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36612/0 (socket says 172.21.15.29:36612) 2023-10-16T19:39:56.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0ad4f2700 1 -- 172.21.15.29:0/3886157340 learned_addr learned my addr 172.21.15.29:0/3886157340 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:56.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0a7fff700 1 --2- 172.21.15.29:0/3886157340 >> v2:172.21.15.53:3300/0 conn(0x7ff0a80adb20 0x7ff0a80c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637523448 0 0) 0x7ff0a80c7d10 con 0x7ff0a8152aa0 2023-10-16T19:39:56.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0980035b0 con 0x7ff0a8152aa0 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.129+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621382711 0 0) 0x7ff0a80c73e0 con 0x7ff0a80a9ed0 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a80c7d10 con 0x7ff0a80a9ed0 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136071520 0 0) 0x7ff0980035b0 con 0x7ff0a8152aa0 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 >> v2:172.21.15.53:3300/0 conn(0x7ff0a80adb20 msgr2=0x7ff0a80c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 --2- 172.21.15.29:0/3886157340 >> v2:172.21.15.53:3300/0 conn(0x7ff0a80adb20 0x7ff0a80c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 >> v1:172.21.15.53:6789/0 conn(0x7ff0a80a9ed0 legacy=0x7ff0a814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80c76c0 con 0x7ff0a8152aa0 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7ff0a00019f0 con 0x7ff0a8152aa0 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 >> v1:172.21.15.29:6789/0 conn(0x7ff0a8152aa0 legacy=0x7ff0a8152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098003be0 0x7ff098003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff098004850 0x7ff098004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 0x7ff09800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80c4990 con 0x7ff098005260 2023-10-16T19:39:56.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09800c190 con 0x7ff098004850 2023-10-16T19:39:56.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09800c350 con 0x7ff098003be0 2023-10-16T19:39:56.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 0x7ff09800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0accf1700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098003be0 0x7ff098003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a7fff700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff098004850 0x7ff098004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 -- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098003be0 msgr2=0x7ff098003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098003be0 0x7ff098003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 -- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff098004850 msgr2=0x7ff098004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff098004850 0x7ff098004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 -- 172.21.15.29:0/3886157340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980035b0 con 0x7ff098005260 2023-10-16T19:39:56.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 -- 172.21.15.29:0/3886157340 reap_dead start 2023-10-16T19:39:56.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0ad4f2700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 0x7ff09800ba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000a710 tx=0x7ff098005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e52fd013f3e9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:56.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00072d0 con 0x7ff098005260 2023-10-16T19:39:56.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0007430 con 0x7ff098005260 2023-10-16T19:39:56.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.130+0000 7ff0a77fe700 1 -- 172.21.15.29:0/3886157340 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00077e0 con 0x7ff098005260 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 -- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 msgr2=0x7ff09800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 0x7ff09800ba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000a710 tx=0x7ff098005880 comp rx=0 tx=0).stop 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 -- 172.21.15.29:0/3886157340 shutdown_connections 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 --2- 172.21.15.29:0/3886157340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff098005260 0x7ff09800ba10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 -- 172.21.15.29:0/3886157340 >> 172.21.15.29:0/3886157340 conn(0x7ff0a806aeb0 msgr2=0x7ff0a80c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:56.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 -- 172.21.15.29:0/3886157340 shutdown_connections 2023-10-16T19:39:56.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.131+0000 7ff0aef55700 1 -- 172.21.15.29:0/3886157340 wait complete. 2023-10-16T19:39:56.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.132+0000 7ff0aef55700 1 Processor -- start 2023-10-16T19:39:56.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.132+0000 7ff0aef55700 1 -- start start 2023-10-16T19:39:56.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098005260 0x7ff0a81e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0a80c1a90 0x7ff0a80bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80c06e0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81eb500 con 0x7ff0a80c1a90 2023-10-16T19:39:56.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0aef55700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81eba30 con 0x7ff098005260 2023-10-16T19:39:56.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51178/0 (socket says 172.21.15.29:51178) 2023-10-16T19:39:56.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 -- 172.21.15.29:0/1691395009 learned_addr learned my addr 172.21.15.29:0/1691395009 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:56.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0accf1700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098005260 0x7ff0a81e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0ad4f2700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0a80c1a90 0x7ff0a80bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 -- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098005260 msgr2=0x7ff0a81e7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098005260 0x7ff0a81e7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 -- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0a80c1a90 msgr2=0x7ff0a80bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0a80c1a90 0x7ff0a80bf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.133+0000 7ff0a7fff700 1 -- 172.21.15.29:0/1691395009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80ad250 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0a7fff700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0940119d0 tx=0x7ff094011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09400f940 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09400faa0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a81e7ac0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09400fe30 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.134+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a80acc00 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.135+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80ad3e0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.135+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff094014440 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.136+0000 7ff0a57fa700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 0x7ff08c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:56.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.136+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff094089fb0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.136+0000 7ff0accf1700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 0x7ff08c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:56.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.137+0000 7ff0accf1700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 0x7ff08c06d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff09c007fd0 tx=0x7ff09c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:56.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.141+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff094054e30 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.343+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff0a80c73e0 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.751 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-16T19:39:56.749+0000 7f0f9cc7a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T19:39:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.973+0000 7ff0a57fa700 1 -- 172.21.15.29:0/1691395009 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff094058450 con 0x7ff0a81dc5f0 2023-10-16T19:39:56.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 msgr2=0x7ff08c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 0x7ff08c06d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff09c007fd0 tx=0x7ff09c009040 comp rx=0 tx=0).stop 2023-10-16T19:39:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 msgr2=0x7ff0a81dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0940119d0 tx=0x7ff094011d90 comp rx=0 tx=0).stop 2023-10-16T19:39:56.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 shutdown_connections 2023-10-16T19:39:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff08c06af00 0x7ff08c06d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0a80c1a90 0x7ff0a80bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff098005260 0x7ff0a81e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:56.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 --2- 172.21.15.29:0/1691395009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a81dc5f0 0x7ff0a81dd070 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0940119d0 tx=0x7ff094011d90 comp rx=0 tx=0).stop 2023-10-16T19:39:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 >> 172.21.15.29:0/1691395009 conn(0x7ff0a806aeb0 msgr2=0x7ff0a814f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.978+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 shutdown_connections 2023-10-16T19:39:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:56.979+0000 7ff0aef55700 1 -- 172.21.15.29:0/1691395009 wait complete. 2023-10-16T19:39:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2023-10-16T19:39:57.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-16T19:39:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.148+0000 7f7c1a618700 1 Processor -- start 2023-10-16T19:39:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 -- start start 2023-10-16T19:39:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c1414ee10 0x7f7c140c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 0x7f7c1406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c14152200 con 0x7f7c140c2880 2023-10-16T19:39:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1406c140 con 0x7f7c1414ee10 2023-10-16T19:39:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c1a618700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140c2d20 con 0x7f7c1406a880 2023-10-16T19:39:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.149+0000 7f7c13fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c1414ee10 0x7f7c140c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c1414ee10 0x7f7c140c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51182/0 (socket says 172.21.15.29:51182) 2023-10-16T19:39:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 -- 172.21.15.29:0/2892101652 learned_addr learned my addr 172.21.15.29:0/2892101652 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c18bb5700 1 --2- 172.21.15.29:0/2892101652 >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 0x7f7c1406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 -- 172.21.15.29:0/2892101652 >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 msgr2=0x7f7c1406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 --2- 172.21.15.29:0/2892101652 >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 0x7f7c1406acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 -- 172.21.15.29:0/2892101652 >> v1:172.21.15.53:6789/0 conn(0x7f7c140c2880 legacy=0x7f7c140c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 -- 172.21.15.29:0/2892101652 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14152690 con 0x7f7c1414ee10 2023-10-16T19:39:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c18bb5700 1 --2- 172.21.15.29:0/2892101652 >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 0x7f7c1406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c13fff700 1 --2- 172.21.15.29:0/2892101652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c1414ee10 0x7f7c140c2340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c14072690 tx=0x7f7c0400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a21f8b8f03e1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c12ffd700 1 -- 172.21.15.29:0/2892101652 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400dd30 con 0x7f7c1414ee10 2023-10-16T19:39:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c12ffd700 1 -- 172.21.15.29:0/2892101652 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400de90 con 0x7f7c1414ee10 2023-10-16T19:39:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.150+0000 7f7c12ffd700 1 -- 172.21.15.29:0/2892101652 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04010690 con 0x7f7c1414ee10 2023-10-16T19:39:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 -- 172.21.15.29:0/2892101652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c1414ee10 msgr2=0x7f7c140c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 --2- 172.21.15.29:0/2892101652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c1414ee10 0x7f7c140c2340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c14072690 tx=0x7f7c0400be70 comp rx=0 tx=0).stop 2023-10-16T19:39:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 -- 172.21.15.29:0/2892101652 shutdown_connections 2023-10-16T19:39:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 --2- 172.21.15.29:0/2892101652 >> v2:172.21.15.53:3300/0 conn(0x7f7c1406a880 0x7f7c1406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 --2- 172.21.15.29:0/2892101652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c1414ee10 0x7f7c140c2340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 -- 172.21.15.29:0/2892101652 >> 172.21.15.29:0/2892101652 conn(0x7f7c140c66d0 msgr2=0x7f7c140c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:57.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 -- 172.21.15.29:0/2892101652 shutdown_connections 2023-10-16T19:39:57.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.151+0000 7f7c1a618700 1 -- 172.21.15.29:0/2892101652 wait complete. 2023-10-16T19:39:57.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.152+0000 7f7c1a618700 1 Processor -- start 2023-10-16T19:39:57.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.152+0000 7f7c1a618700 1 -- start start 2023-10-16T19:39:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c1406a880 0x7f7c140c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1414ee10 0x7f7c1406dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141559a0 con 0x7f7c140c2880 2023-10-16T19:39:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14154260 con 0x7f7c1414ee10 2023-10-16T19:39:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140c0200 con 0x7f7c1406a880 2023-10-16T19:39:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51190/0 (socket says 172.21.15.29:51190) 2023-10-16T19:39:57.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 -- 172.21.15.29:0/100106956 learned_addr learned my addr 172.21.15.29:0/100106956 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:57.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c13fff700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c1406a880 0x7f7c140c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c18bb5700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1414ee10 0x7f7c1406dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 -- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c1406a880 msgr2=0x7f7c140c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c1406a880 0x7f7c140c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 -- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1414ee10 msgr2=0x7f7c1406dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1414ee10 0x7f7c1406dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 -- 172.21.15.29:0/100106956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0400b7f0 con 0x7f7c140c2880 2023-10-16T19:39:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c137fe700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800c510 tx=0x7f7c0800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080052d0 con 0x7f7c140c2880 2023-10-16T19:39:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08005430 con 0x7f7c140c2880 2023-10-16T19:39:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.153+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c140aab00 con 0x7f7c140c2880 2023-10-16T19:39:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.154+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080038c0 con 0x7f7c140c2880 2023-10-16T19:39:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.154+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140ab860 con 0x7f7c140c2880 2023-10-16T19:39:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.154+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140ab6c0 con 0x7f7c140c2880 2023-10-16T19:39:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.155+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c08003a20 con 0x7f7c140c2880 2023-10-16T19:39:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.155+0000 7f7c10ff9700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 0x7f7c0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.155+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f7c08088ba0 con 0x7f7c140c2880 2023-10-16T19:39:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.155+0000 7f7c13fff700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 0x7f7c0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.156+0000 7f7c13fff700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 0x7f7c0006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400b6f0 tx=0x7f7c04012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.160+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c140ab6c0 con 0x7f7c140c2880 2023-10-16T19:39:57.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:57.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:39:57.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:57.415+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f7c140ab6c0 con 0x7f7c140c2880 2023-10-16T19:39:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.016+0000 7f7c10ff9700 1 -- 172.21.15.29:0/100106956 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7c140ab6c0 con 0x7f7c140c2880 2023-10-16T19:39:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 msgr2=0x7f7c0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 0x7f7c0006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400b6f0 tx=0x7f7c04012000 comp rx=0 tx=0).stop 2023-10-16T19:39:58.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 msgr2=0x7f7c14153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800c510 tx=0x7f7c0800c820 comp rx=0 tx=0).stop 2023-10-16T19:39:58.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 shutdown_connections 2023-10-16T19:39:58.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7c0006af00 0x7f7c0006d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1414ee10 0x7f7c1406dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c1406a880 0x7f7c140c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 --2- 172.21.15.29:0/100106956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c140c2880 0x7f7c14153720 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 >> 172.21.15.29:0/100106956 conn(0x7f7c140c66d0 msgr2=0x7f7c140c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 shutdown_connections 2023-10-16T19:39:58.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.019+0000 7f7c1a618700 1 -- 172.21.15.29:0/100106956 wait complete. 2023-10-16T19:39:58.026 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2023-10-16T19:39:58.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:39:58.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.166+0000 7f5b07dd5700 1 Processor -- start 2023-10-16T19:39:58.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.166+0000 7f5b07dd5700 1 -- start start 2023-10-16T19:39:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b07dd5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b0006ce10 0x7f5b00072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b07dd5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b000c0f70 0x7f5b000709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b07dd5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b00152170 con 0x7f5b0014ef40 2023-10-16T19:39:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b07dd5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b00071720 con 0x7f5b0006ce10 2023-10-16T19:39:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b07dd5700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000c2100 con 0x7f5b000c0f70 2023-10-16T19:39:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b0006ce10 0x7f5b00072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05b71700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5b0014ef40 0x7f5b000c2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36640/0 (socket says 172.21.15.29:36640) 2023-10-16T19:39:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b0006ce10 0x7f5b00072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51198/0 (socket says 172.21.15.29:51198) 2023-10-16T19:39:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05b71700 1 -- 172.21.15.29:0/843725435 learned_addr learned my addr 172.21.15.29:0/843725435 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b06372700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b000c0f70 0x7f5b000709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 -- 172.21.15.29:0/843725435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b000c0f70 msgr2=0x7f5b000709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b000c0f70 0x7f5b000709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 -- 172.21.15.29:0/843725435 >> v1:172.21.15.29:6789/0 conn(0x7f5b0014ef40 legacy=0x7f5b000c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b05370700 1 -- 172.21.15.29:0/843725435 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b001526a0 con 0x7f5b0006ce10 2023-10-16T19:39:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.167+0000 7f5b04b6f700 1 -- 172.21.15.29:0/843725435 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289339284 0 0) 0x7f5b00152170 con 0x7f5b0014ef40 2023-10-16T19:39:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b05370700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0006ce10 0x7f5b00072810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af000bae0 tx=0x7f5af000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe57a2725d8eee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b04b6f700 1 -- 172.21.15.29:0/843725435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000dd30 con 0x7f5b0006ce10 2023-10-16T19:39:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b04b6f700 1 -- 172.21.15.29:0/843725435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000de90 con 0x7f5b0006ce10 2023-10-16T19:39:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b04b6f700 1 -- 172.21.15.29:0/843725435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0010690 con 0x7f5b0006ce10 2023-10-16T19:39:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 -- 172.21.15.29:0/843725435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0006ce10 msgr2=0x7f5b00072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0006ce10 0x7f5b00072810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af000bae0 tx=0x7f5af000bdf0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 -- 172.21.15.29:0/843725435 shutdown_connections 2023-10-16T19:39:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b000c0f70 0x7f5b000709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/843725435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0006ce10 0x7f5b00072810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 -- 172.21.15.29:0/843725435 >> 172.21.15.29:0/843725435 conn(0x7f5b000c65f0 msgr2=0x7f5b000c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 -- 172.21.15.29:0/843725435 shutdown_connections 2023-10-16T19:39:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.168+0000 7f5b07dd5700 1 -- 172.21.15.29:0/843725435 wait complete. 2023-10-16T19:39:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 Processor -- start 2023-10-16T19:39:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 -- start start 2023-10-16T19:39:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b0006ce10 0x7f5b001556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000bb470 0x7f5b0014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000bc700 con 0x7f5b000c0f70 2023-10-16T19:39:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000bbcf0 con 0x7f5b000bb470 2023-10-16T19:39:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b07dd5700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00155c30 con 0x7f5b0006ce10 2023-10-16T19:39:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b05370700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b05370700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51204/0 (socket says 172.21.15.29:51204) 2023-10-16T19:39:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.170+0000 7f5b05370700 1 -- 172.21.15.29:0/1291209645 learned_addr learned my addr 172.21.15.29:0/1291209645 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05b71700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b0006ce10 0x7f5b001556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 -- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b0006ce10 msgr2=0x7f5b001556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b06372700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000bb470 0x7f5b0014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b0006ce10 0x7f5b001556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 -- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000bb470 msgr2=0x7f5b0014b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000bb470 0x7f5b0014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 -- 172.21.15.29:0/1291209645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af000b740 con 0x7f5b000c0f70 2023-10-16T19:39:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b05370700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5af000be30 tx=0x7f5af0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af001d070 con 0x7f5b000c0f70 2023-10-16T19:39:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af001e040 con 0x7f5b000c0f70 2023-10-16T19:39:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b00151e70 con 0x7f5b000c0f70 2023-10-16T19:39:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00036a0 con 0x7f5b000c0f70 2023-10-16T19:39:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.171+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00153cc0 con 0x7f5b000c0f70 2023-10-16T19:39:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.172+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0004f400 con 0x7f5b000c0f70 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.172+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5af0003800 con 0x7f5b000c0f70 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.173+0000 7f5af67fc700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 0x7f5ae406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.173+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5af008da90 con 0x7f5b000c0f70 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.173+0000 7f5b05b71700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 0x7f5ae406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.173+0000 7f5b05b71700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 0x7f5ae406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000f60 tx=0x7f5afc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.177+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5af0058a00 con 0x7f5b000c0f70 2023-10-16T19:39:58.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.424+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b000c06d0 con 0x7f5b000c0f70 2023-10-16T19:39:58.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.425+0000 7f5af67fc700 1 -- 172.21.15.29:0/1291209645 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4900 (secure 0 0 0) 0x7f5af005c020 con 0x7f5b000c0f70 2023-10-16T19:39:58.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:58.428 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:39:57.416603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T19:39:58.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 msgr2=0x7f5ae406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 0x7f5ae406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000f60 tx=0x7f5afc009040 comp rx=0 tx=0).stop 2023-10-16T19:39:58.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 msgr2=0x7f5b000c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5af000be30 tx=0x7f5af0004750 comp rx=0 tx=0).stop 2023-10-16T19:39:58.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 shutdown_connections 2023-10-16T19:39:58.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5ae406af00 0x7f5ae406d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000bb470 0x7f5b0014b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5b0006ce10 0x7f5b001556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 --2- 172.21.15.29:0/1291209645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b000c0f70 0x7f5b000c2800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 >> 172.21.15.29:0/1291209645 conn(0x7f5b000c65f0 msgr2=0x7f5b0014e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 shutdown_connections 2023-10-16T19:39:58.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.427+0000 7f5b07dd5700 1 -- 172.21.15.29:0/1291209645 wait complete. 2023-10-16T19:39:58.432 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-16T19:39:58.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:58.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.563+0000 7f9180149700 1 Processor -- start 2023-10-16T19:39:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.563+0000 7f9180149700 1 -- start start 2023-10-16T19:39:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f9180149700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 0x7f917806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f9180149700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f917806adc0 0x7f9178158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f9180149700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806e780 con 0x7f9178154a50 2023-10-16T19:39:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f9180149700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917806d320 con 0x7f917806adc0 2023-10-16T19:39:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f9180149700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9178154f10 con 0x7f917813d660 2023-10-16T19:39:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f917e6e6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f917806adc0 0x7f9178158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f917d6e4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9178154a50 0x7f91781583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36656/0 (socket says 172.21.15.29:36656) 2023-10-16T19:39:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f917e6e6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f917806adc0 0x7f9178158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51214/0 (socket says 172.21.15.29:51214) 2023-10-16T19:39:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.564+0000 7f917d6e4700 1 -- 172.21.15.29:0/3920512660 learned_addr learned my addr 172.21.15.29:0/3920512660 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917dee5700 1 --2- 172.21.15.29:0/3920512660 >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 0x7f917806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917e6e6700 1 -- 172.21.15.29:0/3920512660 >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 msgr2=0x7f917806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917e6e6700 1 --2- 172.21.15.29:0/3920512660 >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 0x7f917806a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917e6e6700 1 -- 172.21.15.29:0/3920512660 >> v1:172.21.15.29:6789/0 conn(0x7f9178154a50 legacy=0x7f91781583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917cee3700 1 -- 172.21.15.29:0/3920512660 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970631981 0 0) 0x7f917806e780 con 0x7f9178154a50 2023-10-16T19:39:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917e6e6700 1 -- 172.21.15.29:0/3920512660 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91781551f0 con 0x7f917806adc0 2023-10-16T19:39:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917dee5700 1 --2- 172.21.15.29:0/3920512660 >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 0x7f917806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917e6e6700 1 --2- 172.21.15.29:0/3920512660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f9178158ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91780c15e0 tx=0x7f917000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbed04be3bf3fa96 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917cee3700 1 -- 172.21.15.29:0/3920512660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000e070 con 0x7f917806adc0 2023-10-16T19:39:58.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917cee3700 1 -- 172.21.15.29:0/3920512660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000bbd0 con 0x7f917806adc0 2023-10-16T19:39:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.565+0000 7f917cee3700 1 -- 172.21.15.29:0/3920512660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012430 con 0x7f917806adc0 2023-10-16T19:39:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 -- 172.21.15.29:0/3920512660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 msgr2=0x7f9178158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 --2- 172.21.15.29:0/3920512660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f9178158ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91780c15e0 tx=0x7f917000b330 comp rx=0 tx=0).stop 2023-10-16T19:39:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 -- 172.21.15.29:0/3920512660 shutdown_connections 2023-10-16T19:39:58.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 --2- 172.21.15.29:0/3920512660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f9178158ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 --2- 172.21.15.29:0/3920512660 >> v2:172.21.15.53:3300/0 conn(0x7f917813d660 0x7f917806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 -- 172.21.15.29:0/3920512660 >> 172.21.15.29:0/3920512660 conn(0x7f91780c7110 msgr2=0x7f91780c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 -- 172.21.15.29:0/3920512660 shutdown_connections 2023-10-16T19:39:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.566+0000 7f9180149700 1 -- 172.21.15.29:0/3920512660 wait complete. 2023-10-16T19:39:58.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.567+0000 7f9180149700 1 Processor -- start 2023-10-16T19:39:58.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.567+0000 7f9180149700 1 -- start start 2023-10-16T19:39:58.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 0x7f9178151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 0x7f9178151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178136150 con 0x7f917806adc0 2023-10-16T19:39:58.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781ed750 con 0x7f9178154a50 2023-10-16T19:39:58.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91781eda30 con 0x7f917813d660 2023-10-16T19:39:58.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51216/0 (socket says 172.21.15.29:51216) 2023-10-16T19:39:58.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 -- 172.21.15.29:0/2959800278 learned_addr learned my addr 172.21.15.29:0/2959800278 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:58.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917e6e6700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 0x7f9178151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917d6e4700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 0x7f9178151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 -- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 msgr2=0x7f9178151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 0x7f9178151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 -- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 msgr2=0x7f9178151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 0x7f9178151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 -- 172.21.15.29:0/2959800278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009a70 con 0x7f917806adc0 2023-10-16T19:39:58.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917d6e4700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 0x7f9178151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:58.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917e6e6700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 0x7f9178151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:58.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f917dee5700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f917400e810 tx=0x7f917400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174004230 con 0x7f917806adc0 2023-10-16T19:39:58.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174004390 con 0x7f917806adc0 2023-10-16T19:39:58.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91781edd10 con 0x7f917806adc0 2023-10-16T19:39:58.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740036a0 con 0x7f917806adc0 2023-10-16T19:39:58.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.568+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91781ee2d0 con 0x7f917806adc0 2023-10-16T19:39:58.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.569+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91780c3780 con 0x7f917806adc0 2023-10-16T19:39:58.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.570+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9174003800 con 0x7f917806adc0 2023-10-16T19:39:58.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.570+0000 7f916a7fc700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 0x7f915c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.570+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9174089310 con 0x7f917806adc0 2023-10-16T19:39:58.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.570+0000 7f917d6e4700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 0x7f915c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.571+0000 7f917d6e4700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 0x7f915c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f916c000f60 tx=0x7f916c007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.574+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9174054160 con 0x7f917806adc0 2023-10-16T19:39:58.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.780+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f917804f400 con 0x7f917806adc0 2023-10-16T19:39:58.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.781+0000 7f916a7fc700 1 -- 172.21.15.29:0/2959800278 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f9174057780 con 0x7f917806adc0 2023-10-16T19:39:58.784 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:58.784 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 msgr2=0x7f915c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 0x7f915c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f916c000f60 tx=0x7f916c007d30 comp rx=0 tx=0).stop 2023-10-16T19:39:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 msgr2=0x7f91781347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f917400e810 tx=0x7f917400ebd0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 shutdown_connections 2023-10-16T19:39:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f915c06af00 0x7f915c06d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178154a50 0x7f9178151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806adc0 0x7f91781347b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 --2- 172.21.15.29:0/2959800278 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f917813d660 0x7f9178151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 >> 172.21.15.29:0/2959800278 conn(0x7f91780c7110 msgr2=0x7f91780c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 shutdown_connections 2023-10-16T19:39:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.784+0000 7f9180149700 1 -- 172.21.15.29:0/2959800278 wait complete. 2023-10-16T19:39:58.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:58.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.920+0000 7fa97fb41700 1 Processor -- start 2023-10-16T19:39:58.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.920+0000 7fa97fb41700 1 -- start start 2023-10-16T19:39:58.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97fb41700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9780c3350 0x7fa9781555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97fb41700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa97806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97fb41700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa978155af0 con 0x7fa97814ec50 2023-10-16T19:39:58.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97fb41700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa978152300 con 0x7fa9780c3350 2023-10-16T19:39:58.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97fb41700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c2e40 con 0x7fa97806db00 2023-10-16T19:39:58.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97d8dd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa97814ec50 0x7fa978071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36668/0 (socket says 172.21.15.29:36668) 2023-10-16T19:39:58.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97d8dd700 1 -- 172.21.15.29:0/2601028870 learned_addr learned my addr 172.21.15.29:0/2601028870 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:39:58.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97e0de700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa97806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97d0dc700 1 --2- 172.21.15.29:0/2601028870 >> v2:172.21.15.53:3300/0 conn(0x7fa9780c3350 0x7fa9781555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656343607 0 0) 0x7fa974001110 con 0x7fa97814ec50 2023-10-16T19:39:58.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.921+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9640035b0 con 0x7fa97814ec50 2023-10-16T19:39:58.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4169575742 0 0) 0x7fa9640035b0 con 0x7fa97814ec50 2023-10-16T19:39:58.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 msgr2=0x7fa97806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa97806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 >> v2:172.21.15.53:3300/0 conn(0x7fa9780c3350 msgr2=0x7fa9781555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 --2- 172.21.15.29:0/2601028870 >> v2:172.21.15.53:3300/0 conn(0x7fa9780c3350 0x7fa9781555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97814f030 con 0x7fa97814ec50 2023-10-16T19:39:58.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fa974001800 con 0x7fa97814ec50 2023-10-16T19:39:58.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 >> v1:172.21.15.29:6789/0 conn(0x7fa97814ec50 legacy=0x7fa978071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa964003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964003f80 0x7fa964004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa964004d90 0x7fa964005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978152300 con 0x7fa964004d90 2023-10-16T19:39:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c2e40 con 0x7fa964003f80 2023-10-16T19:39:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96400ba60 con 0x7fa97806db00 2023-10-16T19:39:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa964004d90 0x7fa964005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97d8dd700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa964003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97d0dc700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964003f80 0x7fa964004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 -- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 msgr2=0x7fa964003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa97806db00 0x7fa964003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 -- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964003f80 msgr2=0x7fa964004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:58.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964003f80 0x7fa964004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 -- 172.21.15.29:0/2601028870 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640035b0 con 0x7fa964004d90 2023-10-16T19:39:58.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.922+0000 7fa97e0de700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa964004d90 0x7fa964005210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e170 tx=0x7fa964005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d694966013702c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000ec90 con 0x7fa964004d90 2023-10-16T19:39:58.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000f040 con 0x7fa964004d90 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97c8db700 1 -- 172.21.15.29:0/2601028870 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970014480 con 0x7fa964004d90 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 -- 172.21.15.29:0/2601028870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa964004d90 msgr2=0x7fa964005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 --2- 172.21.15.29:0/2601028870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa964004d90 0x7fa964005210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e170 tx=0x7fa964005880 comp rx=0 tx=0).stop 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97e0de700 1 -- 172.21.15.29:0/2601028870 reap_dead start 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 -- 172.21.15.29:0/2601028870 shutdown_connections 2023-10-16T19:39:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 -- 172.21.15.29:0/2601028870 >> 172.21.15.29:0/2601028870 conn(0x7fa9780c7110 msgr2=0x7fa9780c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 -- 172.21.15.29:0/2601028870 shutdown_connections 2023-10-16T19:39:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.923+0000 7fa97fb41700 1 -- 172.21.15.29:0/2601028870 wait complete. 2023-10-16T19:39:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.924+0000 7fa97fb41700 1 Processor -- start 2023-10-16T19:39:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.924+0000 7fa97fb41700 1 -- start start 2023-10-16T19:39:58.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964004d90 0x7fa9781ea650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa978152c60 0x7fa9780c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978150d70 con 0x7fa978144810 2023-10-16T19:39:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978145200 con 0x7fa964004d90 2023-10-16T19:39:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97fb41700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781dd380 con 0x7fa978152c60 2023-10-16T19:39:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51240/0 (socket says 172.21.15.29:51240) 2023-10-16T19:39:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 -- 172.21.15.29:0/1715581684 learned_addr learned my addr 172.21.15.29:0/1715581684 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97d0dc700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa978152c60 0x7fa9780c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97d8dd700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964004d90 0x7fa9781ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 -- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa978152c60 msgr2=0x7fa9780c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa978152c60 0x7fa9780c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 -- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964004d90 msgr2=0x7fa9781ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964004d90 0x7fa9781ea650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.925+0000 7fa97e0de700 1 -- 172.21.15.29:0/1715581684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9781eab90 con 0x7fa978144810 2023-10-16T19:39:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa97e0de700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e760 tx=0x7fa970009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970007000 con 0x7fa978144810 2023-10-16T19:39:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970014890 con 0x7fa978144810 2023-10-16T19:39:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978154af0 con 0x7fa978144810 2023-10-16T19:39:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970014c40 con 0x7fa978144810 2023-10-16T19:39:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.926+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97814fab0 con 0x7fa978144810 2023-10-16T19:39:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.927+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97804f400 con 0x7fa978144810 2023-10-16T19:39:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.927+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa970023070 con 0x7fa978144810 2023-10-16T19:39:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.928+0000 7fa96a7fc700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 0x7fa95c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.928+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa97008b190 con 0x7fa978144810 2023-10-16T19:39:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.928+0000 7fa97d8dd700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 0x7fa95c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.928+0000 7fa97d8dd700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 0x7fa95c06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa974001eb0 tx=0x7fa974007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:58.932+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa970055ec0 con 0x7fa978144810 2023-10-16T19:39:59.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.135+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9781dd4c0 con 0x7fa978144810 2023-10-16T19:39:59.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.136+0000 7fa96a7fc700 1 -- 172.21.15.29:0/1715581684 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fa9700594e0 con 0x7fa978144810 2023-10-16T19:39:59.139 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:59.139 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 msgr2=0x7fa95c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 0x7fa95c06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa974001eb0 tx=0x7fa974007b00 comp rx=0 tx=0).stop 2023-10-16T19:39:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 msgr2=0x7fa978144cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e760 tx=0x7fa970009750 comp rx=0 tx=0).stop 2023-10-16T19:39:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 shutdown_connections 2023-10-16T19:39:59.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa95c06af00 0x7fa95c06d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa978144810 0x7fa978144cc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa964004d90 0x7fa9781ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 --2- 172.21.15.29:0/1715581684 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa978152c60 0x7fa9780c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 >> 172.21.15.29:0/1715581684 conn(0x7fa9780c7110 msgr2=0x7fa97806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:59.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 shutdown_connections 2023-10-16T19:39:59.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.138+0000 7fa97fb41700 1 -- 172.21.15.29:0/1715581684 wait complete. 2023-10-16T19:39:59.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:39:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.289+0000 7fa3af165700 1 Processor -- start 2023-10-16T19:39:59.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.289+0000 7fa3af165700 1 -- start start 2023-10-16T19:39:59.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3af165700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a813d660 0x7fa3a806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3af165700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 0x7fa3a81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3af165700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a806e780 con 0x7fa3a806adc0 2023-10-16T19:39:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3af165700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a806d320 con 0x7fa3a813d660 2023-10-16T19:39:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3af165700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8154f10 con 0x7fa3a8154a50 2023-10-16T19:39:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3acf01700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a813d660 0x7fa3a806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3acf01700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a813d660 0x7fa3a806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51244/0 (socket says 172.21.15.29:51244) 2023-10-16T19:39:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3acf01700 1 -- 172.21.15.29:0/2280507541 learned_addr learned my addr 172.21.15.29:0/2280507541 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.290+0000 7fa3a7fff700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 0x7fa3a81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3acf01700 1 -- 172.21.15.29:0/2280507541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 msgr2=0x7fa3a81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3acf01700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 0x7fa3a81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3acf01700 1 -- 172.21.15.29:0/2280507541 >> v1:172.21.15.53:6789/0 conn(0x7fa3a806adc0 legacy=0x7fa3a8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3acf01700 1 -- 172.21.15.29:0/2280507541 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a81551f0 con 0x7fa3a813d660 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3a7fff700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 0x7fa3a81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3acf01700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a813d660 0x7fa3a806a880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0098f0 tx=0x7fa39c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7122f8ab195d1eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3a77fe700 1 -- 172.21.15.29:0/2280507541 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c004230 con 0x7fa3a813d660 2023-10-16T19:39:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3a77fe700 1 -- 172.21.15.29:0/2280507541 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c004390 con 0x7fa3a813d660 2023-10-16T19:39:59.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3a77fe700 1 -- 172.21.15.29:0/2280507541 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0036a0 con 0x7fa3a813d660 2023-10-16T19:39:59.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 -- 172.21.15.29:0/2280507541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a813d660 msgr2=0x7fa3a806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a813d660 0x7fa3a806a880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0098f0 tx=0x7fa39c009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:59.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 -- 172.21.15.29:0/2280507541 shutdown_connections 2023-10-16T19:39:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a813d660 0x7fa3a806a880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 --2- 172.21.15.29:0/2280507541 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a8154a50 0x7fa3a81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 -- 172.21.15.29:0/2280507541 >> 172.21.15.29:0/2280507541 conn(0x7fa3a80c7110 msgr2=0x7fa3a80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 -- 172.21.15.29:0/2280507541 shutdown_connections 2023-10-16T19:39:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.291+0000 7fa3af165700 1 -- 172.21.15.29:0/2280507541 wait complete. 2023-10-16T19:39:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 Processor -- start 2023-10-16T19:39:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 -- start start 2023-10-16T19:39:59.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a806adc0 0x7fa3a8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a813d660 0x7fa3a80a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.293+0000 7fa3af165700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80aaea0 con 0x7fa3a8154a50 2023-10-16T19:39:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3af165700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8157480 con 0x7fa3a813d660 2023-10-16T19:39:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3af165700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ab420 con 0x7fa3a806adc0 2023-10-16T19:39:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3acf01700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a806adc0 0x7fa3a8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a813d660 0x7fa3a80a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51254/0 (socket says 172.21.15.29:51254) 2023-10-16T19:39:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 -- 172.21.15.29:0/2187624380 learned_addr learned my addr 172.21.15.29:0/2187624380 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:59.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 -- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a806adc0 msgr2=0x7fa3a8157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a806adc0 0x7fa3a8157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 -- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a813d660 msgr2=0x7fa3a80a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a813d660 0x7fa3a80a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 -- 172.21.15.29:0/2187624380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009550 con 0x7fa3a8154a50 2023-10-16T19:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3ad702700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000cc40 tx=0x7fa3a000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0004c40 con 0x7fa3a8154a50 2023-10-16T19:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0004da0 con 0x7fa3a8154a50 2023-10-16T19:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a8139990 con 0x7fa3a8154a50 2023-10-16T19:39:59.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000aa60 con 0x7fa3a8154a50 2023-10-16T19:39:59.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.294+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a80ab0b0 con 0x7fa3a8154a50 2023-10-16T19:39:59.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.295+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80a8990 con 0x7fa3a8154a50 2023-10-16T19:39:59.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.296+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3a000abc0 con 0x7fa3a8154a50 2023-10-16T19:39:59.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.296+0000 7fa3a57fa700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 0x7fa38c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.296+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3a0089e70 con 0x7fa3a8154a50 2023-10-16T19:39:59.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.297+0000 7fa3acf01700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 0x7fa38c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.297+0000 7fa3acf01700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 0x7fa38c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009130 tx=0x7fa39c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.301+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3a0054c20 con 0x7fa3a8154a50 2023-10-16T19:39:59.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.543+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a80c3760 con 0x7fa3a8154a50 2023-10-16T19:39:59.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.544+0000 7fa3a57fa700 1 -- 172.21.15.29:0/2187624380 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fa3a0058240 con 0x7fa3a8154a50 2023-10-16T19:39:59.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:59.547 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:39:57.416603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T19:39:59.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 msgr2=0x7fa38c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 0x7fa38c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009130 tx=0x7fa39c008030 comp rx=0 tx=0).stop 2023-10-16T19:39:59.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 msgr2=0x7fa3a8136730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000cc40 tx=0x7fa3a000cf50 comp rx=0 tx=0).stop 2023-10-16T19:39:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 shutdown_connections 2023-10-16T19:39:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa38c06af00 0x7fa38c06d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8154a50 0x7fa3a8136730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa3a806adc0 0x7fa3a8157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 --2- 172.21.15.29:0/2187624380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a813d660 0x7fa3a80a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 >> 172.21.15.29:0/2187624380 conn(0x7fa3a80c7110 msgr2=0x7fa3a806e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:59.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 shutdown_connections 2023-10-16T19:39:59.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.546+0000 7fa3af165700 1 -- 172.21.15.29:0/2187624380 wait complete. 2023-10-16T19:39:59.551 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-16T19:39:59.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:39:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.683+0000 7f6bfc14c700 1 Processor -- start 2023-10-16T19:39:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.683+0000 7f6bfc14c700 1 -- start start 2023-10-16T19:39:59.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bfc14c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bf414c780 0x7f6bf40ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bfc14c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf4156c60 con 0x7f6bf4153290 2023-10-16T19:39:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bfc14c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf41536f0 con 0x7f6bf406a880 2023-10-16T19:39:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bfc14c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf40ac7d0 con 0x7f6bf414c780 2023-10-16T19:39:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bf9ee8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bf414c780 0x7f6bf40ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bf9ee8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bf414c780 0x7f6bf40ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51258/0 (socket says 172.21.15.29:51258) 2023-10-16T19:39:59.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bf96e7700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6bf4153290 0x7f6bf406d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36702/0 (socket says 172.21.15.29:36702) 2023-10-16T19:39:59.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.684+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/1460162720 learned_addr learned my addr 172.21.15.29:0/1460162720 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:59.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/1460162720 >> v1:172.21.15.53:6789/0 conn(0x7f6bf406a880 legacy=0x7f6bf406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:39:59.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/1460162720 >> v1:172.21.15.29:6789/0 conn(0x7f6bf4153290 legacy=0x7f6bf406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/1460162720 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4155ea0 con 0x7f6bf414c780 2023-10-16T19:39:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf9ee8700 1 --2- 172.21.15.29:0/1460162720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf414c780 0x7f6bf40ac0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6be40098f0 tx=0x7f6be4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85672292d6834a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf8ee6700 1 -- 172.21.15.29:0/1460162720 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4004230 con 0x7f6bf414c780 2023-10-16T19:39:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf8ee6700 1 -- 172.21.15.29:0/1460162720 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4004390 con 0x7f6bf414c780 2023-10-16T19:39:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bf8ee6700 1 -- 172.21.15.29:0/1460162720 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40036a0 con 0x7f6bf414c780 2023-10-16T19:39:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 -- 172.21.15.29:0/1460162720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf414c780 msgr2=0x7f6bf40ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/1460162720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf414c780 0x7f6bf40ac0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6be40098f0 tx=0x7f6be4009c00 comp rx=0 tx=0).stop 2023-10-16T19:39:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 -- 172.21.15.29:0/1460162720 shutdown_connections 2023-10-16T19:39:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/1460162720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf414c780 0x7f6bf40ac0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 -- 172.21.15.29:0/1460162720 >> 172.21.15.29:0/1460162720 conn(0x7f6bf40c66d0 msgr2=0x7f6bf40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:59.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.685+0000 7f6bfc14c700 1 -- 172.21.15.29:0/1460162720 shutdown_connections 2023-10-16T19:39:59.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.686+0000 7f6bfc14c700 1 -- 172.21.15.29:0/1460162720 wait complete. 2023-10-16T19:39:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 Processor -- start 2023-10-16T19:39:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 -- start start 2023-10-16T19:39:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 0x7f6bf4146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 0x7f6bf4143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4144e30 con 0x7f6bf406a880 2023-10-16T19:39:59.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4145360 con 0x7f6bf414c780 2023-10-16T19:39:59.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bfc14c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4145080 con 0x7f6bf4153290 2023-10-16T19:39:59.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bf9ee8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bf9ee8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51262/0 (socket says 172.21.15.29:51262) 2023-10-16T19:39:59.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.687+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/4132406172 learned_addr learned my addr 172.21.15.29:0/4132406172 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:39:59.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf96e7700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 0x7f6bf4146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bfa6e9700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 0x7f6bf4143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 msgr2=0x7f6bf4143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 0x7f6bf4143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 msgr2=0x7f6bf4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 0x7f6bf4146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 -- 172.21.15.29:0/4132406172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009550 con 0x7f6bf406a880 2023-10-16T19:39:59.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf96e7700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 0x7f6bf4146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:59.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bfa6e9700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 0x7f6bf4143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:39:59.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bf9ee8700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c7510 tx=0x7f6be4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003dc0 con 0x7f6bf406a880 2023-10-16T19:39:59.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be401f070 con 0x7f6bf406a880 2023-10-16T19:39:59.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400b8a0 con 0x7f6bf406a880 2023-10-16T19:39:59.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf4149e10 con 0x7f6bf406a880 2023-10-16T19:39:59.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.688+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf414a3d0 con 0x7f6bf406a880 2023-10-16T19:39:59.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.689+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf40aa5e0 con 0x7f6bf406a880 2023-10-16T19:39:59.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.689+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6be4021030 con 0x7f6bf406a880 2023-10-16T19:39:59.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.690+0000 7f6bea7fc700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 0x7f6bd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:39:59.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.690+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6be408af40 con 0x7f6bf406a880 2023-10-16T19:39:59.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.690+0000 7f6bf96e7700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 0x7f6bd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:39:59.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.691+0000 7f6bf96e7700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 0x7f6bd806d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4145720 tx=0x7f6bf0007df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:39:59.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.694+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6be4055d90 con 0x7f6bf406a880 2023-10-16T19:39:59.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.893+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bf40aa5e0 con 0x7f6bf406a880 2023-10-16T19:39:59.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.894+0000 7f6bea7fc700 1 -- 172.21.15.29:0/4132406172 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f6be40593b0 con 0x7f6bf406a880 2023-10-16T19:39:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:39:59.899 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:39:59.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 msgr2=0x7f6bd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 0x7f6bd806d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4145720 tx=0x7f6bf0007df0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 msgr2=0x7f6bf4145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:39:59.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c7510 tx=0x7f6be4004750 comp rx=0 tx=0).stop 2023-10-16T19:39:59.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 shutdown_connections 2023-10-16T19:39:59.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6bd806af00 0x7f6bd806d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6bf4153290 0x7f6bf4143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf406a880 0x7f6bf4145ef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 --2- 172.21.15.29:0/4132406172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bf414c780 0x7f6bf4146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:39:59.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 >> 172.21.15.29:0/4132406172 conn(0x7f6bf40c66d0 msgr2=0x7f6bf40aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:39:59.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 shutdown_connections 2023-10-16T19:39:59.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:39:59.897+0000 7f6bfc14c700 1 -- 172.21.15.29:0/4132406172 wait complete. 2023-10-16T19:40:00.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:39:52.363895+0000', 'modified': '2023-10-16T19:39:57.416603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/1712057273', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 1712057273}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1712057273}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-16T19:40:00.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T19:40:00.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-16T19:40:00.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.446+0000 7f5bec57d700 1 Processor -- start 2023-10-16T19:40:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.446+0000 7f5bec57d700 1 -- start start 2023-10-16T19:40:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bec57d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5be414ec50 0x7f5be41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bec57d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 0x7f5be406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bec57d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be4155af0 con 0x7f5be40c3350 2023-10-16T19:40:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bec57d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be4152300 con 0x7f5be414ec50 2023-10-16T19:40:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bec57d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c2e40 con 0x7f5be406db00 2023-10-16T19:40:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bea319700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5be414ec50 0x7f5be41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bea319700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5be414ec50 0x7f5be41555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51270/0 (socket says 172.21.15.29:51270) 2023-10-16T19:40:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5bea319700 1 -- 172.21.15.29:0/223050531 learned_addr learned my addr 172.21.15.29:0/223050531 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.447+0000 7f5beab1a700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 0x7f5be406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bea319700 1 -- 172.21.15.29:0/223050531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 msgr2=0x7f5be406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bea319700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 0x7f5be406dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bea319700 1 -- 172.21.15.29:0/223050531 >> v1:172.21.15.53:6789/0 conn(0x7f5be40c3350 legacy=0x7f5be4071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bea319700 1 -- 172.21.15.29:0/223050531 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be414f030 con 0x7f5be414ec50 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5beab1a700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 0x7f5be406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bea319700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be41555b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400bb90 tx=0x7f5bd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6304e0681e3fc3e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5be9317700 1 -- 172.21.15.29:0/223050531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400dd50 con 0x7f5be414ec50 2023-10-16T19:40:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5be9317700 1 -- 172.21.15.29:0/223050531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4010470 con 0x7f5be414ec50 2023-10-16T19:40:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5be9317700 1 -- 172.21.15.29:0/223050531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4010800 con 0x7f5be414ec50 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bec57d700 1 -- 172.21.15.29:0/223050531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 msgr2=0x7f5be41555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.448+0000 7f5bec57d700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be41555b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400bb90 tx=0x7f5bd400bea0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 -- 172.21.15.29:0/223050531 shutdown_connections 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be406db00 0x7f5be406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 --2- 172.21.15.29:0/223050531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be41555b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 -- 172.21.15.29:0/223050531 >> 172.21.15.29:0/223050531 conn(0x7f5be40c7110 msgr2=0x7f5be40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 -- 172.21.15.29:0/223050531 shutdown_connections 2023-10-16T19:40:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.449+0000 7f5bec57d700 1 -- 172.21.15.29:0/223050531 wait complete. 2023-10-16T19:40:00.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.450+0000 7f5bec57d700 1 Processor -- start 2023-10-16T19:40:00.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.450+0000 7f5bec57d700 1 -- start start 2023-10-16T19:40:00.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.450+0000 7f5bec57d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 0x7f5be4153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.450+0000 7f5bec57d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be40c3350 0x7f5be4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.450+0000 7f5bec57d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bec57d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41e9d30 con 0x7f5be414ec50 2023-10-16T19:40:00.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bec57d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41ea260 con 0x7f5be406db00 2023-10-16T19:40:00.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bec57d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c68c0 con 0x7f5be40c3350 2023-10-16T19:40:00.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51280/0 (socket says 172.21.15.29:51280) 2023-10-16T19:40:00.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 -- 172.21.15.29:0/1441863856 learned_addr learned my addr 172.21.15.29:0/1441863856 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bea319700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 0x7f5be4153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5be9b18700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be40c3350 0x7f5be4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 -- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be40c3350 msgr2=0x7f5be4152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be40c3350 0x7f5be4152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 -- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 msgr2=0x7f5be4153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 0x7f5be4153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 -- 172.21.15.29:0/1441863856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd400b7f0 con 0x7f5be414ec50 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bea319700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 0x7f5be4153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5beab1a700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007e70 tx=0x7f5bdc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bdaffd700 1 -- 172.21.15.29:0/1441863856 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ddd0 con 0x7f5be414ec50 2023-10-16T19:40:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bdaffd700 1 -- 172.21.15.29:0/1441863856 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00f040 con 0x7f5be414ec50 2023-10-16T19:40:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be41e9fe0 con 0x7f5be414ec50 2023-10-16T19:40:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bdaffd700 1 -- 172.21.15.29:0/1441863856 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc003cb0 con 0x7f5be414ec50 2023-10-16T19:40:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.451+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40c6220 con 0x7f5be414ec50 2023-10-16T19:40:00.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.453+0000 7f5bdaffd700 1 -- 172.21.15.29:0/1441863856 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5bdc004030 con 0x7f5be414ec50 2023-10-16T19:40:00.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.453+0000 7f5bdaffd700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 0x7f5bc806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.453+0000 7f5bdaffd700 1 -- 172.21.15.29:0/1441863856 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bdc089870 con 0x7f5be414ec50 2023-10-16T19:40:00.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.453+0000 7f5bea319700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 0x7f5bc806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.454+0000 7f5bea319700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 0x7f5bc806d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400b340 tx=0x7f5bd4013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.455+0000 7f5bf8767b80 1 Processor -- start 2023-10-16T19:40:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 -- start start 2023-10-16T19:40:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfbeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bef4c20 con 0x56005bf7ac90 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bed9c10 con 0x56005bf806b0 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.456+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x56005bed7530 con 0x56005bf80a90 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51288/0 (socket says 172.21.15.29:51288) 2023-10-16T19:40:00.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 -- 172.21.15.29:0/3146776117 learned_addr learned my addr 172.21.15.29:0/3146776117 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfbeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5bea319700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 -- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 msgr2=0x56005bfbeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfbeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 -- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 msgr2=0x56005bfbe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 -- 172.21.15.29:0/3146776117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005be903a0 con 0x56005bf7ac90 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5bea319700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfbeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5beab1a700 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00dfd0 tx=0x7f5bdc057db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3720f5b5cd4467d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5bc7fff700 1 -- 172.21.15.29:0/3146776117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc060680 con 0x56005bf7ac90 2023-10-16T19:40:00.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5bc7fff700 1 -- 172.21.15.29:0/3146776117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0564c0 con 0x56005bf7ac90 2023-10-16T19:40:00.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.457+0000 7f5bc7fff700 1 -- 172.21.15.29:0/3146776117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc05c160 con 0x56005bf7ac90 2023-10-16T19:40:00.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3146776117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 msgr2=0x56005bf9e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00dfd0 tx=0x7f5bdc057db0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3146776117 shutdown_connections 2023-10-16T19:40:00.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bf9e8a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3146776117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfbeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3146776117 >> 172.21.15.29:0/3146776117 conn(0x56005beadd80 msgr2=0x56005bf7e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3146776117 shutdown_connections 2023-10-16T19:40:00.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3146776117 wait complete. 2023-10-16T19:40:00.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.458+0000 7f5bf8767b80 1 -- start start 2023-10-16T19:40:00.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 Processor -- start 2023-10-16T19:40:00.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfa4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bed2e20 con 0x56005bf7ac90 2023-10-16T19:40:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005be6f6c0 con 0x56005bf806b0 2023-10-16T19:40:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.459+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x56005be6f360 con 0x56005bf80a90 2023-10-16T19:40:00.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bf8767b80 10 client.0 _ll_register_callbacks cb 0x56005bccc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:40:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51290/0 (socket says 172.21.15.29:51290) 2023-10-16T19:40:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 -- 172.21.15.29:0/2540357332 learned_addr learned my addr 172.21.15.29:0/2540357332 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5beab1a700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfa4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5be9b18700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 -- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 msgr2=0x56005bfa4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfa4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 -- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 msgr2=0x56005bfbc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 -- 172.21.15.29:0/2540357332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40c6220 con 0x56005bf7ac90 2023-10-16T19:40:00.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5beab1a700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfa4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:00.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bea319700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5be4072170 tx=0x7f5bd40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4375d61ecccea60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:40:00.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4020070 con 0x56005bf7ac90 2023-10-16T19:40:00.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bd4003930 con 0x56005bf7ac90 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005bf735b0 con 0x56005bf7ac90 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bd4003af0 con 0x56005bf7ac90 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bf8767b80 10 client.4410 fetch_fsmap learned FSMap version 7 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56005bcfdd90 con 0x56005bf7ac90 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.460+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56005bf735b0 con 0x56005bf7ac90 2023-10-16T19:40:00.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5bd4003c50 con 0x56005bf7ac90 2023-10-16T19:40:00.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T19:40:00.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 10 client.4410 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:40:00.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 20 client.4410 populate_metadata read hostname 'smithi029' 2023-10-16T19:40:00.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfa5740 0x56005bfcbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 4 client.4410 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:40:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 --> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56005becbe00 con 0x56005bfa5740 2023-10-16T19:40:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5be9b18700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfa5740 0x56005bfcbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5bc57fa700 10 client.4410 ms_handle_connect on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.461+0000 7f5be9b18700 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfa5740 0x56005bfcbe30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91db7bc579f2be server_cookie=aedd3570be4cc493 in_seq=0 out_seq=0 2023-10-16T19:40:00.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bc57fa700 1 -- 172.21.15.29:0/2540357332 <== mds.0 v2:172.21.15.29:6833/1712057273 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56005becbe00 con 0x56005bfa5740 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bc57fa700 10 client.4410 handle_command_reply: tid=0 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 client.4410 shutdown 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 msgr2=0x56005bfa33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5be4072170 tx=0x7f5bd40047c0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 shutdown_connections 2023-10-16T19:40:00.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf80a90 0x56005bfa4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfa5740 0x56005bfcbe30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005bfa33c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bc57fa700 0 client.4410 ms_handle_reset on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/2540357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf806b0 0x56005bfbc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 >> 172.21.15.29:0/2540357332 conn(0x56005beadd80 msgr2=0x56005bf757d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 shutdown_connections 2023-10-16T19:40:00.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 1 -- 172.21.15.29:0/2540357332 wait complete. 2023-10-16T19:40:00.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.462+0000 7f5bf8767b80 20 client.4410 trim_cache size 0 max 16384 2023-10-16T19:40:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.480+0000 7f5bf8767b80 1 Processor -- start 2023-10-16T19:40:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.480+0000 7f5bf8767b80 1 -- start start 2023-10-16T19:40:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf7ac90 0x56005bfa4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bd538d0 con 0x56005bf806b0 2023-10-16T19:40:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005becbe00 con 0x56005bf80a90 2023-10-16T19:40:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x56005bf81300 con 0x56005bf7ac90 2023-10-16T19:40:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51300/0 (socket says 172.21.15.29:51300) 2023-10-16T19:40:00.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 -- 172.21.15.29:0/3415491293 learned_addr learned my addr 172.21.15.29:0/3415491293 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5beab1a700 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 -- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf7ac90 msgr2=0x56005bfa4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf7ac90 0x56005bfa4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 -- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 msgr2=0x56005bfbf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 -- 172.21.15.29:0/3415491293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005bce6c10 con 0x56005bf806b0 2023-10-16T19:40:00.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5be00056b0 tx=0x7f5be0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be83a52fef98207c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bd8ff9700 1 -- 172.21.15.29:0/3415491293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be001d070 con 0x56005bf806b0 2023-10-16T19:40:00.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bd8ff9700 1 -- 172.21.15.29:0/3415491293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0001440 con 0x56005bf806b0 2023-10-16T19:40:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.481+0000 7f5bd8ff9700 1 -- 172.21.15.29:0/3415491293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00015d0 con 0x56005bf806b0 2023-10-16T19:40:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3415491293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 msgr2=0x56005bfcf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5be00056b0 tx=0x7f5be0007ec0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3415491293 shutdown_connections 2023-10-16T19:40:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf7ac90 0x56005bfa4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3415491293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf806b0 0x56005bfcf310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3415491293 >> 172.21.15.29:0/3415491293 conn(0x56005beadd80 msgr2=0x56005bfbcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3415491293 shutdown_connections 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3415491293 wait complete. 2023-10-16T19:40:00.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 -- start start 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.482+0000 7f5bf8767b80 1 Processor -- start 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf806b0 0x56005bfb2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bf73590 con 0x56005bf7ac90 2023-10-16T19:40:00.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005bfbe770 con 0x56005bf80a90 2023-10-16T19:40:00.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x56005bfbe460 con 0x56005bf806b0 2023-10-16T19:40:00.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bf8767b80 10 client.0 _ll_register_callbacks cb 0x56005bccc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:40:00.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bea319700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bea319700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51304/0 (socket says 172.21.15.29:51304) 2023-10-16T19:40:00.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5bea319700 1 -- 172.21.15.29:0/3404661953 learned_addr learned my addr 172.21.15.29:0/3404661953 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.483+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf806b0 0x56005bfb2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5beab1a700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 -- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf806b0 msgr2=0x56005bfb2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf806b0 0x56005bfb2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 -- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 msgr2=0x56005bfbf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 -- 172.21.15.29:0/3404661953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be00053b0 con 0x56005bf7ac90 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bea319700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400bb90 tx=0x7f5bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcced13c68dcfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4006b90 con 0x56005bf7ac90 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bd4003930 con 0x56005bf7ac90 2023-10-16T19:40:00.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bdc0564c0 con 0x56005bf7ac90 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bd4010e90 con 0x56005bf7ac90 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 10 client.4416 fetch_fsmap learned FSMap version 7 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56005bd24200 con 0x56005bf7ac90 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0564c0 con 0x56005bf7ac90 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5bd4003af0 con 0x56005bf7ac90 2023-10-16T19:40:00.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T19:40:00.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 10 client.4416 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:40:00.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 20 client.4416 populate_metadata read hostname 'smithi029' 2023-10-16T19:40:00.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfbfab0 0x56005bfb9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 4 client.4416 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:40:00.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.484+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 --> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56005becbb20 con 0x56005bfbfab0 2023-10-16T19:40:00.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfbfab0 0x56005bfb9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bc57fa700 10 client.4416 ms_handle_connect on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:00.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5be9b18700 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfbfab0 0x56005bfb9dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea76588a5587f886 server_cookie=3d4ea3c8f68f092 in_seq=0 out_seq=0 2023-10-16T19:40:00.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bc57fa700 1 -- 172.21.15.29:0/3404661953 <== mds.0 v2:172.21.15.29:6833/1712057273 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56005becbb20 con 0x56005bfbfab0 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bc57fa700 10 client.4416 handle_command_reply: tid=0 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 client.4416 shutdown 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 msgr2=0x56005c01e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400bb90 tx=0x7f5bd4004750 comp rx=0 tx=0).stop 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 shutdown_connections 2023-10-16T19:40:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005bf80a90 0x56005bfbf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x56005bfbfab0 0x56005bfb9dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56005bf7ac90 0x56005c01e5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 --2- 172.21.15.29:0/3404661953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x56005bf806b0 0x56005bfb2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bc57fa700 0 client.4416 ms_handle_reset on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:00.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 >> 172.21.15.29:0/3404661953 conn(0x56005beadd80 msgr2=0x56005bfa4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 shutdown_connections 2023-10-16T19:40:00.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.485+0000 7f5bf8767b80 1 -- 172.21.15.29:0/3404661953 wait complete. 2023-10-16T19:40:00.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bf8767b80 20 client.4416 trim_cache size 0 max 16384 2023-10-16T19:40:00.509 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:40:00.510 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "b5b71d99-0d95-4cc7-b379-31b38eac533d", 2023-10-16T19:40:00.510 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-16T19:40:00.510 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4251, 2023-10-16T19:40:00.510 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 7.5245647670000002, 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 25, 2023-10-16T19:40:00.511 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 25, 2023-10-16T19:40:00.512 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 14.758788896 2023-10-16T19:40:00.512 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:40:00.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 msgr2=0x7f5bc806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 0x7f5bc806d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400b340 tx=0x7f5bd4013000 comp rx=0 tx=0).stop 2023-10-16T19:40:00.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 msgr2=0x7f5be4143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007e70 tx=0x7f5bdc00d3b0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 shutdown_connections 2023-10-16T19:40:00.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f5bc806af00 0x7f5bc806d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be414ec50 0x7f5be4143be0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5be406db00 0x7f5be4153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 --2- 172.21.15.29:0/1441863856 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5be40c3350 0x7f5be4152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 >> 172.21.15.29:0/1441863856 conn(0x7f5be40c7110 msgr2=0x7f5be406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 shutdown_connections 2023-10-16T19:40:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.486+0000 7f5bec57d700 1 -- 172.21.15.29:0/1441863856 wait complete. 2023-10-16T19:40:00.517 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:40:00.518 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:00.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:40:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.642+0000 7f6db444b700 1 Processor -- start 2023-10-16T19:40:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.642+0000 7f6db444b700 1 -- start start 2023-10-16T19:40:00.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db444b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 0x7f6dac06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db444b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6dac154a50 0x7f6dac1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db444b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac06e780 con 0x7f6dac06adc0 2023-10-16T19:40:00.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db444b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac06d320 con 0x7f6dac154a50 2023-10-16T19:40:00.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db444b700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac154f10 con 0x7f6dac13d660 2023-10-16T19:40:00.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6dac154a50 0x7f6dac1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db29e8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6dac06adc0 0x7f6dac158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36758/0 (socket says 172.21.15.29:36758) 2023-10-16T19:40:00.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6dac154a50 0x7f6dac1583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51316/0 (socket says 172.21.15.29:51316) 2023-10-16T19:40:00.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db29e8700 1 -- 172.21.15.29:0/41844243 learned_addr learned my addr 172.21.15.29:0/41844243 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:00.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db21e7700 1 --2- 172.21.15.29:0/41844243 >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 0x7f6dac06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 -- 172.21.15.29:0/41844243 >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 msgr2=0x7f6dac06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:00.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 --2- 172.21.15.29:0/41844243 >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 0x7f6dac06a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 -- 172.21.15.29:0/41844243 >> v1:172.21.15.29:6789/0 conn(0x7f6dac06adc0 legacy=0x7f6dac158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 -- 172.21.15.29:0/41844243 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac1551f0 con 0x7f6dac154a50 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db11e5700 1 -- 172.21.15.29:0/41844243 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243557640 0 0) 0x7f6dac06e780 con 0x7f6dac06adc0 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db21e7700 1 --2- 172.21.15.29:0/41844243 >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 0x7f6dac06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db19e6700 1 --2- 172.21.15.29:0/41844243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1583c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0c15e0 tx=0x7f6d9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c21d9b53438be2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.643+0000 7f6db11e5700 1 -- 172.21.15.29:0/41844243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c011830 con 0x7f6dac154a50 2023-10-16T19:40:00.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db11e5700 1 -- 172.21.15.29:0/41844243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c011990 con 0x7f6dac154a50 2023-10-16T19:40:00.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db11e5700 1 -- 172.21.15.29:0/41844243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c011d20 con 0x7f6dac154a50 2023-10-16T19:40:00.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 -- 172.21.15.29:0/41844243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 msgr2=0x7f6dac1583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 --2- 172.21.15.29:0/41844243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1583c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0c15e0 tx=0x7f6d9c009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:00.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 -- 172.21.15.29:0/41844243 shutdown_connections 2023-10-16T19:40:00.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 --2- 172.21.15.29:0/41844243 >> v2:172.21.15.53:3300/0 conn(0x7f6dac13d660 0x7f6dac06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 --2- 172.21.15.29:0/41844243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1583c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 -- 172.21.15.29:0/41844243 >> 172.21.15.29:0/41844243 conn(0x7f6dac0c7110 msgr2=0x7f6dac0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 -- 172.21.15.29:0/41844243 shutdown_connections 2023-10-16T19:40:00.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.644+0000 7f6db444b700 1 -- 172.21.15.29:0/41844243 wait complete. 2023-10-16T19:40:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.645+0000 7f6db444b700 1 Processor -- start 2023-10-16T19:40:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.645+0000 7f6db444b700 1 -- start start 2023-10-16T19:40:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac06adc0 0x7f6dac1396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6dac13d660 0x7f6dac156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac138a80 con 0x7f6dac154a50 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac139c10 con 0x7f6dac06adc0 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db444b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac13a800 con 0x7f6dac13d660 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51322/0 (socket says 172.21.15.29:51322) 2023-10-16T19:40:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 -- 172.21.15.29:0/2321166361 learned_addr learned my addr 172.21.15.29:0/2321166361 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db19e6700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6dac13d660 0x7f6dac156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db21e7700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac06adc0 0x7f6dac1396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 -- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6dac13d660 msgr2=0x7f6dac156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6dac13d660 0x7f6dac156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 -- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac06adc0 msgr2=0x7f6dac1396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac06adc0 0x7f6dac1396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.646+0000 7f6db29e8700 1 -- 172.21.15.29:0/2321166361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0094a0 con 0x7f6dac154a50 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6db29e8700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6da400cba0 tx=0x7f6da400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400aaa0 con 0x7f6dac154a50 2023-10-16T19:40:00.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400ac00 con 0x7f6dac154a50 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac138430 con 0x7f6dac154a50 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40070d0 con 0x7f6dac154a50 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.647+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac157300 con 0x7f6dac154a50 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.648+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac138290 con 0x7f6dac154a50 2023-10-16T19:40:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.648+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6da4007230 con 0x7f6dac154a50 2023-10-16T19:40:00.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.649+0000 7f6da2ffd700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 0x7f6d9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:00.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.649+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6da4089480 con 0x7f6dac154a50 2023-10-16T19:40:00.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.649+0000 7f6db21e7700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 0x7f6d9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:00.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.649+0000 7f6db21e7700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 0x7f6d9006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6da8006fd0 tx=0x7f6da8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:00.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.653+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dac138290 con 0x7f6dac154a50 2023-10-16T19:40:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.900+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6dac138290 con 0x7f6dac154a50 2023-10-16T19:40:00.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.901+0000 7f6da2ffd700 1 -- 172.21.15.29:0/2321166361 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6dac138290 con 0x7f6dac154a50 2023-10-16T19:40:00.904 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T19:40:00.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 msgr2=0x7f6d9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 0x7f6d9006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6da8006fd0 tx=0x7f6da8008040 comp rx=0 tx=0).stop 2023-10-16T19:40:00.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 msgr2=0x7f6dac1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:00.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6da400cba0 tx=0x7f6da400ceb0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 shutdown_connections 2023-10-16T19:40:00.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6d9006af00 0x7f6d9006d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dac154a50 0x7f6dac1532c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac06adc0 0x7f6dac1396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 --2- 172.21.15.29:0/2321166361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6dac13d660 0x7f6dac156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:00.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 >> 172.21.15.29:0/2321166361 conn(0x7f6dac0c7110 msgr2=0x7f6dac13ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:00.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 shutdown_connections 2023-10-16T19:40:00.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:00.903+0000 7f6db444b700 1 -- 172.21.15.29:0/2321166361 wait complete. 2023-10-16T19:40:00.917 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T19:40:00.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:40:00.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-16T19:40:00.919 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-16T19:40:00.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:00.919 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T19:40:00.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:40:00.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:40:00.920 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T19:40:00.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:00.921 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-16T19:40:00.938 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:40:00.939 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:40:00.939 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:40:00.939 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:00.939 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:00.940 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:40:00.941 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:00.941 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T19:40:00.941 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-10-16T19:40:00.941 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-16T19:40:00.941 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:00.942 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:00.942 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:00.942 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:40:00.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:00.943 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:00.943 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:00.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:40:00.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-10-16T19:40:00.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-10-16T19:40:00.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:40:00.945 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:01.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.133 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:40:01.162 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-16T19:40:01.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.164 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-16T19:40:01.239 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-16T19:40:01.240 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:40:01.240 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T19:40:01.240 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T19:40:01.240 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:40:01.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.241 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:01.242 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:01.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T19:40:01.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T19:40:01.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T19:40:01.243 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:01.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.539 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-16T19:40:01.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.558 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-16T19:40:01.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.614 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:01.614 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:01.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:01.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-16T19:40:01.615 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:01.709 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-16T19:40:01.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.710 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:01.710 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:01.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-16T19:40:01.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:40:01.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-16T19:40:01.712 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-16T19:40:01.712 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-16T19:40:01.712 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:01.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:01.910 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:01.910 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:01.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-16T19:40:01.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:40:01.911 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:02.014 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-16T19:40:02.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:02.015 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:02.038 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T19:40:02.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:02.039 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:02.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-16T19:40:02.163 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:40:02.221 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2023-10-16T19:40:02.222 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2023-10-16T19:40:02.222 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2023-10-16T19:40:02.222 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2023-10-16T19:40:02.222 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2023-10-16T19:40:02.222 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2023-10-16T19:40:02.223 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2023-10-16T19:40:02.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2023-10-16T19:40:02.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/systemd 2023-10-16T19:40:02.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2023-10-16T19:40:02.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2023-10-16T19:40:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T19:40:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/rdma 2023-10-16T19:40:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/freezer 2023-10-16T19:40:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/perf_event 2023-10-16T19:40:02.224 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/devices 2023-10-16T19:40:02.225 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/blkio 2023-10-16T19:40:02.225 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T19:40:02.225 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/memory 2023-10-16T19:40:02.225 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/pids 2023-10-16T19:40:02.225 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T19:40:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpuset 2023-10-16T19:40:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2023-10-16T19:40:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2023-10-16T19:40:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2023-10-16T19:40:02.226 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2023-10-16T19:40:02.227 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2023-10-16T19:40:02.227 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2023-10-16T19:40:02.227 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:40:02.227 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2023-10-16T19:40:02.227 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2023-10-16T19:40:02.228 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:40:02.228 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2023-10-16T19:40:02.228 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2023-10-16T19:40:02.228 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:40:02.228 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:40:02.229 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:40:02.229 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:40:02.229 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2023-10-16T19:40:02.229 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:02.229 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:02.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:02.230 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-16T19:40:02.279 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T19:40:02.279 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-16T19:40:02.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-16T19:40:02.349 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:40:02.406 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2023-10-16T19:40:02.407 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2023-10-16T19:40:02.407 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2023-10-16T19:40:02.407 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2023-10-16T19:40:02.407 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2023-10-16T19:40:02.408 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2023-10-16T19:40:02.408 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2023-10-16T19:40:02.408 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2023-10-16T19:40:02.408 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/systemd 2023-10-16T19:40:02.408 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2023-10-16T19:40:02.409 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2023-10-16T19:40:02.409 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T19:40:02.409 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/rdma 2023-10-16T19:40:02.409 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/freezer 2023-10-16T19:40:02.409 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/perf_event 2023-10-16T19:40:02.410 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/devices 2023-10-16T19:40:02.410 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/blkio 2023-10-16T19:40:02.410 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T19:40:02.410 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/memory 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/pids 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpuset 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2023-10-16T19:40:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2023-10-16T19:40:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2023-10-16T19:40:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2023-10-16T19:40:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2023-10-16T19:40:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2023-10-16T19:40:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:40:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:40:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:40:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:40:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2023-10-16T19:40:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:02.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:02.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:02.415 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-16T19:40:02.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2023-10-16T19:40:02.462+0000 7fb9fc5f05c0 -1 init, newargv = 0x55833aede110 newargc=15 2023-10-16T19:40:02.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[110982]: starting ceph client 2023-10-16T19:40:02.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[110982]: starting fuse 2023-10-16T19:40:03.565 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-16T19:40:03.601 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T19:40:03.663 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2023-10-16T19:40:03.663 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2023-10-16T19:40:03.664 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2023-10-16T19:40:03.664 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2023-10-16T19:40:03.664 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2023-10-16T19:40:03.664 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2023-10-16T19:40:03.665 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2023-10-16T19:40:03.665 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2023-10-16T19:40:03.665 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/systemd 2023-10-16T19:40:03.666 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2023-10-16T19:40:03.666 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2023-10-16T19:40:03.666 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T19:40:03.666 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/rdma 2023-10-16T19:40:03.667 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/freezer 2023-10-16T19:40:03.667 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/perf_event 2023-10-16T19:40:03.667 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/devices 2023-10-16T19:40:03.667 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/blkio 2023-10-16T19:40:03.668 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T19:40:03.668 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/memory 2023-10-16T19:40:03.668 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/pids 2023-10-16T19:40:03.669 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T19:40:03.669 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup/cpuset 2023-10-16T19:40:03.669 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2023-10-16T19:40:03.669 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2023-10-16T19:40:03.670 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2023-10-16T19:40:03.670 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2023-10-16T19:40:03.670 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2023-10-16T19:40:03.671 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2023-10-16T19:40:03.671 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T19:40:03.671 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2023-10-16T19:40:03.671 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2023-10-16T19:40:03.672 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T19:40:03.672 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2023-10-16T19:40:03.672 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2023-10-16T19:40:03.672 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T19:40:03.673 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T19:40:03.673 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T19:40:03.673 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T19:40:03.673 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2023-10-16T19:40:03.674 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:03.674 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:03.674 INFO:teuthology.orchestra.run.smithi029.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:03.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:03.675 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-16T19:40:03.723 INFO:teuthology.orchestra.run.smithi029.stdout:47 2023-10-16T19:40:03.724 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-16T19:40:03.724 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2023-10-16T19:40:03.724 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-16T19:40:03.725 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-16T19:40:03.725 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-16T19:40:03.725 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-16T19:40:03.726 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-16T19:40:03.726 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-16T19:40:03.727 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-16T19:40:03.727 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-16T19:40:03.727 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-16T19:40:03.728 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-16T19:40:03.728 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-16T19:40:03.728 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-16T19:40:03.729 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-16T19:40:03.729 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-16T19:40:03.729 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-16T19:40:03.730 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-16T19:40:03.730 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T19:40:03.730 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T19:40:03.731 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T19:40:03.731 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-16T19:40:03.731 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-16T19:40:03.732 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-16T19:40:03.732 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T19:40:03.733 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-16T19:40:03.733 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2023-10-16T19:40:03.733 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-16T19:40:03.858 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.110982.asok 2023-10-16T19:40:03.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T19:40:03.868 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.110982.asok 2023-10-16T19:40:03.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:03.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.110982.asok status 2023-10-16T19:40:04.030 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:40:04.031 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-16T19:40:04.031 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T19:40:04.031 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T19:40:04.031 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "110982", 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:40:04.032 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-16T19:40:04.033 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-16T19:40:04.033 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4431, 2023-10-16T19:40:04.033 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-16T19:40:04.033 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-16T19:40:04.033 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-16T19:40:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4431 2023-10-16T19:40:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:40:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-16T19:40:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-16T19:40:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-16T19:40:04.035 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2973629643 2023-10-16T19:40:04.035 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:40:04.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:40:04.035 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-16T19:40:04.035 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-16T19:40:04.036 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-16T19:40:04.036 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2973629643 2023-10-16T19:40:04.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:40:04.036 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4431 192.168.0.1:0/2973629643", 2023-10-16T19:40:04.036 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2973629643", 2023-10-16T19:40:04.037 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-16T19:40:04.037 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2023-10-16T19:40:04.037 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 25, 2023-10-16T19:40:04.037 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-16T19:40:04.038 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-16T19:40:04.038 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-16T19:40:04.038 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:40:04.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:04.041 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-16T19:40:04.041 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:04.059 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-16T19:40:04.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:04.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:04.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:04.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:04.128 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-16T19:40:04.227 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2023-10-16T19:40:04.227 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-16T19:40:04.227 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:04.228 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:04.228 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:04.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:04.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.409+0000 7fcfaa407700 1 Processor -- start 2023-10-16T19:40:04.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.409+0000 7fcfaa407700 1 -- start start 2023-10-16T19:40:04.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfaa407700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfa413d660 0x7fcfa406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfaa407700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa406e780 con 0x7fcfa406adc0 2023-10-16T19:40:04.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfaa407700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa4154f10 con 0x7fcfa4154a50 2023-10-16T19:40:04.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfaa407700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa406d320 con 0x7fcfa413d660 2023-10-16T19:40:04.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfa413d660 0x7fcfa406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa89a4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcfa406adc0 0x7fcfa415f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36798/0 (socket says 172.21.15.29:36798) 2023-10-16T19:40:04.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa89a4700 1 -- 172.21.15.29:0/826843140 learned_addr learned my addr 172.21.15.29:0/826843140 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:04.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa3fff700 1 -- 172.21.15.29:0/826843140 >> v1:172.21.15.53:6789/0 conn(0x7fcfa4154a50 legacy=0x7fcfa41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:04.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa3fff700 1 -- 172.21.15.29:0/826843140 >> v1:172.21.15.29:6789/0 conn(0x7fcfa406adc0 legacy=0x7fcfa415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa2ffd700 1 -- 172.21.15.29:0/826843140 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028955259 0 0) 0x7fcfa406e780 con 0x7fcfa406adc0 2023-10-16T19:40:04.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.410+0000 7fcfa3fff700 1 -- 172.21.15.29:0/826843140 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa41551f0 con 0x7fcfa413d660 2023-10-16T19:40:04.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfa3fff700 1 --2- 172.21.15.29:0/826843140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa413d660 0x7fcfa406a880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3122ac14f24c96e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfa2ffd700 1 -- 172.21.15.29:0/826843140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004230 con 0x7fcfa413d660 2023-10-16T19:40:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfa2ffd700 1 -- 172.21.15.29:0/826843140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94004390 con 0x7fcfa413d660 2023-10-16T19:40:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfa2ffd700 1 -- 172.21.15.29:0/826843140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940036a0 con 0x7fcfa413d660 2023-10-16T19:40:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 -- 172.21.15.29:0/826843140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa413d660 msgr2=0x7fcfa406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 --2- 172.21.15.29:0/826843140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa413d660 0x7fcfa406a880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf94009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:04.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 -- 172.21.15.29:0/826843140 shutdown_connections 2023-10-16T19:40:04.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 --2- 172.21.15.29:0/826843140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa413d660 0x7fcfa406a880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 -- 172.21.15.29:0/826843140 >> 172.21.15.29:0/826843140 conn(0x7fcfa40c7110 msgr2=0x7fcfa40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:04.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 -- 172.21.15.29:0/826843140 shutdown_connections 2023-10-16T19:40:04.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.411+0000 7fcfaa407700 1 -- 172.21.15.29:0/826843140 wait complete. 2023-10-16T19:40:04.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.412+0000 7fcfaa407700 1 Processor -- start 2023-10-16T19:40:04.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 -- start start 2023-10-16T19:40:04.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcfa406adc0 0x7fcfa40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa413d660 0x7fcfa40c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40c6bb0 con 0x7fcfa4154a50 2023-10-16T19:40:04.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa41390b0 con 0x7fcfa413d660 2023-10-16T19:40:04.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfaa407700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4136230 con 0x7fcfa406adc0 2023-10-16T19:40:04.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfa89a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfa89a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51360/0 (socket says 172.21.15.29:51360) 2023-10-16T19:40:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.413+0000 7fcfa89a4700 1 -- 172.21.15.29:0/867594283 learned_addr learned my addr 172.21.15.29:0/867594283 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa37fe700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa413d660 0x7fcfa40c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa3fff700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcfa406adc0 0x7fcfa40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 -- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcfa406adc0 msgr2=0x7fcfa40c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcfa406adc0 0x7fcfa40c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 -- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa413d660 msgr2=0x7fcfa40c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa413d660 0x7fcfa40c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 -- 172.21.15.29:0/867594283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094a0 con 0x7fcfa4154a50 2023-10-16T19:40:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa89a4700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cba0 tx=0x7fcf9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00ab80 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00ace0 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa41395a0 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c007310 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.414+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa41392c0 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.415+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa413c300 con 0x7fcfa4154a50 2023-10-16T19:40:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.415+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf9c007470 con 0x7fcfa4154a50 2023-10-16T19:40:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.416+0000 7fcfa0ff9700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 0x7fcf9006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.416+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf9c089650 con 0x7fcfa4154a50 2023-10-16T19:40:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.416+0000 7fcfa3fff700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 0x7fcf9006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.417+0000 7fcfa3fff700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 0x7fcf9006d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf9401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.420+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfa413c300 con 0x7fcfa4154a50 2023-10-16T19:40:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.620+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa413c300 con 0x7fcfa4154a50 2023-10-16T19:40:04.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.622+0000 7fcfa0ff9700 1 -- 172.21.15.29:0/867594283 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fcfa413c300 con 0x7fcfa4154a50 2023-10-16T19:40:04.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:04.624 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 msgr2=0x7fcf9006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 0x7fcf9006d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf9401c040 comp rx=0 tx=0).stop 2023-10-16T19:40:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 msgr2=0x7fcfa41ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cba0 tx=0x7fcf9c00cf60 comp rx=0 tx=0).stop 2023-10-16T19:40:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 shutdown_connections 2023-10-16T19:40:04.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf9006af30 0x7fcf9006d3f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa4154a50 0x7fcfa41ed520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcfa406adc0 0x7fcfa40c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 --2- 172.21.15.29:0/867594283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa413d660 0x7fcfa40c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 >> 172.21.15.29:0/867594283 conn(0x7fcfa40c7110 msgr2=0x7fcfa40c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:04.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 shutdown_connections 2023-10-16T19:40:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.624+0000 7fcfaa407700 1 -- 172.21.15.29:0/867594283 wait complete. 2023-10-16T19:40:04.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:04.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:04.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.764+0000 7f0d09e53700 1 Processor -- start 2023-10-16T19:40:04.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.764+0000 7f0d09e53700 1 -- start start 2023-10-16T19:40:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d09e53700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040c2a40 0x7f0d040a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d09e53700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d040c7c10 0x7f0d040a7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d09e53700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d04158e30 con 0x7f0d040be280 2023-10-16T19:40:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d09e53700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d04158b50 con 0x7f0d040c7c10 2023-10-16T19:40:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d09e53700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0406ba30 con 0x7f0d040c2a40 2023-10-16T19:40:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d040c7c10 0x7f0d040a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d040c7c10 0x7f0d040a7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51368/0 (socket says 172.21.15.29:51368) 2023-10-16T19:40:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d037fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0d040be280 0x7f0d040c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36808/0 (socket says 172.21.15.29:36808) 2023-10-16T19:40:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 -- 172.21.15.29:0/902784498 learned_addr learned my addr 172.21.15.29:0/902784498 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d02ffd700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040c2a40 0x7f0d040a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 -- 172.21.15.29:0/902784498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040c2a40 msgr2=0x7f0d040a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040c2a40 0x7f0d040a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 -- 172.21.15.29:0/902784498 >> v1:172.21.15.29:6789/0 conn(0x7f0d040be280 legacy=0x7f0d040c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 -- 172.21.15.29:0/902784498 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0406bd10 con 0x7f0d040c7c10 2023-10-16T19:40:04.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d027fc700 1 -- 172.21.15.29:0/902784498 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819383362 0 0) 0x7f0d04158e30 con 0x7f0d040be280 2023-10-16T19:40:04.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.765+0000 7f0d03fff700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c7c10 0x7f0d040a7410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009e50 tx=0x7f0cfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8daa0fc8fa1b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d027fc700 1 -- 172.21.15.29:0/902784498 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00e070 con 0x7f0d040c7c10 2023-10-16T19:40:04.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d027fc700 1 -- 172.21.15.29:0/902784498 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00b910 con 0x7f0d040c7c10 2023-10-16T19:40:04.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d027fc700 1 -- 172.21.15.29:0/902784498 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00bcc0 con 0x7f0d040c7c10 2023-10-16T19:40:04.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 -- 172.21.15.29:0/902784498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c7c10 msgr2=0x7f0d040a7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c7c10 0x7f0d040a7410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009e50 tx=0x7f0cfc00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:04.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 -- 172.21.15.29:0/902784498 shutdown_connections 2023-10-16T19:40:04.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c7c10 0x7f0d040a7410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 --2- 172.21.15.29:0/902784498 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040c2a40 0x7f0d040a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 -- 172.21.15.29:0/902784498 >> 172.21.15.29:0/902784498 conn(0x7f0d040a9cd0 msgr2=0x7f0d040aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:04.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 -- 172.21.15.29:0/902784498 shutdown_connections 2023-10-16T19:40:04.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.766+0000 7f0d09e53700 1 -- 172.21.15.29:0/902784498 wait complete. 2023-10-16T19:40:04.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.767+0000 7f0d09e53700 1 Processor -- start 2023-10-16T19:40:04.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 -- start start 2023-10-16T19:40:04.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 0x7f0d041eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 0x7f0d041ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c1e60 con 0x7f0d040c2a40 2023-10-16T19:40:04.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d041edb00 con 0x7f0d040c7c10 2023-10-16T19:40:04.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d09e53700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040a75a0 con 0x7f0d040be280 2023-10-16T19:40:04.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d02ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d02ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51372/0 (socket says 172.21.15.29:51372) 2023-10-16T19:40:04.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d02ffd700 1 -- 172.21.15.29:0/2040838317 learned_addr learned my addr 172.21.15.29:0/2040838317 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:04.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.768+0000 7f0d037fe700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 0x7f0d041eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d03fff700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 0x7f0d041ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 -- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 msgr2=0x7f0d041eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 0x7f0d041eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 -- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 msgr2=0x7f0d041ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 0x7f0d041ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 -- 172.21.15.29:0/2040838317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009b30 con 0x7f0d040c2a40 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d03fff700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 0x7f0d041ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d037fe700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 0x7f0d041eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d02ffd700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400e980 tx=0x7f0cf400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4009710 con 0x7f0d040c2a40 2023-10-16T19:40:04.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400c850 con 0x7f0d040c2a40 2023-10-16T19:40:04.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400cc00 con 0x7f0d040c2a40 2023-10-16T19:40:04.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d041ed820 con 0x7f0d040c2a40 2023-10-16T19:40:04.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.769+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d04153580 con 0x7f0d040c2a40 2023-10-16T19:40:04.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.770+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d04156a80 con 0x7f0d040c2a40 2023-10-16T19:40:04.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.770+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cf4013470 con 0x7f0d040c2a40 2023-10-16T19:40:04.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.771+0000 7f0cfbfff700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 0x7f0ce406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:04.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.771+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cf40899b0 con 0x7f0d040c2a40 2023-10-16T19:40:04.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.771+0000 7f0d037fe700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 0x7f0ce406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:04.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.772+0000 7f0d037fe700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 0x7f0ce406d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000f60 tx=0x7f0cec007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:04.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.776+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d04156a80 con 0x7f0d040c2a40 2023-10-16T19:40:04.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.972+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d04156a80 con 0x7f0d040c2a40 2023-10-16T19:40:04.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.972+0000 7f0cfbfff700 1 -- 172.21.15.29:0/2040838317 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d04156a80 con 0x7f0d040c2a40 2023-10-16T19:40:04.976 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 msgr2=0x7f0ce406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 0x7f0ce406d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000f60 tx=0x7f0cec007d30 comp rx=0 tx=0).stop 2023-10-16T19:40:04.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 msgr2=0x7f0d04156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400e980 tx=0x7f0cf400ed40 comp rx=0 tx=0).stop 2023-10-16T19:40:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 shutdown_connections 2023-10-16T19:40:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ce406af00 0x7f0ce406d3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d040c7c10 0x7f0d041ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0d040be280 0x7f0d041eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 --2- 172.21.15.29:0/2040838317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d040c2a40 0x7f0d04156d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 >> 172.21.15.29:0/2040838317 conn(0x7f0d040a9cd0 msgr2=0x7f0d040c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 shutdown_connections 2023-10-16T19:40:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:04.975+0000 7f0d09e53700 1 -- 172.21.15.29:0/2040838317 wait complete. 2023-10-16T19:40:04.989 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:05.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.117+0000 7f89bb408700 1 Processor -- start 2023-10-16T19:40:05.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.117+0000 7f89bb408700 1 -- start start 2023-10-16T19:40:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89bb408700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89b406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89bb408700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b4154da0 con 0x7f89b41520b0 2023-10-16T19:40:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89bb408700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b4155080 con 0x7f89b40714a0 2023-10-16T19:40:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89bb408700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4155b60 con 0x7f89b40c3240 2023-10-16T19:40:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89b89a3700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f89b41520b0 0x7f89b406ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36828/0 (socket says 172.21.15.29:36828) 2023-10-16T19:40:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89b89a3700 1 -- 172.21.15.29:0/635325445 learned_addr learned my addr 172.21.15.29:0/635325445 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89b99a5700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89b406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422744759 0 0) 0x7f89b4154da0 con 0x7f89b41520b0 2023-10-16T19:40:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a00035b0 con 0x7f89b41520b0 2023-10-16T19:40:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860610939 0 0) 0x7f89a00035b0 con 0x7f89b41520b0 2023-10-16T19:40:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 msgr2=0x7f89b406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89b406e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 >> v1:172.21.15.53:6789/0 conn(0x7f89b40714a0 legacy=0x7f89b4147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4155360 con 0x7f89b41520b0 2023-10-16T19:40:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.118+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f89a4001670 con 0x7f89b41520b0 2023-10-16T19:40:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 >> v1:172.21.15.29:6789/0 conn(0x7f89b41520b0 legacy=0x7f89b406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89a0003a30 0x7f89a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a0004d90 0x7f89a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4155b60 con 0x7f89a0003a30 2023-10-16T19:40:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a000bb40 con 0x7f89a0004d90 2023-10-16T19:40:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a000df10 con 0x7f89b40c3240 2023-10-16T19:40:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89a0003a30 0x7f89a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b89a3700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b99a5700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a0004d90 0x7f89a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 -- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 msgr2=0x7f89a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89b40c3240 0x7f89a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 -- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a0004d90 msgr2=0x7f89a0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a0004d90 0x7f89a0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 -- 172.21.15.29:0/635325445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00035b0 con 0x7f89a0003a30 2023-10-16T19:40:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89b91a4700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89a0003a30 0x7f89a0003e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f89b00017c0 tx=0x7f89a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f995b511c34ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00052d0 con 0x7f89a0003a30 2023-10-16T19:40:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b0005430 con 0x7f89a0003a30 2023-10-16T19:40:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.119+0000 7f89abfff700 1 -- 172.21.15.29:0/635325445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00038c0 con 0x7f89a0003a30 2023-10-16T19:40:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 -- 172.21.15.29:0/635325445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89a0003a30 msgr2=0x7f89a0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 --2- 172.21.15.29:0/635325445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89a0003a30 0x7f89a0003e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f89b00017c0 tx=0x7f89a0005880 comp rx=0 tx=0).stop 2023-10-16T19:40:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89b99a5700 1 -- 172.21.15.29:0/635325445 reap_dead start 2023-10-16T19:40:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 -- 172.21.15.29:0/635325445 shutdown_connections 2023-10-16T19:40:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 -- 172.21.15.29:0/635325445 >> 172.21.15.29:0/635325445 conn(0x7f89b40c7100 msgr2=0x7f89b40c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 -- 172.21.15.29:0/635325445 shutdown_connections 2023-10-16T19:40:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.120+0000 7f89bb408700 1 -- 172.21.15.29:0/635325445 wait complete. 2023-10-16T19:40:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.121+0000 7f89bb408700 1 Processor -- start 2023-10-16T19:40:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.121+0000 7f89bb408700 1 -- start start 2023-10-16T19:40:05.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89a0003a30 0x7f89b406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 0x7f89b40c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4146a40 con 0x7f89b40c6a30 2023-10-16T19:40:05.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b406e450 con 0x7f89b4145730 2023-10-16T19:40:05.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89bb408700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4152ab0 con 0x7f89a0003a30 2023-10-16T19:40:05.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51396/0 (socket says 172.21.15.29:51396) 2023-10-16T19:40:05.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 -- 172.21.15.29:0/3795634322 learned_addr learned my addr 172.21.15.29:0/3795634322 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:05.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b99a5700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 0x7f89b40c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b91a4700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89a0003a30 0x7f89b406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 -- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89a0003a30 msgr2=0x7f89b406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89a0003a30 0x7f89b406f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 -- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 msgr2=0x7f89b40c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 0x7f89b40c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 -- 172.21.15.29:0/3795634322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4152d90 con 0x7f89b40c6a30 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b99a5700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 0x7f89b40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89b89a3700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89a40072c0 tx=0x7f89a4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.122+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400f7d0 con 0x7f89b40c6a30 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.123+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400f950 con 0x7f89b40c6a30 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.123+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b4153070 con 0x7f89b40c6a30 2023-10-16T19:40:05.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.123+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400fd00 con 0x7f89b40c6a30 2023-10-16T19:40:05.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.123+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b406f6b0 con 0x7f89b40c6a30 2023-10-16T19:40:05.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.124+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b404f400 con 0x7f89b40c6a30 2023-10-16T19:40:05.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.124+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f89a401d460 con 0x7f89b40c6a30 2023-10-16T19:40:05.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.125+0000 7f89a9ffb700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 0x7f899806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.125+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89a40898d0 con 0x7f89b40c6a30 2023-10-16T19:40:05.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.125+0000 7f89b91a4700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 0x7f899806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.125+0000 7f89b91a4700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 0x7f899806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89b0015040 tx=0x7f89b0009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.129+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89a4054720 con 0x7f89b40c6a30 2023-10-16T19:40:05.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.327+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89b40c3020 con 0x7f89b40c6a30 2023-10-16T19:40:05.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.327+0000 7f89a9ffb700 1 -- 172.21.15.29:0/3795634322 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89a4057d40 con 0x7f89b40c6a30 2023-10-16T19:40:05.331 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 msgr2=0x7f899806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 0x7f899806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89b0015040 tx=0x7f89b0009030 comp rx=0 tx=0).stop 2023-10-16T19:40:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 msgr2=0x7f89b4146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89a40072c0 tx=0x7f89a4007680 comp rx=0 tx=0).stop 2023-10-16T19:40:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 shutdown_connections 2023-10-16T19:40:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f899806af00 0x7f899806d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89b4145730 0x7f89b40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89a0003a30 0x7f89b406f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 --2- 172.21.15.29:0/3795634322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40c6a30 0x7f89b4146ed0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 >> 172.21.15.29:0/3795634322 conn(0x7f89b40c7100 msgr2=0x7f89b40c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.329+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 shutdown_connections 2023-10-16T19:40:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.330+0000 7f89bb408700 1 -- 172.21.15.29:0/3795634322 wait complete. 2023-10-16T19:40:05.344 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:05.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.469+0000 7f567a82d700 1 Processor -- start 2023-10-16T19:40:05.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.469+0000 7f567a82d700 1 -- start start 2023-10-16T19:40:05.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f567a82d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f567413d660 0x7f567406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f567a82d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f567406adc0 0x7f5674158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f567a82d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567406e780 con 0x7f5674154a50 2023-10-16T19:40:05.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f567a82d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567406d320 con 0x7f567413d660 2023-10-16T19:40:05.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f567a82d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5674154f10 con 0x7f567406adc0 2023-10-16T19:40:05.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f5673fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f567413d660 0x7f567406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f56737fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5674154a50 0x7f56741583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36848/0 (socket says 172.21.15.29:36848) 2023-10-16T19:40:05.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f5673fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f567413d660 0x7f567406a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51402/0 (socket says 172.21.15.29:51402) 2023-10-16T19:40:05.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f56737fe700 1 -- 172.21.15.29:0/3428902531 learned_addr learned my addr 172.21.15.29:0/3428902531 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.470+0000 7f5678dca700 1 --2- 172.21.15.29:0/3428902531 >> v2:172.21.15.53:3300/0 conn(0x7f567406adc0 0x7f5674158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5672ffd700 1 -- 172.21.15.29:0/3428902531 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469532663 0 0) 0x7f567406e780 con 0x7f5674154a50 2023-10-16T19:40:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5672ffd700 1 -- 172.21.15.29:0/3428902531 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f565c0035b0 con 0x7f5674154a50 2023-10-16T19:40:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5673fff700 1 -- 172.21.15.29:0/3428902531 >> v2:172.21.15.53:3300/0 conn(0x7f567406adc0 msgr2=0x7f5674158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5673fff700 1 --2- 172.21.15.29:0/3428902531 >> v2:172.21.15.53:3300/0 conn(0x7f567406adc0 0x7f5674158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5673fff700 1 -- 172.21.15.29:0/3428902531 >> v1:172.21.15.29:6789/0 conn(0x7f5674154a50 legacy=0x7f56741583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5673fff700 1 -- 172.21.15.29:0/3428902531 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56741551f0 con 0x7f567413d660 2023-10-16T19:40:05.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5673fff700 1 --2- 172.21.15.29:0/3428902531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f567413d660 0x7f567406a880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f567406fe60 tx=0x7f5664009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5f7b432daef6e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5672ffd700 1 -- 172.21.15.29:0/3428902531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664011830 con 0x7f567413d660 2023-10-16T19:40:05.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5672ffd700 1 -- 172.21.15.29:0/3428902531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664011990 con 0x7f567413d660 2023-10-16T19:40:05.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f5672ffd700 1 -- 172.21.15.29:0/3428902531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664011d20 con 0x7f567413d660 2023-10-16T19:40:05.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f567a82d700 1 -- 172.21.15.29:0/3428902531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f567413d660 msgr2=0x7f567406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f567a82d700 1 --2- 172.21.15.29:0/3428902531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f567413d660 0x7f567406a880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f567406fe60 tx=0x7f5664009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:05.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f567a82d700 1 -- 172.21.15.29:0/3428902531 shutdown_connections 2023-10-16T19:40:05.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f567a82d700 1 --2- 172.21.15.29:0/3428902531 >> v2:172.21.15.53:3300/0 conn(0x7f567406adc0 0x7f5674158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.471+0000 7f567a82d700 1 --2- 172.21.15.29:0/3428902531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f567413d660 0x7f567406a880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.472+0000 7f567a82d700 1 -- 172.21.15.29:0/3428902531 >> 172.21.15.29:0/3428902531 conn(0x7f56740c7110 msgr2=0x7f56740c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:05.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.472+0000 7f567a82d700 1 -- 172.21.15.29:0/3428902531 shutdown_connections 2023-10-16T19:40:05.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.472+0000 7f567a82d700 1 -- 172.21.15.29:0/3428902531 wait complete. 2023-10-16T19:40:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.473+0000 7f567a82d700 1 Processor -- start 2023-10-16T19:40:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.473+0000 7f567a82d700 1 -- start start 2023-10-16T19:40:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f567406adc0 0x7f567413a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f567413d660 0x7f56741ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567413c420 con 0x7f5674154a50 2023-10-16T19:40:05.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741e9720 con 0x7f567413d660 2023-10-16T19:40:05.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56741edce0 con 0x7f567406adc0 2023-10-16T19:40:05.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51412/0 (socket says 172.21.15.29:51412) 2023-10-16T19:40:05.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 -- 172.21.15.29:0/3102692849 learned_addr learned my addr 172.21.15.29:0/3102692849 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:05.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5673fff700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f567406adc0 0x7f567413a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f56737fe700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f567413d660 0x7f56741ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 -- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f567406adc0 msgr2=0x7f567413a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f567406adc0 0x7f567413a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 -- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f567413d660 msgr2=0x7f56741ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f567413d660 0x7f56741ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 -- 172.21.15.29:0/3102692849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56640094a0 con 0x7f5674154a50 2023-10-16T19:40:05.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5678dca700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f566c009dd0 tx=0x7f566c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c009c40 con 0x7f5674154a50 2023-10-16T19:40:05.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00f040 con 0x7f5674154a50 2023-10-16T19:40:05.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56741e9c60 con 0x7f5674154a50 2023-10-16T19:40:05.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c00ceb0 con 0x7f5674154a50 2023-10-16T19:40:05.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.474+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5674139b00 con 0x7f5674154a50 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.475+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56741e9df0 con 0x7f5674154a50 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.476+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f566c014480 con 0x7f5674154a50 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.476+0000 7f5670ff9700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 0x7f566006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.476+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f566c08a0d0 con 0x7f5674154a50 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.476+0000 7f5673fff700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 0x7f566006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.477+0000 7f5673fff700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 0x7f566006d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56640090b0 tx=0x7f5664008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.481+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f566c054f20 con 0x7f5674154a50 2023-10-16T19:40:05.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.681+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56740c3760 con 0x7f5674154a50 2023-10-16T19:40:05.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.681+0000 7f5670ff9700 1 -- 172.21.15.29:0/3102692849 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f566c058540 con 0x7f5674154a50 2023-10-16T19:40:05.684 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 msgr2=0x7f566006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 0x7f566006d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56640090b0 tx=0x7f5664008030 comp rx=0 tx=0).stop 2023-10-16T19:40:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 msgr2=0x7f56740c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f566c009dd0 tx=0x7f566c00c3a0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 shutdown_connections 2023-10-16T19:40:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f566006af00 0x7f566006d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5674154a50 0x7f56740c5dc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f567406adc0 0x7f567413a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 --2- 172.21.15.29:0/3102692849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f567413d660 0x7f56741ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 >> 172.21.15.29:0/3102692849 conn(0x7f56740c7110 msgr2=0x7f56740c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:05.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 shutdown_connections 2023-10-16T19:40:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.684+0000 7f567a82d700 1 -- 172.21.15.29:0/3102692849 wait complete. 2023-10-16T19:40:05.698 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:05.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.823+0000 7fa9092b2700 1 Processor -- start 2023-10-16T19:40:05.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.823+0000 7fa9092b2700 1 -- start start 2023-10-16T19:40:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9092b2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa9040ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9092b2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa904153710 con 0x7fa904153290 2023-10-16T19:40:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9092b2700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa904156c60 con 0x7fa90406a880 2023-10-16T19:40:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9092b2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040ac7d0 con 0x7fa90414c780 2023-10-16T19:40:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9027fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa904153290 0x7fa90406d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36862/0 (socket says 172.21.15.29:36862) 2023-10-16T19:40:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa9027fc700 1 -- 172.21.15.29:0/367902067 learned_addr learned my addr 172.21.15.29:0/367902067 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.824+0000 7fa902ffd700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa9040ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573998953 0 0) 0x7fa904153710 con 0x7fa904153290 2023-10-16T19:40:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ec0035b0 con 0x7fa904153290 2023-10-16T19:40:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916027761 0 0) 0x7fa904156c60 con 0x7fa90406a880 2023-10-16T19:40:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa904153710 con 0x7fa90406a880 2023-10-16T19:40:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3177857531 0 0) 0x7fa8ec0035b0 con 0x7fa904153290 2023-10-16T19:40:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 msgr2=0x7fa9040ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa9040ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 >> v1:172.21.15.53:6789/0 conn(0x7fa90406a880 legacy=0x7fa90406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904155ea0 con 0x7fa904153290 2023-10-16T19:40:05.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fa8f4001670 con 0x7fa904153290 2023-10-16T19:40:05.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 >> v1:172.21.15.29:6789/0 conn(0x7fa904153290 legacy=0x7fa90406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec003bc0 0x7fa8ec003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa8ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8ec004d90 0x7fa8ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040ac7d0 con 0x7fa8ec004d90 2023-10-16T19:40:05.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec00bb10 con 0x7fa8ec003bc0 2023-10-16T19:40:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec00bcd0 con 0x7fa90414c780 2023-10-16T19:40:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa902ffd700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec003bc0 0x7fa8ec003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa9037fe700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8ec004d90 0x7fa8ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa9027fc700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa8ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa9037fe700 1 -- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 msgr2=0x7fa8ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa9037fe700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90414c780 0x7fa8ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.825+0000 7fa9037fe700 1 -- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec003bc0 msgr2=0x7fa8ec003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9037fe700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec003bc0 0x7fa8ec003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9037fe700 1 -- 172.21.15.29:0/367902067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0035b0 con 0x7fa8ec004d90 2023-10-16T19:40:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9037fe700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8ec004d90 0x7fa8ec005210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c2f0 tx=0x7fa8ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5b70d2fb2e5da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc001f30 con 0x7fa8ec004d90 2023-10-16T19:40:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc00ce90 con 0x7fa8ec004d90 2023-10-16T19:40:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa901ffb700 1 -- 172.21.15.29:0/367902067 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc003c40 con 0x7fa8ec004d90 2023-10-16T19:40:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 -- 172.21.15.29:0/367902067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8ec004d90 msgr2=0x7fa8ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 --2- 172.21.15.29:0/367902067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8ec004d90 0x7fa8ec005210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c2f0 tx=0x7fa8ec005880 comp rx=0 tx=0).stop 2023-10-16T19:40:05.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9037fe700 1 -- 172.21.15.29:0/367902067 reap_dead start 2023-10-16T19:40:05.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 -- 172.21.15.29:0/367902067 shutdown_connections 2023-10-16T19:40:05.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 -- 172.21.15.29:0/367902067 >> 172.21.15.29:0/367902067 conn(0x7fa9040c66d0 msgr2=0x7fa9040c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:05.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 -- 172.21.15.29:0/367902067 shutdown_connections 2023-10-16T19:40:05.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.826+0000 7fa9092b2700 1 -- 172.21.15.29:0/367902067 wait complete. 2023-10-16T19:40:05.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.828+0000 7fa9092b2700 1 Processor -- start 2023-10-16T19:40:05.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.828+0000 7fa9092b2700 1 -- start start 2023-10-16T19:40:05.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec004d90 0x7fa9040c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 0x7fa9041540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90413cff0 con 0x7fa904154620 2023-10-16T19:40:05.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c3150 con 0x7fa8ec004d90 2023-10-16T19:40:05.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9092b2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c1a00 con 0x7fa9040c38d0 2023-10-16T19:40:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51432/0 (socket says 172.21.15.29:51432) 2023-10-16T19:40:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9037fe700 1 -- 172.21.15.29:0/891367784 learned_addr learned my addr 172.21.15.29:0/891367784 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa902ffd700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec004d90 0x7fa9040c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.829+0000 7fa9027fc700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 0x7fa9041540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 -- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 msgr2=0x7fa9041540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 0x7fa9041540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 -- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec004d90 msgr2=0x7fa9040c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec004d90 0x7fa9040c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 -- 172.21.15.29:0/891367784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040c1ce0 con 0x7fa904154620 2023-10-16T19:40:05.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9027fc700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 0x7fa9041540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:05.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9037fe700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc004000 tx=0x7fa8fc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0013e0 con 0x7fa904154620 2023-10-16T19:40:05.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc0050d0 con 0x7fa904154620 2023-10-16T19:40:05.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc005480 con 0x7fa904154620 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9040c2050 con 0x7fa904154620 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.830+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9040c3d50 con 0x7fa904154620 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.831+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9040c1e70 con 0x7fa904154620 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.831+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8fc019070 con 0x7fa904154620 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.832+0000 7fa8eb7fe700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 0x7fa8f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:05.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.832+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8fc08a780 con 0x7fa904154620 2023-10-16T19:40:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.832+0000 7fa902ffd700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 0x7fa8f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.832+0000 7fa902ffd700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 0x7fa8f006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa904141210 tx=0x7fa8f8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:05.837+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8fc0556f0 con 0x7fa904154620 2023-10-16T19:40:06.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.035+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa90404f400 con 0x7fa904154620 2023-10-16T19:40:06.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.036+0000 7fa8eb7fe700 1 -- 172.21.15.29:0/891367784 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa8fc0011c0 con 0x7fa904154620 2023-10-16T19:40:06.039 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:06.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.037+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 msgr2=0x7fa8f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.037+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 0x7fa8f006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa904141210 tx=0x7fa8f8009210 comp rx=0 tx=0).stop 2023-10-16T19:40:06.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 msgr2=0x7fa90413bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc004000 tx=0x7fa8fc001650 comp rx=0 tx=0).stop 2023-10-16T19:40:06.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 shutdown_connections 2023-10-16T19:40:06.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8f006af00 0x7fa8f006d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa904154620 0x7fa90413bfc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8ec004d90 0x7fa9040c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 --2- 172.21.15.29:0/891367784 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9040c38d0 0x7fa9041540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 >> 172.21.15.29:0/891367784 conn(0x7fa9040c66d0 msgr2=0x7fa90406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 shutdown_connections 2023-10-16T19:40:06.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.038+0000 7fa9092b2700 1 -- 172.21.15.29:0/891367784 wait complete. 2023-10-16T19:40:06.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:40:06.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.175+0000 7f313b58f700 1 Processor -- start 2023-10-16T19:40:06.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.175+0000 7f313b58f700 1 -- start start 2023-10-16T19:40:06.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f313b58f700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3134152190 0x7f31340c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f313b58f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313406bac0 con 0x7f313406d670 2023-10-16T19:40:06.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f313b58f700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31341559d0 con 0x7f31340bd650 2023-10-16T19:40:06.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f313b58f700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31341554e0 con 0x7f3134152190 2023-10-16T19:40:06.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f3138b2a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f313406d670 0x7f31340bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36880/0 (socket says 172.21.15.29:36880) 2023-10-16T19:40:06.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f3138b2a700 1 -- 172.21.15.29:0/1581710647 learned_addr learned my addr 172.21.15.29:0/1581710647 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:06.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f313932b700 1 --2- 172.21.15.29:0/1581710647 >> v2:172.21.15.53:3300/0 conn(0x7f3134152190 0x7f31340c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604881064 0 0) 0x7f313406bac0 con 0x7f313406d670 2023-10-16T19:40:06.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.176+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31200035b0 con 0x7f313406d670 2023-10-16T19:40:06.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f313932b700 1 -- 172.21.15.29:0/1581710647 >> v1:172.21.15.53:6789/0 conn(0x7f31340bd650 legacy=0x7f31340c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818911989 0 0) 0x7f31200035b0 con 0x7f313406d670 2023-10-16T19:40:06.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f313932b700 1 -- 172.21.15.29:0/1581710647 >> v1:172.21.15.29:6789/0 conn(0x7f313406d670 legacy=0x7f31340bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f313932b700 1 -- 172.21.15.29:0/1581710647 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340c6c20 con 0x7f3134152190 2023-10-16T19:40:06.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f313932b700 1 --2- 172.21.15.29:0/1581710647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3134152190 0x7f31340c7b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3124009840 tx=0x7f3124009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9623d103ba51dcb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130001670 con 0x7f3134152190 2023-10-16T19:40:06.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124004030 con 0x7f3134152190 2023-10-16T19:40:06.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.177+0000 7f312bfff700 1 -- 172.21.15.29:0/1581710647 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240043c0 con 0x7f3134152190 2023-10-16T19:40:06.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 -- 172.21.15.29:0/1581710647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3134152190 msgr2=0x7f31340c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 --2- 172.21.15.29:0/1581710647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3134152190 0x7f31340c7b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3124009840 tx=0x7f3124009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 -- 172.21.15.29:0/1581710647 shutdown_connections 2023-10-16T19:40:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 --2- 172.21.15.29:0/1581710647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3134152190 0x7f31340c7b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 -- 172.21.15.29:0/1581710647 >> 172.21.15.29:0/1581710647 conn(0x7f31340a9cd0 msgr2=0x7f31340aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 -- 172.21.15.29:0/1581710647 shutdown_connections 2023-10-16T19:40:06.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.178+0000 7f313b58f700 1 -- 172.21.15.29:0/1581710647 wait complete. 2023-10-16T19:40:06.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.179+0000 7f313b58f700 1 Processor -- start 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.179+0000 7f313b58f700 1 -- start start 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.179+0000 7f313b58f700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f313406d670 0x7f31341ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.179+0000 7f313b58f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31340bd650 0x7f31341ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313b58f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313b58f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341eddb0 con 0x7f3134152190 2023-10-16T19:40:06.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313b58f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341567c0 con 0x7f31340bd650 2023-10-16T19:40:06.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313b58f700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31341edf90 con 0x7f313406d670 2023-10-16T19:40:06.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51446/0 (socket says 172.21.15.29:51446) 2023-10-16T19:40:06.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 -- 172.21.15.29:0/1099764029 learned_addr learned my addr 172.21.15.29:0/1099764029 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:06.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313932b700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f313406d670 0x7f31341ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3138b2a700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31340bd650 0x7f31341ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 -- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f313406d670 msgr2=0x7f31341ed330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f313406d670 0x7f31341ed330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 -- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31340bd650 msgr2=0x7f31341ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31340bd650 0x7f31341ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 -- 172.21.15.29:0/1099764029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240094a0 con 0x7f3134152190 2023-10-16T19:40:06.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3139b2c700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f312c00cc80 tx=0x7f312c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c003c00 con 0x7f3134152190 2023-10-16T19:40:06.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c003d60 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313406c0d0 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.180+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00aaa0 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.181+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31341eb370 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.182+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313406bf30 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.182+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f312c00ac00 con 0x7f3134152190 2023-10-16T19:40:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.182+0000 7f3129ffb700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.183+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f312c089930 con 0x7f3134152190 2023-10-16T19:40:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.183+0000 7f313932b700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.183+0000 7f313932b700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 0x7f311806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f312400a010 tx=0x7f3124008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.187+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f313406bf30 con 0x7f3134152190 2023-10-16T19:40:06.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.400+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31341ebb70 con 0x7f3134152190 2023-10-16T19:40:06.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.400+0000 7f3129ffb700 1 -- 172.21.15.29:0/1099764029 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31341ebb70 con 0x7f3134152190 2023-10-16T19:40:06.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 msgr2=0x7f311806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 0x7f311806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f312400a010 tx=0x7f3124008030 comp rx=0 tx=0).stop 2023-10-16T19:40:06.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 msgr2=0x7f31341ebe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f312c00cc80 tx=0x7f312c00cf90 comp rx=0 tx=0).stop 2023-10-16T19:40:06.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 shutdown_connections 2023-10-16T19:40:06.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f311806af00 0x7f311806d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3134152190 0x7f31341ebe50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f313406d670 0x7f31341ed330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 --2- 172.21.15.29:0/1099764029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31340bd650 0x7f31341ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 >> 172.21.15.29:0/1099764029 conn(0x7f31340a9cd0 msgr2=0x7f31340aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 shutdown_connections 2023-10-16T19:40:06.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.403+0000 7f313b58f700 1 -- 172.21.15.29:0/1099764029 wait complete. 2023-10-16T19:40:06.408 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2023-10-16T19:40:06.418 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:06.418 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:06.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.598+0000 7f7a840c1700 1 Processor -- start 2023-10-16T19:40:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.598+0000 7f7a840c1700 1 -- start start 2023-10-16T19:40:06.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a840c1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a7c14ec50 0x7f7a7c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a840c1700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a7c06db00 0x7f7a7c06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a840c1700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c155af0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a840c1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c152300 con 0x7f7a7c14ec50 2023-10-16T19:40:06.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a840c1700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c2e40 con 0x7f7a7c06db00 2023-10-16T19:40:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a7c14ec50 0x7f7a7c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a8165c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7a7c0c3350 0x7f7a7c071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36894/0 (socket says 172.21.15.29:36894) 2023-10-16T19:40:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a8165c700 1 -- 172.21.15.29:0/2020364234 learned_addr learned my addr 172.21.15.29:0/2020364234 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a8265e700 1 --2- 172.21.15.29:0/2020364234 >> v2:172.21.15.53:3300/0 conn(0x7f7a7c06db00 0x7f7a7c06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 -- 172.21.15.29:0/2020364234 >> v2:172.21.15.53:3300/0 conn(0x7f7a7c06db00 msgr2=0x7f7a7c06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/2020364234 >> v2:172.21.15.53:3300/0 conn(0x7f7a7c06db00 0x7f7a7c06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 -- 172.21.15.29:0/2020364234 >> v1:172.21.15.29:6789/0 conn(0x7f7a7c0c3350 legacy=0x7f7a7c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 -- 172.21.15.29:0/2020364234 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c14f030 con 0x7f7a7c14ec50 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.599+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/2020364234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c1555b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c068e40 tx=0x7f7a6c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3785a50f72d19d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a80e5b700 1 -- 172.21.15.29:0/2020364234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011830 con 0x7f7a7c14ec50 2023-10-16T19:40:06.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a80e5b700 1 -- 172.21.15.29:0/2020364234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c011990 con 0x7f7a7c14ec50 2023-10-16T19:40:06.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a80e5b700 1 -- 172.21.15.29:0/2020364234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011d20 con 0x7f7a7c14ec50 2023-10-16T19:40:06.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 -- 172.21.15.29:0/2020364234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c14ec50 msgr2=0x7f7a7c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 --2- 172.21.15.29:0/2020364234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c1555b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c068e40 tx=0x7f7a6c009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 -- 172.21.15.29:0/2020364234 shutdown_connections 2023-10-16T19:40:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 --2- 172.21.15.29:0/2020364234 >> v2:172.21.15.53:3300/0 conn(0x7f7a7c06db00 0x7f7a7c06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 --2- 172.21.15.29:0/2020364234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c1555b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 -- 172.21.15.29:0/2020364234 >> 172.21.15.29:0/2020364234 conn(0x7f7a7c0c7110 msgr2=0x7f7a7c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 -- 172.21.15.29:0/2020364234 shutdown_connections 2023-10-16T19:40:06.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.600+0000 7f7a840c1700 1 -- 172.21.15.29:0/2020364234 wait complete. 2023-10-16T19:40:06.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.601+0000 7f7a840c1700 1 Processor -- start 2023-10-16T19:40:06.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.601+0000 7f7a840c1700 1 -- start start 2023-10-16T19:40:06.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 0x7f7a7c0c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1555b0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c15ecd0 con 0x7f7a7c14ec50 2023-10-16T19:40:06.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a840c1700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c145190 con 0x7f7a7c06db00 2023-10-16T19:40:06.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8165c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8165c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51458/0 (socket says 172.21.15.29:51458) 2023-10-16T19:40:06.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8165c700 1 -- 172.21.15.29:0/3637094811 learned_addr learned my addr 172.21.15.29:0/3637094811 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:06.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8265e700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 0x7f7a7c0c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8165c700 1 -- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 msgr2=0x7f7a7c0c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.602+0000 7f7a8165c700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 0x7f7a7c0c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a8165c700 1 -- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 msgr2=0x7f7a7c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a8165c700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a8165c700 1 -- 172.21.15.29:0/3637094811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0094a0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 0x7f7a7c0c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:06.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a8265e700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:06.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a8165c700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c530 tx=0x7f7a7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78005d70 con 0x7f7a7c0c3350 2023-10-16T19:40:06.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a780070d0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c1557c0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78007440 con 0x7f7a7c0c3350 2023-10-16T19:40:06.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.603+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0c0a90 con 0x7f7a7c0c3350 2023-10-16T19:40:06.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.604+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c15ee80 con 0x7f7a7c0c3350 2023-10-16T19:40:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.604+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a780075a0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.605+0000 7f7a727fc700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 0x7f7a6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.605+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a78088b20 con 0x7f7a7c0c3350 2023-10-16T19:40:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.605+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 0x7f7a6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.605+0000 7f7a81e5d700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 0x7f7a6006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0090b0 tx=0x7f7a6c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.609+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a7c15ee80 con 0x7f7a7c0c3350 2023-10-16T19:40:06.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.810+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a7c155af0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.812+0000 7f7a727fc700 1 -- 172.21.15.29:0/3637094811 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f7a7c155af0 con 0x7f7a7c0c3350 2023-10-16T19:40:06.814 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:06.814 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:06.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.813+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 msgr2=0x7f7a6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.813+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 0x7f7a6006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0090b0 tx=0x7f7a6c008030 comp rx=0 tx=0).stop 2023-10-16T19:40:06.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 msgr2=0x7f7a7c144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c530 tx=0x7f7a7800c8f0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 shutdown_connections 2023-10-16T19:40:06.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7a6006af00 0x7f7a6006d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a7c14ec50 0x7f7a7c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7a7c06db00 0x7f7a7c0c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 --2- 172.21.15.29:0/3637094811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7c0c3350 0x7f7a7c144330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 >> 172.21.15.29:0/3637094811 conn(0x7f7a7c0c7110 msgr2=0x7f7a7c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 shutdown_connections 2023-10-16T19:40:06.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.814+0000 7f7a840c1700 1 -- 172.21.15.29:0/3637094811 wait complete. 2023-10-16T19:40:06.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:06.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:06.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.954+0000 7fd9f3301700 1 Processor -- start 2023-10-16T19:40:06.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.954+0000 7fd9f3301700 1 -- start start 2023-10-16T19:40:06.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f3301700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c4f50 0x7fd9ec153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f3301700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd9ec0c7bb0 0x7fd9ec070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f3301700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec0bd0e0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f3301700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec0c3000 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f3301700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0c5330 con 0x7fd9ec0c4f50 2023-10-16T19:40:06.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f089c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd9ec0c7bb0 0x7fd9ec070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f189e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd9ec070ac0 0x7fd9ec155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36912/0 (socket says 172.21.15.29:36912) 2023-10-16T19:40:06.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f189e700 1 -- 172.21.15.29:0/3907936082 learned_addr learned my addr 172.21.15.29:0/3907936082 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:06.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.955+0000 7fd9f109d700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c4f50 0x7fd9ec153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f089c700 1 -- 172.21.15.29:0/3907936082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c4f50 msgr2=0x7fd9ec153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:06.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f089c700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c4f50 0x7fd9ec153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f089c700 1 -- 172.21.15.29:0/3907936082 >> v1:172.21.15.29:6789/0 conn(0x7fd9ec070ac0 legacy=0x7fd9ec155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9e3fff700 1 -- 172.21.15.29:0/3907936082 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004069541 0 0) 0x7fd9ec0bd0e0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f089c700 1 -- 172.21.15.29:0/3907936082 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0c2a40 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f089c700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec0c7bb0 0x7fd9ec070580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009840 tx=0x7fd9e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fff47aa41795609 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9e3fff700 1 -- 172.21.15.29:0/3907936082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8011830 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9e3fff700 1 -- 172.21.15.29:0/3907936082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8011990 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9e3fff700 1 -- 172.21.15.29:0/3907936082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8011d20 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f3301700 1 -- 172.21.15.29:0/3907936082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec0c7bb0 msgr2=0x7fd9ec070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.956+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec0c7bb0 0x7fd9ec070580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009840 tx=0x7fd9e8009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 -- 172.21.15.29:0/3907936082 shutdown_connections 2023-10-16T19:40:06.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c4f50 0x7fd9ec153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3907936082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec0c7bb0 0x7fd9ec070580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 -- 172.21.15.29:0/3907936082 >> 172.21.15.29:0/3907936082 conn(0x7fd9ec0a9cd0 msgr2=0x7fd9ec0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:06.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 -- 172.21.15.29:0/3907936082 shutdown_connections 2023-10-16T19:40:06.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.957+0000 7fd9f3301700 1 -- 172.21.15.29:0/3907936082 wait complete. 2023-10-16T19:40:06.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 Processor -- start 2023-10-16T19:40:06.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 -- start start 2023-10-16T19:40:06.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9ec0c4f50 0x7fd9ec1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c7bb0 0x7fd9ec0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0adcc0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec154cd0 con 0x7fd9ec0c4f50 2023-10-16T19:40:06.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.958+0000 7fd9f3301700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec156870 con 0x7fd9ec0c7bb0 2023-10-16T19:40:06.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51470/0 (socket says 172.21.15.29:51470) 2023-10-16T19:40:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 -- 172.21.15.29:0/3867945701 learned_addr learned my addr 172.21.15.29:0/3867945701 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f189e700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c7bb0 0x7fd9ec0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f089c700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9ec0c4f50 0x7fd9ec1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 -- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c7bb0 msgr2=0x7fd9ec0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c7bb0 0x7fd9ec0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 -- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9ec0c4f50 msgr2=0x7fd9ec1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:06.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9ec0c4f50 0x7fd9ec1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:06.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 -- 172.21.15.29:0/3867945701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80094a0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f109d700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00e9b0 tx=0x7fd9dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc009710 con 0x7fd9ec070ac0 2023-10-16T19:40:06.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00ee50 con 0x7fd9ec070ac0 2023-10-16T19:40:06.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec0ad790 con 0x7fd9ec070ac0 2023-10-16T19:40:06.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00ca50 con 0x7fd9ec070ac0 2023-10-16T19:40:06.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.959+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec0ad9e0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.960+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec04f400 con 0x7fd9ec070ac0 2023-10-16T19:40:06.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.961+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd9dc00cbb0 con 0x7fd9ec070ac0 2023-10-16T19:40:06.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.961+0000 7fd9e1ffb700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 0x7fd9d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:06.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.961+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9dc089b80 con 0x7fd9ec070ac0 2023-10-16T19:40:06.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.961+0000 7fd9f089c700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 0x7fd9d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:06.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.962+0000 7fd9f089c700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 0x7fd9d006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80090b0 tx=0x7fd9e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:06.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:06.966+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9dc0549d0 con 0x7fd9ec070ac0 2023-10-16T19:40:07.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.163+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9ec0aa5a0 con 0x7fd9ec070ac0 2023-10-16T19:40:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.164+0000 7fd9e1ffb700 1 -- 172.21.15.29:0/3867945701 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9dc0170a0 con 0x7fd9ec070ac0 2023-10-16T19:40:07.166 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:07.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 msgr2=0x7fd9d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 0x7fd9d006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80090b0 tx=0x7fd9e8008030 comp rx=0 tx=0).stop 2023-10-16T19:40:07.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 msgr2=0x7fd9ec14b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00e9b0 tx=0x7fd9dc00ecc0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 shutdown_connections 2023-10-16T19:40:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd9d006af00 0x7fd9d006d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9ec0c7bb0 0x7fd9ec0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9ec070ac0 0x7fd9ec14b3f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 --2- 172.21.15.29:0/3867945701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9ec0c4f50 0x7fd9ec1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 >> 172.21.15.29:0/3867945701 conn(0x7fd9ec0a9cd0 msgr2=0x7fd9ec06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 shutdown_connections 2023-10-16T19:40:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.166+0000 7fd9f3301700 1 -- 172.21.15.29:0/3867945701 wait complete. 2023-10-16T19:40:07.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.305+0000 7f56621b2700 1 Processor -- start 2023-10-16T19:40:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.305+0000 7f56621b2700 1 -- start start 2023-10-16T19:40:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f56621b2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f56621b2700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f565c0c7c10 0x7f565c0a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f56621b2700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c158e30 con 0x7f565c0c2a40 2023-10-16T19:40:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f56621b2700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c158b50 con 0x7f565c0c7c10 2023-10-16T19:40:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f56621b2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c06ba30 con 0x7f565c0be280 2023-10-16T19:40:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f565b7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f565b7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:43932/0 (socket says 172.21.15.29:43932) 2023-10-16T19:40:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f565b7fe700 1 -- 172.21.15.29:0/909604005 learned_addr learned my addr 172.21.15.29:0/909604005 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.306+0000 7f565bfff700 1 --2- 172.21.15.29:0/909604005 >> v2:172.21.15.53:3300/0 conn(0x7f565c0c7c10 0x7f565c0a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565b7fe700 1 -- 172.21.15.29:0/909604005 >> v2:172.21.15.53:3300/0 conn(0x7f565c0c7c10 msgr2=0x7f565c0a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565b7fe700 1 --2- 172.21.15.29:0/909604005 >> v2:172.21.15.53:3300/0 conn(0x7f565c0c7c10 0x7f565c0a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565b7fe700 1 -- 172.21.15.29:0/909604005 >> v1:172.21.15.53:6789/0 conn(0x7f565c0c2a40 legacy=0x7f565c0a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565b7fe700 1 -- 172.21.15.29:0/909604005 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c06bd10 con 0x7f565c0be280 2023-10-16T19:40:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565b7fe700 1 --2- 172.21.15.29:0/909604005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f564c0098f0 tx=0x7f564c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45bceb9ed52f8572 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565a7fc700 1 -- 172.21.15.29:0/909604005 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011830 con 0x7f565c0be280 2023-10-16T19:40:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565a7fc700 1 -- 172.21.15.29:0/909604005 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c011990 con 0x7f565c0be280 2023-10-16T19:40:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f565a7fc700 1 -- 172.21.15.29:0/909604005 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011d20 con 0x7f565c0be280 2023-10-16T19:40:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f56621b2700 1 -- 172.21.15.29:0/909604005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 msgr2=0x7f565c0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.307+0000 7f56621b2700 1 --2- 172.21.15.29:0/909604005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f564c0098f0 tx=0x7f564c009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 -- 172.21.15.29:0/909604005 shutdown_connections 2023-10-16T19:40:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 --2- 172.21.15.29:0/909604005 >> v2:172.21.15.53:3300/0 conn(0x7f565c0c7c10 0x7f565c0a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 --2- 172.21.15.29:0/909604005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0be280 0x7f565c0c4ad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 -- 172.21.15.29:0/909604005 >> 172.21.15.29:0/909604005 conn(0x7f565c0a9cd0 msgr2=0x7f565c0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 -- 172.21.15.29:0/909604005 shutdown_connections 2023-10-16T19:40:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.308+0000 7f56621b2700 1 -- 172.21.15.29:0/909604005 wait complete. 2023-10-16T19:40:07.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.309+0000 7f56621b2700 1 Processor -- start 2023-10-16T19:40:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.309+0000 7f56621b2700 1 -- start start 2023-10-16T19:40:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 0x7f565c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 0x7f565c14e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0bfc10 con 0x7f565c0be280 2023-10-16T19:40:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c070900 con 0x7f565c0c7c10 2023-10-16T19:40:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f56621b2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c06f010 con 0x7f565c0c2a40 2023-10-16T19:40:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f565b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f565b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51484/0 (socket says 172.21.15.29:51484) 2023-10-16T19:40:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f565b7fe700 1 -- 172.21.15.29:0/1052032928 learned_addr learned my addr 172.21.15.29:0/1052032928 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f565bfff700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 0x7f565c14e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.310+0000 7f565affd700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 0x7f565c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 -- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 msgr2=0x7f565c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 0x7f565c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 -- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 msgr2=0x7f565c14e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 0x7f565c14e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 -- 172.21.15.29:0/1052032928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009550 con 0x7f565c0be280 2023-10-16T19:40:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565bfff700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 0x7f565c14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565affd700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 0x7f565c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f565b7fe700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f564c009c40 tx=0x7f564c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c004530 con 0x7f565c0be280 2023-10-16T19:40:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c01f070 con 0x7f565c0be280 2023-10-16T19:40:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c0bf650 con 0x7f565c0be280 2023-10-16T19:40:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0038c0 con 0x7f565c0be280 2023-10-16T19:40:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.311+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c06eca0 con 0x7f565c0be280 2023-10-16T19:40:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.312+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c06eb00 con 0x7f565c0be280 2023-10-16T19:40:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.313+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f564c021030 con 0x7f565c0be280 2023-10-16T19:40:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.313+0000 7f5653fff700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 0x7f563c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.313+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f564c08ace0 con 0x7f565c0be280 2023-10-16T19:40:07.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.313+0000 7f565affd700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 0x7f563c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.314+0000 7f565affd700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 0x7f563c06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f565c1e7ab0 tx=0x7f5644009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.317+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f565c06eb00 con 0x7f565c0be280 2023-10-16T19:40:07.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.520+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f565c06eb00 con 0x7f565c0be280 2023-10-16T19:40:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.521+0000 7f5653fff700 1 -- 172.21.15.29:0/1052032928 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f565c06eb00 con 0x7f565c0be280 2023-10-16T19:40:07.523 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:07.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.522+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 msgr2=0x7f563c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.522+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 0x7f563c06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f565c1e7ab0 tx=0x7f5644009040 comp rx=0 tx=0).stop 2023-10-16T19:40:07.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.522+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 msgr2=0x7f565c0c1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.522+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f564c009c40 tx=0x7f564c004750 comp rx=0 tx=0).stop 2023-10-16T19:40:07.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 shutdown_connections 2023-10-16T19:40:07.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f563c06af00 0x7f563c06d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f565c0c7c10 0x7f565c14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f565c0be280 0x7f565c0c1d60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 --2- 172.21.15.29:0/1052032928 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f565c0c2a40 0x7f565c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 >> 172.21.15.29:0/1052032928 conn(0x7f565c0a9cd0 msgr2=0x7f565c0bd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:07.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 shutdown_connections 2023-10-16T19:40:07.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.523+0000 7f56621b2700 1 -- 172.21.15.29:0/1052032928 wait complete. 2023-10-16T19:40:07.536 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:07.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.662+0000 7ffb157fd700 1 Processor -- start 2023-10-16T19:40:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.662+0000 7ffb157fd700 1 -- start start 2023-10-16T19:40:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb157fd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c4f50 0x7ffb10153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb157fd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb10155e00 0x7ffb10156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb157fd700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb100bd0e0 con 0x7ffb100c7bb0 2023-10-16T19:40:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb157fd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb100c3000 con 0x7ffb10155e00 2023-10-16T19:40:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb157fd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100c5330 con 0x7ffb100c4f50 2023-10-16T19:40:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb10155e00 0x7ffb10156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb10155e00 0x7ffb10156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51494/0 (socket says 172.21.15.29:51494) 2023-10-16T19:40:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0e7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb100c7bb0 0x7ffb10070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:59762/0 (socket says 172.21.15.29:59762) 2023-10-16T19:40:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 -- 172.21.15.29:0/55406425 learned_addr learned my addr 172.21.15.29:0/55406425 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0effd700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c4f50 0x7ffb10153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 -- 172.21.15.29:0/55406425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c4f50 msgr2=0x7ffb10153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c4f50 0x7ffb10153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 -- 172.21.15.29:0/55406425 >> v1:172.21.15.53:6789/0 conn(0x7ffb100c7bb0 legacy=0x7ffb10070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.663+0000 7ffb0f7fe700 1 -- 172.21.15.29:0/55406425 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100c2a40 con 0x7ffb10155e00 2023-10-16T19:40:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb0f7fe700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb10155e00 0x7ffb10156290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009e50 tx=0x7ffb0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0948860ecbb7f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb0dffb700 1 -- 172.21.15.29:0/55406425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800e070 con 0x7ffb10155e00 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb0dffb700 1 -- 172.21.15.29:0/55406425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800b910 con 0x7ffb10155e00 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb0dffb700 1 -- 172.21.15.29:0/55406425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800bcc0 con 0x7ffb10155e00 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 -- 172.21.15.29:0/55406425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb10155e00 msgr2=0x7ffb10156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb10155e00 0x7ffb10156290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009e50 tx=0x7ffb0800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:07.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 -- 172.21.15.29:0/55406425 shutdown_connections 2023-10-16T19:40:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb10155e00 0x7ffb10156290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 --2- 172.21.15.29:0/55406425 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c4f50 0x7ffb10153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 -- 172.21.15.29:0/55406425 >> 172.21.15.29:0/55406425 conn(0x7ffb100a9cd0 msgr2=0x7ffb100aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 -- 172.21.15.29:0/55406425 shutdown_connections 2023-10-16T19:40:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.664+0000 7ffb157fd700 1 -- 172.21.15.29:0/55406425 wait complete. 2023-10-16T19:40:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 Processor -- start 2023-10-16T19:40:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 -- start start 2023-10-16T19:40:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c7bb0 0x7ffb100bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb10155e00 0x7ffb100c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100ab7f0 con 0x7ffb100c4f50 2023-10-16T19:40:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100ac5a0 con 0x7ffb10155e00 2023-10-16T19:40:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb157fd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100acbc0 con 0x7ffb100c7bb0 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51496/0 (socket says 172.21.15.29:51496) 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.666+0000 7ffb0effd700 1 -- 172.21.15.29:0/3990442570 learned_addr learned my addr 172.21.15.29:0/3990442570 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0f7fe700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb10155e00 0x7ffb100c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0e7fc700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c7bb0 0x7ffb100bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 -- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c7bb0 msgr2=0x7ffb100bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c7bb0 0x7ffb100bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 -- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb10155e00 msgr2=0x7ffb100c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb10155e00 0x7ffb100c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 -- 172.21.15.29:0/3990442570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009b30 con 0x7ffb100c4f50 2023-10-16T19:40:07.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb0effd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9b0 tx=0x7ffb0400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04009710 con 0x7ffb100c4f50 2023-10-16T19:40:07.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400ee50 con 0x7ffb100c4f50 2023-10-16T19:40:07.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb100acea0 con 0x7ffb100c4f50 2023-10-16T19:40:07.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400ca50 con 0x7ffb100c4f50 2023-10-16T19:40:07.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.667+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb100ad460 con 0x7ffb100c4f50 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.668+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10153290 con 0x7ffb100c4f50 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.669+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb0400cbb0 con 0x7ffb100c4f50 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.669+0000 7ffaf77fe700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 0x7ffafc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.669+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb040897f0 con 0x7ffb100c4f50 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.669+0000 7ffb0e7fc700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 0x7ffafc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:07.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.670+0000 7ffb0e7fc700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 0x7ffafc06d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb100bf3a0 tx=0x7ffb00007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:07.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.673+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb04054640 con 0x7ffb100c4f50 2023-10-16T19:40:07.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.872+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb1004f400 con 0x7ffb100c4f50 2023-10-16T19:40:07.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.873+0000 7ffaf77fe700 1 -- 172.21.15.29:0/3990442570 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb0400ce60 con 0x7ffb100c4f50 2023-10-16T19:40:07.875 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:07.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 msgr2=0x7ffafc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 0x7ffafc06d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb100bf3a0 tx=0x7ffb00007ed0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 msgr2=0x7ffb1014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9b0 tx=0x7ffb0400ecc0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 shutdown_connections 2023-10-16T19:40:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffafc06af00 0x7ffafc06d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb10155e00 0x7ffb100c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb100c4f50 0x7ffb1014b930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 --2- 172.21.15.29:0/3990442570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb100c7bb0 0x7ffb100bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 >> 172.21.15.29:0/3990442570 conn(0x7ffb100a9cd0 msgr2=0x7ffb100aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 shutdown_connections 2023-10-16T19:40:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:07.875+0000 7ffb157fd700 1 -- 172.21.15.29:0/3990442570 wait complete. 2023-10-16T19:40:07.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.016+0000 7f20cb9b0700 1 Processor -- start 2023-10-16T19:40:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.016+0000 7f20cb9b0700 1 -- start start 2023-10-16T19:40:08.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20cb9b0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20cb9b0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20c40c3240 0x7f20c406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20cb9b0700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c4154da0 con 0x7f20c40714a0 2023-10-16T19:40:08.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20cb9b0700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c4155b60 con 0x7f20c40c3240 2023-10-16T19:40:08.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20cb9b0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41525e0 con 0x7f20c41520b0 2023-10-16T19:40:08.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20c40c3240 0x7f20c406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20c40c3240 0x7f20c406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41794/0 (socket says 172.21.15.29:41794) 2023-10-16T19:40:08.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 -- 172.21.15.29:0/2260502336 learned_addr learned my addr 172.21.15.29:0/2260502336 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:08.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c8f4b700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 -- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 msgr2=0x7f20c406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:08.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 -- 172.21.15.29:0/2260502336 >> v1:172.21.15.53:6789/0 conn(0x7f20c40714a0 legacy=0x7f20c4147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.017+0000 7f20c9f4d700 1 -- 172.21.15.29:0/2260502336 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4155080 con 0x7f20c40c3240 2023-10-16T19:40:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20c9f4d700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c406e410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00d1b0 tx=0x7f20bc00d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc0d9426eec02a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20bbfff700 1 -- 172.21.15.29:0/2260502336 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc010070 con 0x7f20c40c3240 2023-10-16T19:40:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20bbfff700 1 -- 172.21.15.29:0/2260502336 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc00dcf0 con 0x7f20c40c3240 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20bbfff700 1 -- 172.21.15.29:0/2260502336 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00b310 con 0x7f20c40c3240 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 -- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 msgr2=0x7f20c406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c406e410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00d1b0 tx=0x7f20bc00d4c0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 -- 172.21.15.29:0/2260502336 shutdown_connections 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c406e410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/2260502336 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.018+0000 7f20cb9b0700 1 -- 172.21.15.29:0/2260502336 >> 172.21.15.29:0/2260502336 conn(0x7f20c40c7100 msgr2=0x7f20c40c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.019+0000 7f20cb9b0700 1 -- 172.21.15.29:0/2260502336 shutdown_connections 2023-10-16T19:40:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.019+0000 7f20cb9b0700 1 -- 172.21.15.29:0/2260502336 wait complete. 2023-10-16T19:40:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 Processor -- start 2023-10-16T19:40:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 -- start start 2023-10-16T19:40:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41e9780 con 0x7f20c40714a0 2023-10-16T19:40:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4154a60 con 0x7f20c40c3240 2023-10-16T19:40:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20cb9b0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4140090 con 0x7f20c41520b0 2023-10-16T19:40:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20c974c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20c974c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51510/0 (socket says 172.21.15.29:51510) 2023-10-16T19:40:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.020+0000 7f20c974c700 1 -- 172.21.15.29:0/3969927169 learned_addr learned my addr 172.21.15.29:0/3969927169 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c8f4b700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c9f4d700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 -- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 msgr2=0x7f20c414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 -- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 msgr2=0x7f20c414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 -- 172.21.15.29:0/3969927169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc00bd40 con 0x7f20c40714a0 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20c974c700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20c000c450 tx=0x7f20c000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00052d0 con 0x7f20c40714a0 2023-10-16T19:40:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0005430 con 0x7f20c40714a0 2023-10-16T19:40:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c41e9990 con 0x7f20c40714a0 2023-10-16T19:40:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00038c0 con 0x7f20c40714a0 2023-10-16T19:40:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.021+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c41e9f50 con 0x7f20c40714a0 2023-10-16T19:40:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.022+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c404f400 con 0x7f20c40714a0 2023-10-16T19:40:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.023+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20c0003a20 con 0x7f20c40714a0 2023-10-16T19:40:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.023+0000 7f20b9ffb700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.023+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20c0088ba0 con 0x7f20c40714a0 2023-10-16T19:40:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.023+0000 7f20c8f4b700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.024+0000 7f20c8f4b700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 0x7f20a806d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20c413fef0 tx=0x7f20b4009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.027+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20c0053970 con 0x7f20c40714a0 2023-10-16T19:40:08.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.227+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f20c40c3020 con 0x7f20c40714a0 2023-10-16T19:40:08.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.227+0000 7f20b9ffb700 1 -- 172.21.15.29:0/3969927169 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f20c000ce60 con 0x7f20c40714a0 2023-10-16T19:40:08.230 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:08.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 msgr2=0x7f20a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 0x7f20a806d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20c413fef0 tx=0x7f20b4009210 comp rx=0 tx=0).stop 2023-10-16T19:40:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 msgr2=0x7f20c40c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20c000c450 tx=0x7f20c000c760 comp rx=0 tx=0).stop 2023-10-16T19:40:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 shutdown_connections 2023-10-16T19:40:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f20a806af00 0x7f20a806d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20c41520b0 0x7f20c414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20c40714a0 0x7f20c40c04e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 --2- 172.21.15.29:0/3969927169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20c40c3240 0x7f20c414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 >> 172.21.15.29:0/3969927169 conn(0x7f20c40c7100 msgr2=0x7f20c40c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:08.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 shutdown_connections 2023-10-16T19:40:08.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.229+0000 7f20cb9b0700 1 -- 172.21.15.29:0/3969927169 wait complete. 2023-10-16T19:40:08.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:40:08.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.367+0000 7f20595a2700 1 Processor -- start 2023-10-16T19:40:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.367+0000 7f20595a2700 1 -- start start 2023-10-16T19:40:08.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20595a2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20540c5300 0x7f20540c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20595a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071940 0x7f2054154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20595a2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205406fb10 con 0x7f2054071560 2023-10-16T19:40:08.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20595a2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2054154880 con 0x7f20540c5300 2023-10-16T19:40:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20595a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054072790 con 0x7f2054071940 2023-10-16T19:40:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20537fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20540c5300 0x7f20540c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f2053fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2054071560 0x7f205406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36962/0 (socket says 172.21.15.29:36962) 2023-10-16T19:40:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f20537fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20540c5300 0x7f20540c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51520/0 (socket says 172.21.15.29:51520) 2023-10-16T19:40:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f2053fff700 1 -- 172.21.15.29:0/3452578863 learned_addr learned my addr 172.21.15.29:0/3452578863 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f2058da1700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071940 0x7f2054154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.368+0000 7f2052ffd700 1 -- 172.21.15.29:0/3452578863 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296974035 0 0) 0x7f205406fb10 con 0x7f2054071560 2023-10-16T19:40:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f2052ffd700 1 -- 172.21.15.29:0/3452578863 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20400035b0 con 0x7f2054071560 2023-10-16T19:40:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20537fe700 1 -- 172.21.15.29:0/3452578863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071940 msgr2=0x7f2054154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20537fe700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071940 0x7f2054154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20537fe700 1 -- 172.21.15.29:0/3452578863 >> v1:172.21.15.29:6789/0 conn(0x7f2054071560 legacy=0x7f205406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20537fe700 1 -- 172.21.15.29:0/3452578863 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054071df0 con 0x7f20540c5300 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20537fe700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f20540c3080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f203c009840 tx=0x7f203c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdb771d43685f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f2052ffd700 1 -- 172.21.15.29:0/3452578863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c011830 con 0x7f20540c5300 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f2052ffd700 1 -- 172.21.15.29:0/3452578863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c011990 con 0x7f20540c5300 2023-10-16T19:40:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f2052ffd700 1 -- 172.21.15.29:0/3452578863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c011d20 con 0x7f20540c5300 2023-10-16T19:40:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20595a2700 1 -- 172.21.15.29:0/3452578863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 msgr2=0x7f20540c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20595a2700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f20540c3080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f203c009840 tx=0x7f203c009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20595a2700 1 -- 172.21.15.29:0/3452578863 shutdown_connections 2023-10-16T19:40:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.369+0000 7f20595a2700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071940 0x7f2054154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.370+0000 7f20595a2700 1 --2- 172.21.15.29:0/3452578863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f20540c3080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.370+0000 7f20595a2700 1 -- 172.21.15.29:0/3452578863 >> 172.21.15.29:0/3452578863 conn(0x7f20540c6d30 msgr2=0x7f20540c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.370+0000 7f20595a2700 1 -- 172.21.15.29:0/3452578863 shutdown_connections 2023-10-16T19:40:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.370+0000 7f20595a2700 1 -- 172.21.15.29:0/3452578863 wait complete. 2023-10-16T19:40:08.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.371+0000 7f20595a2700 1 Processor -- start 2023-10-16T19:40:08.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.371+0000 7f20595a2700 1 -- start start 2023-10-16T19:40:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071560 0x7f205414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2054071940 0x7f2054155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540ab7a0 con 0x7f20540c5300 2023-10-16T19:40:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540ac4b0 con 0x7f2054071940 2023-10-16T19:40:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205414df30 con 0x7f2054071560 2023-10-16T19:40:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51528/0 (socket says 172.21.15.29:51528) 2023-10-16T19:40:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 -- 172.21.15.29:0/1438096452 learned_addr learned my addr 172.21.15.29:0/1438096452 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2053fff700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071560 0x7f205414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20537fe700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2054071940 0x7f2054155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 -- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071560 msgr2=0x7f205414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071560 0x7f205414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 -- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2054071940 msgr2=0x7f2054155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2054071940 0x7f2054155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 -- 172.21.15.29:0/1438096452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0094a0 con 0x7f20540c5300 2023-10-16T19:40:08.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2058da1700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f204c00efc0 tx=0x7f204c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c009ba0 con 0x7f20540c5300 2023-10-16T19:40:08.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c00f040 con 0x7f20540c5300 2023-10-16T19:40:08.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540ab9d0 con 0x7f20540c5300 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.372+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c014480 con 0x7f20540c5300 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.373+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540abf90 con 0x7f20540c5300 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.373+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20540ac180 con 0x7f20540c5300 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.374+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f204c0145e0 con 0x7f20540c5300 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.374+0000 7f2050ff9700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 0x7f203406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.375+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f204c08a3f0 con 0x7f20540c5300 2023-10-16T19:40:08.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.375+0000 7f2053fff700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 0x7f203406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:08.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.375+0000 7f2053fff700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 0x7f203406d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20440011e0 tx=0x7f2044009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:08.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.379+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f204c055240 con 0x7f20540c5300 2023-10-16T19:40:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.596+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2054067f50 con 0x7f20540c5300 2023-10-16T19:40:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.596+0000 7f2050ff9700 1 -- 172.21.15.29:0/1438096452 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f204c058860 con 0x7f20540c5300 2023-10-16T19:40:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 msgr2=0x7f203406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 0x7f203406d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20440011e0 tx=0x7f2044009040 comp rx=0 tx=0).stop 2023-10-16T19:40:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 msgr2=0x7f205414cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f204c00efc0 tx=0x7f204c00c3a0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 shutdown_connections 2023-10-16T19:40:08.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f203406af00 0x7f203406d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20540c5300 0x7f205414cce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2054071560 0x7f205414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 --2- 172.21.15.29:0/1438096452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2054071940 0x7f2054155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:08.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 >> 172.21.15.29:0/1438096452 conn(0x7f20540c6d30 msgr2=0x7f20540c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:08.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 shutdown_connections 2023-10-16T19:40:08.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:08.599+0000 7f20595a2700 1 -- 172.21.15.29:0/1438096452 wait complete. 2023-10-16T19:40:08.603 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2023-10-16T19:40:08.612 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-16T19:40:08.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:08.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-16T19:40:08.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[110982]: fuse finished with error 0 and tester_r 0 2023-10-16T19:40:08.652 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:40:14.754 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:40:14.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:14.755 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-16T19:40:14.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:14.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.962+0000 7fcd9b966700 1 Processor -- start 2023-10-16T19:40:14.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.962+0000 7fcd9b966700 1 -- start start 2023-10-16T19:40:14.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd9b966700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 0x7fcd940c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd9b966700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd940c07f0 0x7fcd940c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd9b966700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940c5260 con 0x7fcd940c0c70 2023-10-16T19:40:14.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd9b966700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940c4650 con 0x7fcd940c07f0 2023-10-16T19:40:14.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd9b966700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940c4930 con 0x7fcd941550b0 2023-10-16T19:40:14.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd940c07f0 0x7fcd940c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd940c07f0 0x7fcd940c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51532/0 (socket says 172.21.15.29:51532) 2023-10-16T19:40:14.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 -- 172.21.15.29:0/3947426613 learned_addr learned my addr 172.21.15.29:0/3947426613 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd99702700 1 --2- 172.21.15.29:0/3947426613 >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 0x7fcd940c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 -- 172.21.15.29:0/3947426613 >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 msgr2=0x7fcd940c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 --2- 172.21.15.29:0/3947426613 >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 0x7fcd940c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.963+0000 7fcd98f01700 1 -- 172.21.15.29:0/3947426613 >> v1:172.21.15.53:6789/0 conn(0x7fcd940c0c70 legacy=0x7fcd94070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd98f01700 1 -- 172.21.15.29:0/3947426613 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940c4c10 con 0x7fcd940c07f0 2023-10-16T19:40:14.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd99702700 1 --2- 172.21.15.29:0/3947426613 >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 0x7fcd940c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd98f01700 1 --2- 172.21.15.29:0/3947426613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c07f0 0x7fcd940c1320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd940700f0 tx=0x7fcd84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffca73e889d994de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd8bfff700 1 -- 172.21.15.29:0/3947426613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84004230 con 0x7fcd940c07f0 2023-10-16T19:40:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd8bfff700 1 -- 172.21.15.29:0/3947426613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84004390 con 0x7fcd940c07f0 2023-10-16T19:40:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd8bfff700 1 -- 172.21.15.29:0/3947426613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840036a0 con 0x7fcd940c07f0 2023-10-16T19:40:14.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 -- 172.21.15.29:0/3947426613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c07f0 msgr2=0x7fcd940c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:14.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 --2- 172.21.15.29:0/3947426613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c07f0 0x7fcd940c1320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd940700f0 tx=0x7fcd84009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 -- 172.21.15.29:0/3947426613 shutdown_connections 2023-10-16T19:40:14.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 --2- 172.21.15.29:0/3947426613 >> v2:172.21.15.53:3300/0 conn(0x7fcd941550b0 0x7fcd940c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 --2- 172.21.15.29:0/3947426613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c07f0 0x7fcd940c1320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.964+0000 7fcd9b966700 1 -- 172.21.15.29:0/3947426613 >> 172.21.15.29:0/3947426613 conn(0x7fcd940a8070 msgr2=0x7fcd940c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:14.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.965+0000 7fcd9b966700 1 -- 172.21.15.29:0/3947426613 shutdown_connections 2023-10-16T19:40:14.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.965+0000 7fcd9b966700 1 -- 172.21.15.29:0/3947426613 wait complete. 2023-10-16T19:40:14.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 Processor -- start 2023-10-16T19:40:14.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 -- start start 2023-10-16T19:40:14.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd940c07f0 0x7fcd941e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd941550b0 0x7fcd941ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941e6f50 con 0x7fcd940c0c70 2023-10-16T19:40:14.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940a5fb0 con 0x7fcd941550b0 2023-10-16T19:40:14.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.966+0000 7fcd9b966700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940c0170 con 0x7fcd940c07f0 2023-10-16T19:40:14.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51538/0 (socket says 172.21.15.29:51538) 2023-10-16T19:40:14.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 -- 172.21.15.29:0/908458398 learned_addr learned my addr 172.21.15.29:0/908458398 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd99702700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd940c07f0 0x7fcd941e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd99f03700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd941550b0 0x7fcd941ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 -- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd940c07f0 msgr2=0x7fcd941e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd940c07f0 0x7fcd941e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 -- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd941550b0 msgr2=0x7fcd941ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:14.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd941550b0 0x7fcd941ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:14.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 -- 172.21.15.29:0/908458398 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84009550 con 0x7fcd940c0c70 2023-10-16T19:40:14.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd98f01700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd940a8b00 tx=0x7fcd84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:14.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84003c90 con 0x7fcd940c0c70 2023-10-16T19:40:14.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8401f070 con 0x7fcd940c0c70 2023-10-16T19:40:14.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84011870 con 0x7fcd940c0c70 2023-10-16T19:40:14.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.967+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd940bfbb0 con 0x7fcd940c0c70 2023-10-16T19:40:14.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.968+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd941ea020 con 0x7fcd940c0c70 2023-10-16T19:40:14.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.968+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94070570 con 0x7fcd940c0c70 2023-10-16T19:40:14.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.969+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd84021030 con 0x7fcd940c0c70 2023-10-16T19:40:14.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.969+0000 7fcd89ffb700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 0x7fcd7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:14.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.969+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd8408ae20 con 0x7fcd940c0c70 2023-10-16T19:40:14.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.970+0000 7fcd99702700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 0x7fcd7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:14.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.970+0000 7fcd99702700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 0x7fcd7806d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000ab40 tx=0x7fcd90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:14.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:14.974+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd84055d90 con 0x7fcd940c0c70 2023-10-16T19:40:15.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.175+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd9404f400 con 0x7fcd940c0c70 2023-10-16T19:40:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.176+0000 7fcd89ffb700 1 -- 172.21.15.29:0/908458398 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fcd84029090 con 0x7fcd940c0c70 2023-10-16T19:40:15.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:15.179 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 msgr2=0x7fcd7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 0x7fcd7806d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000ab40 tx=0x7fcd90008040 comp rx=0 tx=0).stop 2023-10-16T19:40:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 msgr2=0x7fcd94150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd940a8b00 tx=0x7fcd84004750 comp rx=0 tx=0).stop 2023-10-16T19:40:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 shutdown_connections 2023-10-16T19:40:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd7806af00 0x7fcd7806d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd941550b0 0x7fcd941ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd940c07f0 0x7fcd941e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 --2- 172.21.15.29:0/908458398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd940c0c70 0x7fcd94150460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 >> 172.21.15.29:0/908458398 conn(0x7fcd940a8070 msgr2=0x7fcd940c5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 shutdown_connections 2023-10-16T19:40:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.178+0000 7fcd9b966700 1 -- 172.21.15.29:0/908458398 wait complete. 2023-10-16T19:40:15.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:15.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.315+0000 7f704a89b700 1 Processor -- start 2023-10-16T19:40:15.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.315+0000 7f704a89b700 1 -- start start 2023-10-16T19:40:15.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.316+0000 7f704a89b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.316+0000 7f704a89b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70440c3350 0x7f7044071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.316+0000 7f704a89b700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7044155af0 con 0x7f7044071840 2023-10-16T19:40:15.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.316+0000 7f704a89b700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7044152300 con 0x7f70440c3350 2023-10-16T19:40:15.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.316+0000 7f704a89b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440c2e40 con 0x7f704414ec50 2023-10-16T19:40:15.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f7043fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70440c3350 0x7f7044071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70440c3350 0x7f7044071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41830/0 (socket says 172.21.15.29:41830) 2023-10-16T19:40:15.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f7043fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:43998/0 (socket says 172.21.15.29:43998) 2023-10-16T19:40:15.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 -- 172.21.15.29:0/4146552104 learned_addr learned my addr 172.21.15.29:0/4146552104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:15.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 -- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 msgr2=0x7f70441555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:15.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 --2- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 -- 172.21.15.29:0/4146552104 >> v1:172.21.15.53:6789/0 conn(0x7f7044071840 legacy=0x7f704406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 -- 172.21.15.29:0/4146552104 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704414f030 con 0x7f70440c3350 2023-10-16T19:40:15.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f70437fe700 1 --2- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f7044071300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098f0 tx=0x7f702c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e7c15438ed2a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f7042ffd700 1 -- 172.21.15.29:0/4146552104 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c011830 con 0x7f70440c3350 2023-10-16T19:40:15.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f7042ffd700 1 -- 172.21.15.29:0/4146552104 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c011990 con 0x7f70440c3350 2023-10-16T19:40:15.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.317+0000 7f7042ffd700 1 -- 172.21.15.29:0/4146552104 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c011d20 con 0x7f70440c3350 2023-10-16T19:40:15.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 -- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 msgr2=0x7f7044071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 --2- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f7044071300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098f0 tx=0x7f702c009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:15.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 -- 172.21.15.29:0/4146552104 shutdown_connections 2023-10-16T19:40:15.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 --2- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 --2- 172.21.15.29:0/4146552104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f7044071300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 -- 172.21.15.29:0/4146552104 >> 172.21.15.29:0/4146552104 conn(0x7f70440c7110 msgr2=0x7f70440c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:15.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 -- 172.21.15.29:0/4146552104 shutdown_connections 2023-10-16T19:40:15.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.318+0000 7f704a89b700 1 -- 172.21.15.29:0/4146552104 wait complete. 2023-10-16T19:40:15.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.319+0000 7f704a89b700 1 Processor -- start 2023-10-16T19:40:15.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.319+0000 7f704a89b700 1 -- start start 2023-10-16T19:40:15.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f70441e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044153390 con 0x7f7044071840 2023-10-16T19:40:15.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441dfb00 con 0x7f70440c3350 2023-10-16T19:40:15.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f704a89b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044147db0 con 0x7f704414ec50 2023-10-16T19:40:15.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f7043fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f7043fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51550/0 (socket says 172.21.15.29:51550) 2023-10-16T19:40:15.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f7043fff700 1 -- 172.21.15.29:0/445244442 learned_addr learned my addr 172.21.15.29:0/445244442 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:15.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f70437fe700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f70441e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.320+0000 7f7048e38700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 -- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 msgr2=0x7f70441e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 -- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 msgr2=0x7f70441e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f70441e8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 -- 172.21.15.29:0/445244442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009550 con 0x7f7044071840 2023-10-16T19:40:15.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7048e38700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:15.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7043fff700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f703400e9b0 tx=0x7f703400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034009710 con 0x7f7044071840 2023-10-16T19:40:15.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703400c850 con 0x7f7044071840 2023-10-16T19:40:15.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70441e8b20 con 0x7f7044071840 2023-10-16T19:40:15.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400cbc0 con 0x7f7044071840 2023-10-16T19:40:15.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.321+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70441e9470 con 0x7f7044071840 2023-10-16T19:40:15.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.322+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70441536c0 con 0x7f7044071840 2023-10-16T19:40:15.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.322+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f703400cd20 con 0x7f7044071840 2023-10-16T19:40:15.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.323+0000 7f7040ff9700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 0x7f702406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.323+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7034089d60 con 0x7f7044071840 2023-10-16T19:40:15.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.323+0000 7f70437fe700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 0x7f702406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.323+0000 7f70437fe700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 0x7f702406d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c00 tx=0x7f702c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.327+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7034054b30 con 0x7f7044071840 2023-10-16T19:40:15.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.528+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f704404f400 con 0x7f7044071840 2023-10-16T19:40:15.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.529+0000 7f7040ff9700 1 -- 172.21.15.29:0/445244442 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f7034058150 con 0x7f7044071840 2023-10-16T19:40:15.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:15.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 msgr2=0x7f702406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 0x7f702406d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c00 tx=0x7f702c008030 comp rx=0 tx=0).stop 2023-10-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 msgr2=0x7f70441df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f703400e9b0 tx=0x7f703400ed70 comp rx=0 tx=0).stop 2023-10-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 shutdown_connections 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f702406af00 0x7f702406d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f704414ec50 0x7f70441e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7044071840 0x7f70441df5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 --2- 172.21.15.29:0/445244442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70440c3350 0x7f70441e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 >> 172.21.15.29:0/445244442 conn(0x7f70440c7110 msgr2=0x7f704414b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 shutdown_connections 2023-10-16T19:40:15.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.531+0000 7f704a89b700 1 -- 172.21.15.29:0/445244442 wait complete. 2023-10-16T19:40:15.546 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T19:40:15.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.673+0000 7f4983672700 1 Processor -- start 2023-10-16T19:40:15.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.673+0000 7f4983672700 1 -- start start 2023-10-16T19:40:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4983672700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f497c13d660 0x7f497c06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4983672700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 0x7f497c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4983672700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c06e780 con 0x7f497c154a50 2023-10-16T19:40:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4983672700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c06d320 con 0x7f497c13d660 2023-10-16T19:40:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4983672700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c154f10 con 0x7f497c06adc0 2023-10-16T19:40:15.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f498140e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f497c13d660 0x7f497c06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4980c0d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f497c154a50 0x7f497c1583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37002/0 (socket says 172.21.15.29:37002) 2023-10-16T19:40:15.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4980c0d700 1 -- 172.21.15.29:0/778987095 learned_addr learned my addr 172.21.15.29:0/778987095 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:15.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4981c0f700 1 --2- 172.21.15.29:0/778987095 >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 0x7f497c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f498140e700 1 -- 172.21.15.29:0/778987095 >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 msgr2=0x7f497c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f498140e700 1 --2- 172.21.15.29:0/778987095 >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 0x7f497c158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f498140e700 1 -- 172.21.15.29:0/778987095 >> v1:172.21.15.29:6789/0 conn(0x7f497c154a50 legacy=0x7f497c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f498140e700 1 -- 172.21.15.29:0/778987095 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c1551f0 con 0x7f497c13d660 2023-10-16T19:40:15.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4973fff700 1 -- 172.21.15.29:0/778987095 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371135499 0 0) 0x7f497c06e780 con 0x7f497c154a50 2023-10-16T19:40:15.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.674+0000 7f4981c0f700 1 --2- 172.21.15.29:0/778987095 >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 0x7f497c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:15.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f498140e700 1 --2- 172.21.15.29:0/778987095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c13d660 0x7f497c06a880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f497c06fe60 tx=0x7f496c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baf3b97cc2776fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4973fff700 1 -- 172.21.15.29:0/778987095 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011830 con 0x7f497c13d660 2023-10-16T19:40:15.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4973fff700 1 -- 172.21.15.29:0/778987095 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c011990 con 0x7f497c13d660 2023-10-16T19:40:15.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4973fff700 1 -- 172.21.15.29:0/778987095 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011d20 con 0x7f497c13d660 2023-10-16T19:40:15.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 -- 172.21.15.29:0/778987095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c13d660 msgr2=0x7f497c06a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 --2- 172.21.15.29:0/778987095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c13d660 0x7f497c06a880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f497c06fe60 tx=0x7f496c009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:15.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 -- 172.21.15.29:0/778987095 shutdown_connections 2023-10-16T19:40:15.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 --2- 172.21.15.29:0/778987095 >> v2:172.21.15.53:3300/0 conn(0x7f497c06adc0 0x7f497c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 --2- 172.21.15.29:0/778987095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c13d660 0x7f497c06a880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 -- 172.21.15.29:0/778987095 >> 172.21.15.29:0/778987095 conn(0x7f497c0c7110 msgr2=0x7f497c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 -- 172.21.15.29:0/778987095 shutdown_connections 2023-10-16T19:40:15.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.675+0000 7f4983672700 1 -- 172.21.15.29:0/778987095 wait complete. 2023-10-16T19:40:15.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.676+0000 7f4983672700 1 Processor -- start 2023-10-16T19:40:15.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 -- start start 2023-10-16T19:40:15.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c06adc0 0x7f497c13a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 0x7f497c133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1e9f10 con 0x7f497c154a50 2023-10-16T19:40:15.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1342b0 con 0x7f497c06adc0 2023-10-16T19:40:15.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4983672700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1ea120 con 0x7f497c13d660 2023-10-16T19:40:15.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4981c0f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4981c0f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51568/0 (socket says 172.21.15.29:51568) 2023-10-16T19:40:15.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f4981c0f700 1 -- 172.21.15.29:0/2416394451 learned_addr learned my addr 172.21.15.29:0/2416394451 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:15.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.677+0000 7f498140e700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c06adc0 0x7f497c13a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4980c0d700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 0x7f497c133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 -- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 msgr2=0x7f497c133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 0x7f497c133830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 -- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c06adc0 msgr2=0x7f497c13a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:15.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c06adc0 0x7f497c13a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:15.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 -- 172.21.15.29:0/2416394451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0094a0 con 0x7f497c154a50 2023-10-16T19:40:15.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4980c0d700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 0x7f497c133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:15.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4981c0f700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4974007ef0 tx=0x7f497400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400de60 con 0x7f497c154a50 2023-10-16T19:40:15.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400f040 con 0x7f497c154a50 2023-10-16T19:40:15.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c1ea400 con 0x7f497c154a50 2023-10-16T19:40:15.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974003cb0 con 0x7f497c154a50 2023-10-16T19:40:15.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.678+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c1ea9c0 con 0x7f497c154a50 2023-10-16T19:40:15.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.679+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c1eabe0 con 0x7f497c154a50 2023-10-16T19:40:15.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.680+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4974004030 con 0x7f497c154a50 2023-10-16T19:40:15.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.680+0000 7f4971ffb700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 0x7f496006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:15.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.680+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4974089a40 con 0x7f497c154a50 2023-10-16T19:40:15.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.680+0000 7f498140e700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 0x7f496006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:15.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.681+0000 7f498140e700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 0x7f496006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f496c0090b0 tx=0x7f496c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:15.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.685+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f497408be60 con 0x7f497c154a50 2023-10-16T19:40:15.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:15.930+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f497c0c3760 con 0x7f497c154a50 2023-10-16T19:40:16.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.417+0000 7f4971ffb700 1 -- 172.21.15.29:0/2416394451 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f497401a020 con 0x7f497c154a50 2023-10-16T19:40:16.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 msgr2=0x7f496006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:16.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 0x7f496006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f496c0090b0 tx=0x7f496c008030 comp rx=0 tx=0).stop 2023-10-16T19:40:16.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 msgr2=0x7f497c133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:16.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4974007ef0 tx=0x7f497400d3b0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 shutdown_connections 2023-10-16T19:40:16.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f496006af00 0x7f496006d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c154a50 0x7f497c133d70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c06adc0 0x7f497c13a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 --2- 172.21.15.29:0/2416394451 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f497c13d660 0x7f497c133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 >> 172.21.15.29:0/2416394451 conn(0x7f497c0c7110 msgr2=0x7f497c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:16.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.419+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 shutdown_connections 2023-10-16T19:40:16.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.420+0000 7f4983672700 1 -- 172.21.15.29:0/2416394451 wait complete. 2023-10-16T19:40:16.436 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-16T19:40:16.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T19:40:16.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.568+0000 7fe804564700 1 Processor -- start 2023-10-16T19:40:16.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.568+0000 7fe804564700 1 -- start start 2023-10-16T19:40:16.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe804564700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7fc151ea0 0x7fe7fc0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe804564700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7fc0c8130 0x7fe7fc154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe804564700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0ca540 con 0x7fe7fc0bd8c0 2023-10-16T19:40:16.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe804564700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc158c80 con 0x7fe7fc0c8130 2023-10-16T19:40:16.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe804564700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0ca790 con 0x7fe7fc151ea0 2023-10-16T19:40:16.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe801aff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7fc0c8130 0x7fe7fc154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe801aff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7fc0c8130 0x7fe7fc154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51574/0 (socket says 172.21.15.29:51574) 2023-10-16T19:40:16.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.569+0000 7fe801aff700 1 -- 172.21.15.29:0/4294042428 learned_addr learned my addr 172.21.15.29:0/4294042428 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:16.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe802300700 1 --2- 172.21.15.29:0/4294042428 >> v2:172.21.15.53:3300/0 conn(0x7fe7fc151ea0 0x7fe7fc0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe801aff700 1 -- 172.21.15.29:0/4294042428 >> v2:172.21.15.53:3300/0 conn(0x7fe7fc151ea0 msgr2=0x7fe7fc0c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:16.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe801aff700 1 --2- 172.21.15.29:0/4294042428 >> v2:172.21.15.53:3300/0 conn(0x7fe7fc151ea0 0x7fe7fc0c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe801aff700 1 -- 172.21.15.29:0/4294042428 >> v1:172.21.15.53:6789/0 conn(0x7fe7fc0bd8c0 legacy=0x7fe7fc155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:16.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe801aff700 1 -- 172.21.15.29:0/4294042428 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0caa70 con 0x7fe7fc0c8130 2023-10-16T19:40:16.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe801aff700 1 --2- 172.21.15.29:0/4294042428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc154b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0cb1a0 tx=0x7fe7f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2c4a4658d25b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:16.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe8012fe700 1 -- 172.21.15.29:0/4294042428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8004230 con 0x7fe7fc0c8130 2023-10-16T19:40:16.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe8012fe700 1 -- 172.21.15.29:0/4294042428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8004390 con 0x7fe7fc0c8130 2023-10-16T19:40:16.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe8012fe700 1 -- 172.21.15.29:0/4294042428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80036a0 con 0x7fe7fc0c8130 2023-10-16T19:40:16.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe804564700 1 -- 172.21.15.29:0/4294042428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 msgr2=0x7fe7fc154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:16.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.570+0000 7fe804564700 1 --2- 172.21.15.29:0/4294042428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc154b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0cb1a0 tx=0x7fe7f8009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 -- 172.21.15.29:0/4294042428 shutdown_connections 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 --2- 172.21.15.29:0/4294042428 >> v2:172.21.15.53:3300/0 conn(0x7fe7fc151ea0 0x7fe7fc0c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 --2- 172.21.15.29:0/4294042428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc154b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 -- 172.21.15.29:0/4294042428 >> 172.21.15.29:0/4294042428 conn(0x7fe7fc072190 msgr2=0x7fe7fc0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 -- 172.21.15.29:0/4294042428 shutdown_connections 2023-10-16T19:40:16.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.571+0000 7fe804564700 1 -- 172.21.15.29:0/4294042428 wait complete. 2023-10-16T19:40:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 Processor -- start 2023-10-16T19:40:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 -- start start 2023-10-16T19:40:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7fc0bd8c0 0x7fe7fc0c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe7fc151ea0 0x7fe7fc1e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0bf2d0 con 0x7fe7fc0c8130 2023-10-16T19:40:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc154770 con 0x7fe7fc0bd8c0 2023-10-16T19:40:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.572+0000 7fe804564700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1eaf20 con 0x7fe7fc151ea0 2023-10-16T19:40:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51580/0 (socket says 172.21.15.29:51580) 2023-10-16T19:40:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 -- 172.21.15.29:0/560104340 learned_addr learned my addr 172.21.15.29:0/560104340 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe802300700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7fc0bd8c0 0x7fe7fc0c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe802b01700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe7fc151ea0 0x7fe7fc1e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 -- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe7fc151ea0 msgr2=0x7fe7fc1e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe7fc151ea0 0x7fe7fc1e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 -- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7fc0bd8c0 msgr2=0x7fe7fc0c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7fc0bd8c0 0x7fe7fc0c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 -- 172.21.15.29:0/560104340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8009550 con 0x7fe7fc0c8130 2023-10-16T19:40:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe801aff700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8004000 tx=0x7fe7f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8003da0 con 0x7fe7fc0c8130 2023-10-16T19:40:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8011630 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80119e0 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc1e7c40 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.573+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc1ea680 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.574+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc152b60 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.575+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7f8011b40 con 0x7fe7fc0c8130 2023-10-16T19:40:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.575+0000 7fe7f2ffd700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 0x7fe7e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.575+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7f808aca0 con 0x7fe7fc0c8130 2023-10-16T19:40:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.575+0000 7fe802300700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 0x7fe7e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.576+0000 7fe802300700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 0x7fe7e006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006b20 tx=0x7fe7ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.579+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7fc152b60 con 0x7fe7fc0c8130 2023-10-16T19:40:16.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:16.825+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7fc152b60 con 0x7fe7fc0c8130 2023-10-16T19:40:17.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.421+0000 7fe7f2ffd700 1 -- 172.21.15.29:0/560104340 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7fc152b60 con 0x7fe7fc0c8130 2023-10-16T19:40:17.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 msgr2=0x7fe7e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 0x7fe7e006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006b20 tx=0x7fe7ec008040 comp rx=0 tx=0).stop 2023-10-16T19:40:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 msgr2=0x7fe7fc1e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8004000 tx=0x7fe7f8004750 comp rx=0 tx=0).stop 2023-10-16T19:40:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 shutdown_connections 2023-10-16T19:40:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe7e006af00 0x7fe7e006d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe7fc151ea0 0x7fe7fc1e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7fc0bd8c0 0x7fe7fc0c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 --2- 172.21.15.29:0/560104340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7fc0c8130 0x7fe7fc1e71c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 >> 172.21.15.29:0/560104340 conn(0x7fe7fc072190 msgr2=0x7fe7fc14f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 shutdown_connections 2023-10-16T19:40:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.424+0000 7fe804564700 1 -- 172.21.15.29:0/560104340 wait complete. 2023-10-16T19:40:17.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T19:40:17.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:17.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.579+0000 7fa8718be700 1 Processor -- start 2023-10-16T19:40:17.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.579+0000 7fa8718be700 1 -- start start 2023-10-16T19:40:17.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa8718be700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 0x7fa86c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa8718be700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa86c06db00 0x7fa86c06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa8718be700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86c155af0 con 0x7fa86c14ec50 2023-10-16T19:40:17.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa8718be700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c152300 con 0x7fa86c06db00 2023-10-16T19:40:17.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa8718be700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0c2e40 con 0x7fa86c0c3350 2023-10-16T19:40:17.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa86b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa86c06db00 0x7fa86c06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa86b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa86c06db00 0x7fa86c06df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51590/0 (socket says 172.21.15.29:51590) 2023-10-16T19:40:17.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa86b7fe700 1 -- 172.21.15.29:0/906927227 learned_addr learned my addr 172.21.15.29:0/906927227 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:17.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.580+0000 7fa86a7fc700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 0x7fa86c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86b7fe700 1 -- 172.21.15.29:0/906927227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 msgr2=0x7fa86c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:17.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86b7fe700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 0x7fa86c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86b7fe700 1 -- 172.21.15.29:0/906927227 >> v1:172.21.15.53:6789/0 conn(0x7fa86c14ec50 legacy=0x7fa86c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86b7fe700 1 -- 172.21.15.29:0/906927227 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c14f030 con 0x7fa86c06db00 2023-10-16T19:40:17.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86a7fc700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 0x7fa86c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:17.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa86b7fe700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c06db00 0x7fa86c06df90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa86400d150 tx=0x7fa86400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28115c1c775a66f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa869ffb700 1 -- 172.21.15.29:0/906927227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864010070 con 0x7fa86c06db00 2023-10-16T19:40:17.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa869ffb700 1 -- 172.21.15.29:0/906927227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400ddc0 con 0x7fa86c06db00 2023-10-16T19:40:17.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa869ffb700 1 -- 172.21.15.29:0/906927227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400b310 con 0x7fa86c06db00 2023-10-16T19:40:17.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 -- 172.21.15.29:0/906927227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c06db00 msgr2=0x7fa86c06df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c06db00 0x7fa86c06df90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa86400d150 tx=0x7fa86400d460 comp rx=0 tx=0).stop 2023-10-16T19:40:17.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 -- 172.21.15.29:0/906927227 shutdown_connections 2023-10-16T19:40:17.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c06db00 0x7fa86c06df90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 --2- 172.21.15.29:0/906927227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c0c3350 0x7fa86c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.581+0000 7fa8718be700 1 -- 172.21.15.29:0/906927227 >> 172.21.15.29:0/906927227 conn(0x7fa86c0c7110 msgr2=0x7fa86c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:17.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.582+0000 7fa8718be700 1 -- 172.21.15.29:0/906927227 shutdown_connections 2023-10-16T19:40:17.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.582+0000 7fa8718be700 1 -- 172.21.15.29:0/906927227 wait complete. 2023-10-16T19:40:17.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 Processor -- start 2023-10-16T19:40:17.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 -- start start 2023-10-16T19:40:17.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c06db00 0x7fa86c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa86c0c3350 0x7fa86c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c153aa0 con 0x7fa86c14ec50 2023-10-16T19:40:17.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0c5550 con 0x7fa86c0c3350 2023-10-16T19:40:17.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.583+0000 7fa8718be700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0c4fb0 con 0x7fa86c06db00 2023-10-16T19:40:17.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51596/0 (socket says 172.21.15.29:51596) 2023-10-16T19:40:17.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 -- 172.21.15.29:0/2739213724 learned_addr learned my addr 172.21.15.29:0/2739213724 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:17.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86affd700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c06db00 0x7fa86c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86a7fc700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa86c0c3350 0x7fa86c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 -- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c06db00 msgr2=0x7fa86c1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c06db00 0x7fa86c1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 -- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa86c0c3350 msgr2=0x7fa86c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa86c0c3350 0x7fa86c153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 -- 172.21.15.29:0/2739213724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86400bd40 con 0x7fa86c14ec50 2023-10-16T19:40:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa86b7fe700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa86400d4a0 tx=0x7fa864004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400bbc0 con 0x7fa86c14ec50 2023-10-16T19:40:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400b4c0 con 0x7fa86c14ec50 2023-10-16T19:40:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c1e6860 con 0x7fa86c14ec50 2023-10-16T19:40:17.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400ae70 con 0x7fa86c14ec50 2023-10-16T19:40:17.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.584+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c152b00 con 0x7fa86c14ec50 2023-10-16T19:40:17.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.585+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c04f400 con 0x7fa86c14ec50 2023-10-16T19:40:17.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.586+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa864004040 con 0x7fa86c14ec50 2023-10-16T19:40:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.586+0000 7fa853fff700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 0x7fa85806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.586+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa86408cd20 con 0x7fa86c14ec50 2023-10-16T19:40:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.586+0000 7fa86affd700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 0x7fa85806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.587+0000 7fa86affd700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 0x7fa85806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa85c007fd0 tx=0x7fa85c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.591+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa864057ad0 con 0x7fa86c14ec50 2023-10-16T19:40:17.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.838+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa86c06b670 con 0x7fa86c14ec50 2023-10-16T19:40:17.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.838+0000 7fa853fff700 1 -- 172.21.15.29:0/2739213724 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fa864021090 con 0x7fa86c14ec50 2023-10-16T19:40:17.841 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:17.841 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:17.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 msgr2=0x7fa85806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 0x7fa85806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa85c007fd0 tx=0x7fa85c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:17.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 msgr2=0x7fa86c153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa86400d4a0 tx=0x7fa864004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:17.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 shutdown_connections 2023-10-16T19:40:17.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa85806af00 0x7fa85806d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa86c14ec50 0x7fa86c153560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa86c06db00 0x7fa86c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 --2- 172.21.15.29:0/2739213724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa86c0c3350 0x7fa86c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.840+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 >> 172.21.15.29:0/2739213724 conn(0x7fa86c0c7110 msgr2=0x7fa86c06ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:17.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.841+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 shutdown_connections 2023-10-16T19:40:17.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.841+0000 7fa8718be700 1 -- 172.21.15.29:0/2739213724 wait complete. 2023-10-16T19:40:17.845 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:17.855 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.979+0000 7fd3601c8700 1 Processor -- start 2023-10-16T19:40:17.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.979+0000 7fd3601c8700 1 -- start start 2023-10-16T19:40:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358152190 0x7fd3580c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3580bed80 0x7fd35806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd358155710 0x7fd358157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd358152570 con 0x7fd358155710 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580be9f0 con 0x7fd3580bed80 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd3601c8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580c2a40 con 0x7fd358152190 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd35e765700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd358155710 0x7fd358157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd35e765700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd358155710 0x7fd358157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51604/0 (socket says 172.21.15.29:51604) 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.980+0000 7fd35e765700 1 -- 172.21.15.29:0/2054438731 learned_addr learned my addr 172.21.15.29:0/2054438731 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:17.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35df64700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358152190 0x7fd3580c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35d763700 1 --2- 172.21.15.29:0/2054438731 >> v2:172.21.15.53:3300/0 conn(0x7fd3580bed80 0x7fd35806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 -- 172.21.15.29:0/2054438731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358152190 msgr2=0x7fd3580c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358152190 0x7fd3580c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 -- 172.21.15.29:0/2054438731 >> v2:172.21.15.53:3300/0 conn(0x7fd3580bed80 msgr2=0x7fd35806b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 --2- 172.21.15.29:0/2054438731 >> v2:172.21.15.53:3300/0 conn(0x7fd3580bed80 0x7fd35806b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 -- 172.21.15.29:0/2054438731 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580a7710 con 0x7fd358155710 2023-10-16T19:40:17.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35e765700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358155710 0x7fd358157fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3580aacc0 tx=0x7fd35000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3c0551f615e0a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35cf62700 1 -- 172.21.15.29:0/2054438731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000e070 con 0x7fd358155710 2023-10-16T19:40:17.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35cf62700 1 -- 172.21.15.29:0/2054438731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000b980 con 0x7fd358155710 2023-10-16T19:40:17.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd35cf62700 1 -- 172.21.15.29:0/2054438731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000bd30 con 0x7fd358155710 2023-10-16T19:40:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd3601c8700 1 -- 172.21.15.29:0/2054438731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358155710 msgr2=0x7fd358157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.981+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358155710 0x7fd358157fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3580aacc0 tx=0x7fd35000b330 comp rx=0 tx=0).stop 2023-10-16T19:40:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 -- 172.21.15.29:0/2054438731 shutdown_connections 2023-10-16T19:40:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358155710 0x7fd358157fc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2054438731 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358152190 0x7fd3580c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2054438731 >> v2:172.21.15.53:3300/0 conn(0x7fd3580bed80 0x7fd35806b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 -- 172.21.15.29:0/2054438731 >> 172.21.15.29:0/2054438731 conn(0x7fd3580a9cd0 msgr2=0x7fd3580aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:17.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 -- 172.21.15.29:0/2054438731 shutdown_connections 2023-10-16T19:40:17.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.982+0000 7fd3601c8700 1 -- 172.21.15.29:0/2054438731 wait complete. 2023-10-16T19:40:17.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 Processor -- start 2023-10-16T19:40:17.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 -- start start 2023-10-16T19:40:17.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358155710 0x7fd35814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3580c5050 0x7fd35814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580aba20 con 0x7fd358152190 2023-10-16T19:40:17.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814f8b0 con 0x7fd3580c5050 2023-10-16T19:40:17.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.983+0000 7fd3601c8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814f5d0 con 0x7fd358155710 2023-10-16T19:40:17.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51606/0 (socket says 172.21.15.29:51606) 2023-10-16T19:40:17.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 -- 172.21.15.29:0/2100180911 learned_addr learned my addr 172.21.15.29:0/2100180911 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:17.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35d763700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358155710 0x7fd35814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35e765700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3580c5050 0x7fd35814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 -- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358155710 msgr2=0x7fd35814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358155710 0x7fd35814e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 -- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3580c5050 msgr2=0x7fd35814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3580c5050 0x7fd35814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 -- 172.21.15.29:0/2100180911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009b30 con 0x7fd358152190 2023-10-16T19:40:17.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd35df64700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd34800e810 tx=0x7fd34800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:17.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800c070 con 0x7fd358152190 2023-10-16T19:40:17.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348013610 con 0x7fd358152190 2023-10-16T19:40:17.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580aae60 con 0x7fd358152190 2023-10-16T19:40:17.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480139c0 con 0x7fd358152190 2023-10-16T19:40:17.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.984+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35814f370 con 0x7fd358152190 2023-10-16T19:40:17.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.985+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3580ab4b0 con 0x7fd358152190 2023-10-16T19:40:17.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.986+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd348013b20 con 0x7fd358152190 2023-10-16T19:40:17.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.986+0000 7fd34e7fc700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 0x7fd33c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:17.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.986+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd348089600 con 0x7fd358152190 2023-10-16T19:40:17.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.986+0000 7fd35d763700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 0x7fd33c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.987+0000 7fd35d763700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 0x7fd33c06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3580c2450 tx=0x7fd354008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:17.990+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3480543d0 con 0x7fd358152190 2023-10-16T19:40:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.190+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3581e9ab0 con 0x7fd358152190 2023-10-16T19:40:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.191+0000 7fd34e7fc700 1 -- 172.21.15.29:0/2100180911 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fd3480579f0 con 0x7fd358152190 2023-10-16T19:40:18.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:18.194 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:18.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 msgr2=0x7fd33c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 0x7fd33c06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3580c2450 tx=0x7fd354008040 comp rx=0 tx=0).stop 2023-10-16T19:40:18.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 msgr2=0x7fd3580c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd34800e810 tx=0x7fd34800eb20 comp rx=0 tx=0).stop 2023-10-16T19:40:18.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 shutdown_connections 2023-10-16T19:40:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd33c06af00 0x7fd33c06d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3580c5050 0x7fd35814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd358152190 0x7fd3580c3f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 --2- 172.21.15.29:0/2100180911 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd358155710 0x7fd35814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.193+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 >> 172.21.15.29:0/2100180911 conn(0x7fd3580a9cd0 msgr2=0x7fd3580c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.194+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 shutdown_connections 2023-10-16T19:40:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.194+0000 7fd3601c8700 1 -- 172.21.15.29:0/2100180911 wait complete. 2023-10-16T19:40:18.208 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T19:40:18.208 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:40:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.330+0000 7f7e06165700 1 Processor -- start 2023-10-16T19:40:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.330+0000 7f7e06165700 1 -- start start 2023-10-16T19:40:18.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7e06165700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e0006f6e0 0x7f7e00156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7e06165700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7e00152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7e06165700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e000724a0 con 0x7f7e000c18b0 2023-10-16T19:40:18.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7e06165700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e00152780 con 0x7f7e0006f6e0 2023-10-16T19:40:18.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7e06165700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c2660 con 0x7f7e00150100 2023-10-16T19:40:18.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7dfeffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e000c18b0 0x7f7e0014f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37062/0 (socket says 172.21.15.29:37062) 2023-10-16T19:40:18.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.331+0000 7f7dfeffd700 1 -- 172.21.15.29:0/4043032253 learned_addr learned my addr 172.21.15.29:0/4043032253 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:18.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfffff700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7e00152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/4043032253 >> v2:172.21.15.53:3300/0 conn(0x7f7e0006f6e0 0x7f7e00156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876867009 0 0) 0x7f7e000724a0 con 0x7f7e000c18b0 2023-10-16T19:40:18.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7de80035b0 con 0x7f7e000c18b0 2023-10-16T19:40:18.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216393062 0 0) 0x7f7de80035b0 con 0x7f7e000c18b0 2023-10-16T19:40:18.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 msgr2=0x7f7e00152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:18.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7e00152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 >> v2:172.21.15.53:3300/0 conn(0x7f7e0006f6e0 msgr2=0x7f7e00156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 --2- 172.21.15.29:0/4043032253 >> v2:172.21.15.53:3300/0 conn(0x7f7e0006f6e0 0x7f7e00156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000a8490 con 0x7f7e000c18b0 2023-10-16T19:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f7df4001670 con 0x7f7e000c18b0 2023-10-16T19:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 >> v1:172.21.15.29:6789/0 conn(0x7f7e000c18b0 legacy=0x7f7e0014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7de8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7de8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de8004d90 0x7f7de8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00152780 con 0x7f7de8003f80 2023-10-16T19:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c2660 con 0x7f7de8004d90 2023-10-16T19:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de800ba60 con 0x7f7e00150100 2023-10-16T19:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/4043032253 >> v2:172.21.15.53:3300/0 conn(0x7f7e0006f6e0 0x7f7e00156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7de8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfffff700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de8004d90 0x7f7de8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7de8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.332+0000 7f7dfeffd700 1 -- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 msgr2=0x7f7de8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00150100 0x7f7de8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfeffd700 1 -- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de8004d90 msgr2=0x7f7de8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de8004d90 0x7f7de8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfeffd700 1 -- 172.21.15.29:0/4043032253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80035b0 con 0x7f7de8003f80 2023-10-16T19:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7de8004850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c320 tx=0x7f7de8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da25d6ba6beabdd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400ce20 con 0x7f7de8003f80 2023-10-16T19:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4005960 con 0x7f7de8003f80 2023-10-16T19:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfe7fc700 1 -- 172.21.15.29:0/4043032253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4005d10 con 0x7f7de8003f80 2023-10-16T19:40:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 -- 172.21.15.29:0/4043032253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 msgr2=0x7f7de8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 --2- 172.21.15.29:0/4043032253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7de8004850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c320 tx=0x7f7de8005880 comp rx=0 tx=0).stop 2023-10-16T19:40:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7dfffff700 1 -- 172.21.15.29:0/4043032253 reap_dead start 2023-10-16T19:40:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 -- 172.21.15.29:0/4043032253 shutdown_connections 2023-10-16T19:40:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 -- 172.21.15.29:0/4043032253 >> 172.21.15.29:0/4043032253 conn(0x7f7e000c7110 msgr2=0x7f7e000c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 -- 172.21.15.29:0/4043032253 shutdown_connections 2023-10-16T19:40:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.333+0000 7f7e06165700 1 -- 172.21.15.29:0/4043032253 wait complete. 2023-10-16T19:40:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.335+0000 7f7e06165700 1 Processor -- start 2023-10-16T19:40:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.335+0000 7f7e06165700 1 -- start start 2023-10-16T19:40:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.335+0000 7f7e06165700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0014d8c0 0x7f7e00144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00144df0 0x7f7e00144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c54c0 con 0x7f7de8003f80 2023-10-16T19:40:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006d630 con 0x7f7e0014d8c0 2023-10-16T19:40:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c0d30 con 0x7f7e00144df0 2023-10-16T19:40:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51626/0 (socket says 172.21.15.29:51626) 2023-10-16T19:40:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 -- 172.21.15.29:0/1449192019 learned_addr learned my addr 172.21.15.29:0/1449192019 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0014d8c0 0x7f7e00144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dfffff700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00144df0 0x7f7e00144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 -- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00144df0 msgr2=0x7f7e00144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00144df0 0x7f7e00144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 -- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0014d8c0 msgr2=0x7f7e00144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0014d8c0 0x7f7e00144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 -- 172.21.15.29:0/1449192019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0006d390 con 0x7f7de8003f80 2023-10-16T19:40:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7dff7fe700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7df0011930 tx=0x7f7df0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000fae0 con 0x7f7de8003f80 2023-10-16T19:40:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0011ed0 con 0x7f7de8003f80 2023-10-16T19:40:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e000c0a50 con 0x7f7de8003f80 2023-10-16T19:40:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000fe40 con 0x7f7de8003f80 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.336+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e00148890 con 0x7f7de8003f80 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.337+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e001ecfd0 con 0x7f7de8003f80 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.338+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7df0015460 con 0x7f7de8003f80 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.338+0000 7f7de7fff700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 0x7f7dec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.338+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7df0089db0 con 0x7f7de8003f80 2023-10-16T19:40:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.338+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 0x7f7dec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.339+0000 7f7dfeffd700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 0x7f7dec06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.343+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e001ecfd0 con 0x7f7de8003f80 2023-10-16T19:40:18.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.541+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e000a8a50 con 0x7f7dec06af00 2023-10-16T19:40:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.553+0000 7f7de7fff700 1 -- 172.21.15.29:0/1449192019 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345250 (secure 0 0 0) 0x7f7df40014b0 con 0x7f7dec06af00 2023-10-16T19:40:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 msgr2=0x7f7dec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 0x7f7dec06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df400a000 comp rx=0 tx=0).stop 2023-10-16T19:40:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 msgr2=0x7f7e0014d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7df0011930 tx=0x7f7df0011cf0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 shutdown_connections 2023-10-16T19:40:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7dec06af00 0x7f7dec06d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7e00144df0 0x7f7e00144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7de8003f80 0x7f7e0014d380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 --2- 172.21.15.29:0/1449192019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0014d8c0 0x7f7e00144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 >> 172.21.15.29:0/1449192019 conn(0x7f7e000c7110 msgr2=0x7f7e00151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 shutdown_connections 2023-10-16T19:40:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.556+0000 7f7e06165700 1 -- 172.21.15.29:0/1449192019 wait complete. 2023-10-16T19:40:18.565 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:40:18.570 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-16T19:40:16.561094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2025624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003343"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056933+0000","last_change":"2023-10-16T19:39:52.970740+0000","last_active":"2023-10-16T19:39:57.056933+0000","last_peered":"2023-10-16T19:39:57.056933+0000","last_clean":"2023-10-16T19:39:57.056933+0000","last_became_active":"2023-10-16T19:39:52.970471+0000","last_became_peered":"2023-10-16T19:39:52.970471+0000","last_unstale":"2023-10-16T19:39:57.056933+0000","last_undegraded":"2023-10-16T19:39:57.056933+0000","last_fullsized":"2023-10-16T19:39:57.056933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:28.159875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995299+0000","last_change":"2023-10-16T19:39:52.967596+0000","last_active":"2023-10-16T19:39:56.995299+0000","last_peered":"2023-10-16T19:39:56.995299+0000","last_clean":"2023-10-16T19:39:56.995299+0000","last_became_active":"2023-10-16T19:39:52.967235+0000","last_became_peered":"2023-10-16T19:39:52.967235+0000","last_unstale":"2023-10-16T19:39:56.995299+0000","last_undegraded":"2023-10-16T19:39:56.995299+0000","last_fullsized":"2023-10-16T19:39:56.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983237+0000","last_change":"2023-10-16T19:39:52.973343+0000","last_active":"2023-10-16T19:39:56.983237+0000","last_peered":"2023-10-16T19:39:56.983237+0000","last_clean":"2023-10-16T19:39:56.983237+0000","last_became_active":"2023-10-16T19:39:52.973035+0000","last_became_peered":"2023-10-16T19:39:52.973035+0000","last_unstale":"2023-10-16T19:39:56.983237+0000","last_undegraded":"2023-10-16T19:39:56.983237+0000","last_fullsized":"2023-10-16T19:39:56.983237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:11.377449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984370+0000","last_change":"2023-10-16T19:39:52.971942+0000","last_active":"2023-10-16T19:39:56.984370+0000","last_peered":"2023-10-16T19:39:56.984370+0000","last_clean":"2023-10-16T19:39:56.984370+0000","last_became_active":"2023-10-16T19:39:52.971194+0000","last_became_peered":"2023-10-16T19:39:52.971194+0000","last_unstale":"2023-10-16T19:39:56.984370+0000","last_undegraded":"2023-10-16T19:39:56.984370+0000","last_fullsized":"2023-10-16T19:39:56.984370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055336+0000","last_change":"2023-10-16T19:39:52.968333+0000","last_active":"2023-10-16T19:39:57.055336+0000","last_peered":"2023-10-16T19:39:57.055336+0000","last_clean":"2023-10-16T19:39:57.055336+0000","last_became_active":"2023-10-16T19:39:52.968039+0000","last_became_peered":"2023-10-16T19:39:52.968039+0000","last_unstale":"2023-10-16T19:39:57.055336+0000","last_undegraded":"2023-10-16T19:39:57.055336+0000","last_fullsized":"2023-10-16T19:39:57.055336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984153+0000","last_change":"2023-10-16T19:39:52.977137+0000","last_active":"2023-10-16T19:39:56.984153+0000","last_peered":"2023-10-16T19:39:56.984153+0000","last_clean":"2023-10-16T19:39:56.984153+0000","last_became_active":"2023-10-16T19:39:52.976671+0000","last_became_peered":"2023-10-16T19:39:52.976671+0000","last_unstale":"2023-10-16T19:39:56.984153+0000","last_undegraded":"2023-10-16T19:39:56.984153+0000","last_fullsized":"2023-10-16T19:39:56.984153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054955+0000","last_change":"2023-10-16T19:39:52.969912+0000","last_active":"2023-10-16T19:39:57.054955+0000","last_peered":"2023-10-16T19:39:57.054955+0000","last_clean":"2023-10-16T19:39:57.054955+0000","last_became_active":"2023-10-16T19:39:52.969619+0000","last_became_peered":"2023-10-16T19:39:52.969619+0000","last_unstale":"2023-10-16T19:39:57.054955+0000","last_undegraded":"2023-10-16T19:39:57.054955+0000","last_fullsized":"2023-10-16T19:39:57.054955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988599+0000","last_change":"2023-10-16T19:39:52.977292+0000","last_active":"2023-10-16T19:39:56.988599+0000","last_peered":"2023-10-16T19:39:56.988599+0000","last_clean":"2023-10-16T19:39:56.988599+0000","last_became_active":"2023-10-16T19:39:52.976867+0000","last_became_peered":"2023-10-16T19:39:52.976867+0000","last_unstale":"2023-10-16T19:39:56.988599+0000","last_undegraded":"2023-10-16T19:39:56.988599+0000","last_fullsized":"2023-10-16T19:39:56.988599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056855+0000","last_change":"2023-10-16T19:39:52.971411+0000","last_active":"2023-10-16T19:39:57.056855+0000","last_peered":"2023-10-16T19:39:57.056855+0000","last_clean":"2023-10-16T19:39:57.056855+0000","last_became_active":"2023-10-16T19:39:52.971042+0000","last_became_peered":"2023-10-16T19:39:52.971042+0000","last_unstale":"2023-10-16T19:39:57.056855+0000","last_undegraded":"2023-10-16T19:39:57.056855+0000","last_fullsized":"2023-10-16T19:39:57.056855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:43.719224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978310+0000","last_change":"2023-10-16T19:39:52.966574+0000","last_active":"2023-10-16T19:39:56.978310+0000","last_peered":"2023-10-16T19:39:56.978310+0000","last_clean":"2023-10-16T19:39:56.978310+0000","last_became_active":"2023-10-16T19:39:52.966277+0000","last_became_peered":"2023-10-16T19:39:52.966277+0000","last_unstale":"2023-10-16T19:39:56.978310+0000","last_undegraded":"2023-10-16T19:39:56.978310+0000","last_fullsized":"2023-10-16T19:39:56.978310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978886+0000","last_change":"2023-10-16T19:39:52.971359+0000","last_active":"2023-10-16T19:39:56.978886+0000","last_peered":"2023-10-16T19:39:56.978886+0000","last_clean":"2023-10-16T19:39:56.978886+0000","last_became_active":"2023-10-16T19:39:52.971111+0000","last_became_peered":"2023-10-16T19:39:52.971111+0000","last_unstale":"2023-10-16T19:39:56.978886+0000","last_undegraded":"2023-10-16T19:39:56.978886+0000","last_fullsized":"2023-10-16T19:39:56.978886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979383+0000","last_change":"2023-10-16T19:39:52.966121+0000","last_active":"2023-10-16T19:39:56.979383+0000","last_peered":"2023-10-16T19:39:56.979383+0000","last_clean":"2023-10-16T19:39:56.979383+0000","last_became_active":"2023-10-16T19:39:52.965817+0000","last_became_peered":"2023-10-16T19:39:52.965817+0000","last_unstale":"2023-10-16T19:39:56.979383+0000","last_undegraded":"2023-10-16T19:39:56.979383+0000","last_fullsized":"2023-10-16T19:39:56.979383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996155+0000","last_change":"2023-10-16T19:39:52.971739+0000","last_active":"2023-10-16T19:39:56.996155+0000","last_peered":"2023-10-16T19:39:56.996155+0000","last_clean":"2023-10-16T19:39:56.996155+0000","last_became_active":"2023-10-16T19:39:52.970983+0000","last_became_peered":"2023-10-16T19:39:52.970983+0000","last_unstale":"2023-10-16T19:39:56.996155+0000","last_undegraded":"2023-10-16T19:39:56.996155+0000","last_fullsized":"2023-10-16T19:39:56.996155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982897+0000","last_change":"2023-10-16T19:39:52.962992+0000","last_active":"2023-10-16T19:39:56.982897+0000","last_peered":"2023-10-16T19:39:56.982897+0000","last_clean":"2023-10-16T19:39:56.982897+0000","last_became_active":"2023-10-16T19:39:52.962658+0000","last_became_peered":"2023-10-16T19:39:52.962658+0000","last_unstale":"2023-10-16T19:39:56.982897+0000","last_undegraded":"2023-10-16T19:39:56.982897+0000","last_fullsized":"2023-10-16T19:39:56.982897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.991949+0000","last_change":"2023-10-16T19:39:52.965403+0000","last_active":"2023-10-16T19:39:56.991949+0000","last_peered":"2023-10-16T19:39:56.991949+0000","last_clean":"2023-10-16T19:39:56.991949+0000","last_became_active":"2023-10-16T19:39:52.965160+0000","last_became_peered":"2023-10-16T19:39:52.965160+0000","last_unstale":"2023-10-16T19:39:56.991949+0000","last_undegraded":"2023-10-16T19:39:56.991949+0000","last_fullsized":"2023-10-16T19:39:56.991949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983686+0000","last_change":"2023-10-16T19:39:52.969063+0000","last_active":"2023-10-16T19:39:56.983686+0000","last_peered":"2023-10-16T19:39:56.983686+0000","last_clean":"2023-10-16T19:39:56.983686+0000","last_became_active":"2023-10-16T19:39:52.968770+0000","last_became_peered":"2023-10-16T19:39:52.968770+0000","last_unstale":"2023-10-16T19:39:56.983686+0000","last_undegraded":"2023-10-16T19:39:56.983686+0000","last_fullsized":"2023-10-16T19:39:56.983686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984501+0000","last_change":"2023-10-16T19:39:52.973031+0000","last_active":"2023-10-16T19:39:56.984501+0000","last_peered":"2023-10-16T19:39:56.984501+0000","last_clean":"2023-10-16T19:39:56.984501+0000","last_became_active":"2023-10-16T19:39:52.972734+0000","last_became_peered":"2023-10-16T19:39:52.972734+0000","last_unstale":"2023-10-16T19:39:56.984501+0000","last_undegraded":"2023-10-16T19:39:56.984501+0000","last_fullsized":"2023-10-16T19:39:56.984501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977146+0000","last_change":"2023-10-16T19:39:52.953856+0000","last_active":"2023-10-16T19:39:56.977146+0000","last_peered":"2023-10-16T19:39:56.977146+0000","last_clean":"2023-10-16T19:39:56.977146+0000","last_became_active":"2023-10-16T19:39:52.953556+0000","last_became_peered":"2023-10-16T19:39:52.953556+0000","last_unstale":"2023-10-16T19:39:56.977146+0000","last_undegraded":"2023-10-16T19:39:56.977146+0000","last_fullsized":"2023-10-16T19:39:56.977146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056318+0000","last_change":"2023-10-16T19:39:52.966778+0000","last_active":"2023-10-16T19:39:57.056318+0000","last_peered":"2023-10-16T19:39:57.056318+0000","last_clean":"2023-10-16T19:39:57.056318+0000","last_became_active":"2023-10-16T19:39:52.966444+0000","last_became_peered":"2023-10-16T19:39:52.966444+0000","last_unstale":"2023-10-16T19:39:57.056318+0000","last_undegraded":"2023-10-16T19:39:57.056318+0000","last_fullsized":"2023-10-16T19:39:57.056318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014044+0000","last_change":"2023-10-16T19:39:57.060100+0000","last_active":"2023-10-16T19:39:58.014044+0000","last_peered":"2023-10-16T19:39:58.014044+0000","last_clean":"2023-10-16T19:39:58.014044+0000","last_became_active":"2023-10-16T19:39:57.059654+0000","last_became_peered":"2023-10-16T19:39:57.059654+0000","last_unstale":"2023-10-16T19:39:58.014044+0000","last_undegraded":"2023-10-16T19:39:58.014044+0000","last_fullsized":"2023-10-16T19:39:58.014044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983501+0000","last_change":"2023-10-16T19:39:51.960397+0000","last_active":"2023-10-16T19:39:56.983501+0000","last_peered":"2023-10-16T19:39:56.983501+0000","last_clean":"2023-10-16T19:39:56.983501+0000","last_became_active":"2023-10-16T19:39:51.959720+0000","last_became_peered":"2023-10-16T19:39:51.959720+0000","last_unstale":"2023-10-16T19:39:56.983501+0000","last_undegraded":"2023-10-16T19:39:56.983501+0000","last_fullsized":"2023-10-16T19:39:56.983501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997016+0000","last_change":"2023-10-16T19:39:52.970235+0000","last_active":"2023-10-16T19:39:56.997016+0000","last_peered":"2023-10-16T19:39:56.997016+0000","last_clean":"2023-10-16T19:39:56.997016+0000","last_became_active":"2023-10-16T19:39:52.969954+0000","last_became_peered":"2023-10-16T19:39:52.969954+0000","last_unstale":"2023-10-16T19:39:56.997016+0000","last_undegraded":"2023-10-16T19:39:56.997016+0000","last_fullsized":"2023-10-16T19:39:56.997016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014481+0000","last_change":"2023-10-16T19:39:56.998346+0000","last_active":"2023-10-16T19:39:58.014481+0000","last_peered":"2023-10-16T19:39:58.014481+0000","last_clean":"2023-10-16T19:39:58.014481+0000","last_became_active":"2023-10-16T19:39:56.997873+0000","last_became_peered":"2023-10-16T19:39:56.997873+0000","last_unstale":"2023-10-16T19:39:58.014481+0000","last_undegraded":"2023-10-16T19:39:58.014481+0000","last_fullsized":"2023-10-16T19:39:58.014481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:23.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997110+0000","last_change":"2023-10-16T19:39:51.953173+0000","last_active":"2023-10-16T19:39:56.997110+0000","last_peered":"2023-10-16T19:39:56.997110+0000","last_clean":"2023-10-16T19:39:56.997110+0000","last_became_active":"2023-10-16T19:39:51.952008+0000","last_became_peered":"2023-10-16T19:39:51.952008+0000","last_unstale":"2023-10-16T19:39:56.997110+0000","last_undegraded":"2023-10-16T19:39:56.997110+0000","last_fullsized":"2023-10-16T19:39:56.997110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983121+0000","last_change":"2023-10-16T19:39:52.972725+0000","last_active":"2023-10-16T19:39:56.983121+0000","last_peered":"2023-10-16T19:39:56.983121+0000","last_clean":"2023-10-16T19:39:56.983121+0000","last_became_active":"2023-10-16T19:39:52.972414+0000","last_became_peered":"2023-10-16T19:39:52.972414+0000","last_unstale":"2023-10-16T19:39:56.983121+0000","last_undegraded":"2023-10-16T19:39:56.983121+0000","last_fullsized":"2023-10-16T19:39:56.983121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014362+0000","last_change":"2023-10-16T19:39:56.999448+0000","last_active":"2023-10-16T19:39:58.014362+0000","last_peered":"2023-10-16T19:39:58.014362+0000","last_clean":"2023-10-16T19:39:58.014362+0000","last_became_active":"2023-10-16T19:39:56.997855+0000","last_became_peered":"2023-10-16T19:39:56.997855+0000","last_unstale":"2023-10-16T19:39:58.014362+0000","last_undegraded":"2023-10-16T19:39:58.014362+0000","last_fullsized":"2023-10-16T19:39:58.014362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:56.072025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055844+0000","last_change":"2023-10-16T19:39:51.960815+0000","last_active":"2023-10-16T19:39:57.055844+0000","last_peered":"2023-10-16T19:39:57.055844+0000","last_clean":"2023-10-16T19:39:57.055844+0000","last_became_active":"2023-10-16T19:39:51.960470+0000","last_became_peered":"2023-10-16T19:39:51.960470+0000","last_unstale":"2023-10-16T19:39:57.055844+0000","last_undegraded":"2023-10-16T19:39:57.055844+0000","last_fullsized":"2023-10-16T19:39:57.055844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:35.736680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984118+0000","last_change":"2023-10-16T19:39:52.965519+0000","last_active":"2023-10-16T19:39:56.984118+0000","last_peered":"2023-10-16T19:39:56.984118+0000","last_clean":"2023-10-16T19:39:56.984118+0000","last_became_active":"2023-10-16T19:39:52.965232+0000","last_became_peered":"2023-10-16T19:39:52.965232+0000","last_unstale":"2023-10-16T19:39:56.984118+0000","last_undegraded":"2023-10-16T19:39:56.984118+0000","last_fullsized":"2023-10-16T19:39:56.984118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014702+0000","last_change":"2023-10-16T19:39:56.998686+0000","last_active":"2023-10-16T19:39:58.014702+0000","last_peered":"2023-10-16T19:39:58.014702+0000","last_clean":"2023-10-16T19:39:58.014702+0000","last_became_active":"2023-10-16T19:39:56.998124+0000","last_became_peered":"2023-10-16T19:39:56.998124+0000","last_unstale":"2023-10-16T19:39:58.014702+0000","last_undegraded":"2023-10-16T19:39:58.014702+0000","last_fullsized":"2023-10-16T19:39:58.014702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:09.298354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055487+0000","last_change":"2023-10-16T19:39:51.963066+0000","last_active":"2023-10-16T19:39:57.055487+0000","last_peered":"2023-10-16T19:39:57.055487+0000","last_clean":"2023-10-16T19:39:57.055487+0000","last_became_active":"2023-10-16T19:39:51.962643+0000","last_became_peered":"2023-10-16T19:39:51.962643+0000","last_unstale":"2023-10-16T19:39:57.055487+0000","last_undegraded":"2023-10-16T19:39:57.055487+0000","last_fullsized":"2023-10-16T19:39:57.055487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:47.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984874+0000","last_change":"2023-10-16T19:39:52.965735+0000","last_active":"2023-10-16T19:39:56.984874+0000","last_peered":"2023-10-16T19:39:56.984874+0000","last_clean":"2023-10-16T19:39:56.984874+0000","last_became_active":"2023-10-16T19:39:52.965467+0000","last_became_peered":"2023-10-16T19:39:52.965467+0000","last_unstale":"2023-10-16T19:39:56.984874+0000","last_undegraded":"2023-10-16T19:39:56.984874+0000","last_fullsized":"2023-10-16T19:39:56.984874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014328+0000","last_change":"2023-10-16T19:39:57.004000+0000","last_active":"2023-10-16T19:39:58.014328+0000","last_peered":"2023-10-16T19:39:58.014328+0000","last_clean":"2023-10-16T19:39:58.014328+0000","last_became_active":"2023-10-16T19:39:57.003585+0000","last_became_peered":"2023-10-16T19:39:57.003585+0000","last_unstale":"2023-10-16T19:39:58.014328+0000","last_undegraded":"2023-10-16T19:39:58.014328+0000","last_fullsized":"2023-10-16T19:39:58.014328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:49.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996688+0000","last_change":"2023-10-16T19:39:51.963390+0000","last_active":"2023-10-16T19:39:56.996688+0000","last_peered":"2023-10-16T19:39:56.996688+0000","last_clean":"2023-10-16T19:39:56.996688+0000","last_became_active":"2023-10-16T19:39:51.963076+0000","last_became_peered":"2023-10-16T19:39:51.963076+0000","last_unstale":"2023-10-16T19:39:56.996688+0000","last_undegraded":"2023-10-16T19:39:56.996688+0000","last_fullsized":"2023-10-16T19:39:56.996688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978342+0000","last_change":"2023-10-16T19:39:52.961791+0000","last_active":"2023-10-16T19:39:56.978342+0000","last_peered":"2023-10-16T19:39:56.978342+0000","last_clean":"2023-10-16T19:39:56.978342+0000","last_became_active":"2023-10-16T19:39:52.960383+0000","last_became_peered":"2023-10-16T19:39:52.960383+0000","last_unstale":"2023-10-16T19:39:56.978342+0000","last_undegraded":"2023-10-16T19:39:56.978342+0000","last_fullsized":"2023-10-16T19:39:56.978342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:48.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.375697+0000","last_change":"2023-10-16T19:39:56.998866+0000","last_active":"2023-10-16T19:39:58.375697+0000","last_peered":"2023-10-16T19:39:58.375697+0000","last_clean":"2023-10-16T19:39:58.375697+0000","last_became_active":"2023-10-16T19:39:56.998515+0000","last_became_peered":"2023-10-16T19:39:56.998515+0000","last_unstale":"2023-10-16T19:39:58.375697+0000","last_undegraded":"2023-10-16T19:39:58.375697+0000","last_fullsized":"2023-10-16T19:39:58.375697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:15.516547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978023+0000","last_change":"2023-10-16T19:39:51.952902+0000","last_active":"2023-10-16T19:39:56.978023+0000","last_peered":"2023-10-16T19:39:56.978023+0000","last_clean":"2023-10-16T19:39:56.978023+0000","last_became_active":"2023-10-16T19:39:51.952591+0000","last_became_peered":"2023-10-16T19:39:51.952591+0000","last_unstale":"2023-10-16T19:39:56.978023+0000","last_undegraded":"2023-10-16T19:39:56.978023+0000","last_fullsized":"2023-10-16T19:39:56.978023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982312+0000","last_change":"2023-10-16T19:39:52.970475+0000","last_active":"2023-10-16T19:39:56.982312+0000","last_peered":"2023-10-16T19:39:56.982312+0000","last_clean":"2023-10-16T19:39:56.982312+0000","last_became_active":"2023-10-16T19:39:52.968544+0000","last_became_peered":"2023-10-16T19:39:52.968544+0000","last_unstale":"2023-10-16T19:39:56.982312+0000","last_undegraded":"2023-10-16T19:39:56.982312+0000","last_fullsized":"2023-10-16T19:39:56.982312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015980+0000","last_change":"2023-10-16T19:39:56.994009+0000","last_active":"2023-10-16T19:39:58.015980+0000","last_peered":"2023-10-16T19:39:58.015980+0000","last_clean":"2023-10-16T19:39:58.015980+0000","last_became_active":"2023-10-16T19:39:56.993681+0000","last_became_peered":"2023-10-16T19:39:56.993681+0000","last_unstale":"2023-10-16T19:39:58.015980+0000","last_undegraded":"2023-10-16T19:39:58.015980+0000","last_fullsized":"2023-10-16T19:39:58.015980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995806+0000","last_change":"2023-10-16T19:39:51.963829+0000","last_active":"2023-10-16T19:39:56.995806+0000","last_peered":"2023-10-16T19:39:56.995806+0000","last_clean":"2023-10-16T19:39:56.995806+0000","last_became_active":"2023-10-16T19:39:51.962756+0000","last_became_peered":"2023-10-16T19:39:51.962756+0000","last_unstale":"2023-10-16T19:39:56.995806+0000","last_undegraded":"2023-10-16T19:39:56.995806+0000","last_fullsized":"2023-10-16T19:39:56.995806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988378+0000","last_change":"2023-10-16T19:39:52.969328+0000","last_active":"2023-10-16T19:39:56.988378+0000","last_peered":"2023-10-16T19:39:56.988378+0000","last_clean":"2023-10-16T19:39:56.988378+0000","last_became_active":"2023-10-16T19:39:52.968930+0000","last_became_peered":"2023-10-16T19:39:52.968930+0000","last_unstale":"2023-10-16T19:39:56.988378+0000","last_undegraded":"2023-10-16T19:39:56.988378+0000","last_fullsized":"2023-10-16T19:39:56.988378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753706+0000","last_change":"2023-10-16T19:39:57.060169+0000","last_active":"2023-10-16T19:39:58.753706+0000","last_peered":"2023-10-16T19:39:58.753706+0000","last_clean":"2023-10-16T19:39:58.753706+0000","last_became_active":"2023-10-16T19:39:57.059047+0000","last_became_peered":"2023-10-16T19:39:57.059047+0000","last_unstale":"2023-10-16T19:39:58.753706+0000","last_undegraded":"2023-10-16T19:39:58.753706+0000","last_fullsized":"2023-10-16T19:39:58.753706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983925+0000","last_change":"2023-10-16T19:39:51.965322+0000","last_active":"2023-10-16T19:39:56.983925+0000","last_peered":"2023-10-16T19:39:56.983925+0000","last_clean":"2023-10-16T19:39:56.983925+0000","last_became_active":"2023-10-16T19:39:51.964942+0000","last_became_peered":"2023-10-16T19:39:51.964942+0000","last_unstale":"2023-10-16T19:39:56.983925+0000","last_undegraded":"2023-10-16T19:39:56.983925+0000","last_fullsized":"2023-10-16T19:39:56.983925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992388+0000","last_change":"2023-10-16T19:39:52.959908+0000","last_active":"2023-10-16T19:39:56.992388+0000","last_peered":"2023-10-16T19:39:56.992388+0000","last_clean":"2023-10-16T19:39:56.992388+0000","last_became_active":"2023-10-16T19:39:52.959614+0000","last_became_peered":"2023-10-16T19:39:52.959614+0000","last_unstale":"2023-10-16T19:39:56.992388+0000","last_undegraded":"2023-10-16T19:39:56.992388+0000","last_fullsized":"2023-10-16T19:39:56.992388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013814+0000","last_change":"2023-10-16T19:39:57.060218+0000","last_active":"2023-10-16T19:39:58.013814+0000","last_peered":"2023-10-16T19:39:58.013814+0000","last_clean":"2023-10-16T19:39:58.013814+0000","last_became_active":"2023-10-16T19:39:57.059234+0000","last_became_peered":"2023-10-16T19:39:57.059234+0000","last_unstale":"2023-10-16T19:39:58.013814+0000","last_undegraded":"2023-10-16T19:39:58.013814+0000","last_fullsized":"2023-10-16T19:39:58.013814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978943+0000","last_change":"2023-10-16T19:39:51.958717+0000","last_active":"2023-10-16T19:39:56.978943+0000","last_peered":"2023-10-16T19:39:56.978943+0000","last_clean":"2023-10-16T19:39:56.978943+0000","last_became_active":"2023-10-16T19:39:51.958416+0000","last_became_peered":"2023-10-16T19:39:51.958416+0000","last_unstale":"2023-10-16T19:39:56.978943+0000","last_undegraded":"2023-10-16T19:39:56.978943+0000","last_fullsized":"2023-10-16T19:39:56.978943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983880+0000","last_change":"2023-10-16T19:39:52.972637+0000","last_active":"2023-10-16T19:39:56.983880+0000","last_peered":"2023-10-16T19:39:56.983880+0000","last_clean":"2023-10-16T19:39:56.983880+0000","last_became_active":"2023-10-16T19:39:52.970837+0000","last_became_peered":"2023-10-16T19:39:52.970837+0000","last_unstale":"2023-10-16T19:39:56.983880+0000","last_undegraded":"2023-10-16T19:39:56.983880+0000","last_fullsized":"2023-10-16T19:39:56.983880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013875+0000","last_change":"2023-10-16T19:39:57.000167+0000","last_active":"2023-10-16T19:39:58.013875+0000","last_peered":"2023-10-16T19:39:58.013875+0000","last_clean":"2023-10-16T19:39:58.013875+0000","last_became_active":"2023-10-16T19:39:56.999442+0000","last_became_peered":"2023-10-16T19:39:56.999442+0000","last_unstale":"2023-10-16T19:39:58.013875+0000","last_undegraded":"2023-10-16T19:39:58.013875+0000","last_fullsized":"2023-10-16T19:39:58.013875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:03.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983872+0000","last_change":"2023-10-16T19:39:51.961261+0000","last_active":"2023-10-16T19:39:56.983872+0000","last_peered":"2023-10-16T19:39:56.983872+0000","last_clean":"2023-10-16T19:39:56.983872+0000","last_became_active":"2023-10-16T19:39:51.960815+0000","last_became_peered":"2023-10-16T19:39:51.960815+0000","last_unstale":"2023-10-16T19:39:56.983872+0000","last_undegraded":"2023-10-16T19:39:56.983872+0000","last_fullsized":"2023-10-16T19:39:56.983872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:20.342371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983682+0000","last_change":"2023-10-16T19:39:52.972640+0000","last_active":"2023-10-16T19:39:56.983682+0000","last_peered":"2023-10-16T19:39:56.983682+0000","last_clean":"2023-10-16T19:39:56.983682+0000","last_became_active":"2023-10-16T19:39:52.972308+0000","last_became_peered":"2023-10-16T19:39:52.972308+0000","last_unstale":"2023-10-16T19:39:56.983682+0000","last_undegraded":"2023-10-16T19:39:56.983682+0000","last_fullsized":"2023-10-16T19:39:56.983682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014924+0000","last_change":"2023-10-16T19:39:56.995225+0000","last_active":"2023-10-16T19:39:58.014924+0000","last_peered":"2023-10-16T19:39:58.014924+0000","last_clean":"2023-10-16T19:39:58.014924+0000","last_became_active":"2023-10-16T19:39:56.994760+0000","last_became_peered":"2023-10-16T19:39:56.994760+0000","last_unstale":"2023-10-16T19:39:58.014924+0000","last_undegraded":"2023-10-16T19:39:58.014924+0000","last_fullsized":"2023-10-16T19:39:58.014924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:43.007379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993849+0000","last_change":"2023-10-16T19:39:51.962481+0000","last_active":"2023-10-16T19:39:56.993849+0000","last_peered":"2023-10-16T19:39:56.993849+0000","last_clean":"2023-10-16T19:39:56.993849+0000","last_became_active":"2023-10-16T19:39:51.962183+0000","last_became_peered":"2023-10-16T19:39:51.962183+0000","last_unstale":"2023-10-16T19:39:56.993849+0000","last_undegraded":"2023-10-16T19:39:56.993849+0000","last_fullsized":"2023-10-16T19:39:56.993849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979596+0000","last_change":"2023-10-16T19:39:52.974753+0000","last_active":"2023-10-16T19:39:56.979596+0000","last_peered":"2023-10-16T19:39:56.979596+0000","last_clean":"2023-10-16T19:39:56.979596+0000","last_became_active":"2023-10-16T19:39:52.974437+0000","last_became_peered":"2023-10-16T19:39:52.974437+0000","last_unstale":"2023-10-16T19:39:56.979596+0000","last_undegraded":"2023-10-16T19:39:56.979596+0000","last_fullsized":"2023-10-16T19:39:56.979596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988925+0000","last_change":"2023-10-16T19:39:57.008281+0000","last_active":"2023-10-16T19:39:58.988925+0000","last_peered":"2023-10-16T19:39:58.988925+0000","last_clean":"2023-10-16T19:39:58.988925+0000","last_became_active":"2023-10-16T19:39:57.007275+0000","last_became_peered":"2023-10-16T19:39:57.007275+0000","last_unstale":"2023-10-16T19:39:58.988925+0000","last_undegraded":"2023-10-16T19:39:58.988925+0000","last_fullsized":"2023-10-16T19:39:58.988925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:40:08.652465+0000","last_change":"2023-10-16T19:39:51.949368+0000","last_active":"2023-10-16T19:40:08.652465+0000","last_peered":"2023-10-16T19:40:08.652465+0000","last_clean":"2023-10-16T19:40:08.652465+0000","last_became_active":"2023-10-16T19:39:51.948876+0000","last_became_peered":"2023-10-16T19:39:51.948876+0000","last_unstale":"2023-10-16T19:40:08.652465+0000","last_undegraded":"2023-10-16T19:40:08.652465+0000","last_fullsized":"2023-10-16T19:40:08.652465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.058349+0000","last_change":"2023-10-16T19:39:52.975376+0000","last_active":"2023-10-16T19:39:57.058349+0000","last_peered":"2023-10-16T19:39:57.058349+0000","last_clean":"2023-10-16T19:39:57.058349+0000","last_became_active":"2023-10-16T19:39:52.975093+0000","last_became_peered":"2023-10-16T19:39:52.975093+0000","last_unstale":"2023-10-16T19:39:57.058349+0000","last_undegraded":"2023-10-16T19:39:57.058349+0000","last_fullsized":"2023-10-16T19:39:57.058349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707865+0000","last_change":"2023-10-16T19:39:57.058788+0000","last_active":"2023-10-16T19:39:58.707865+0000","last_peered":"2023-10-16T19:39:58.707865+0000","last_clean":"2023-10-16T19:39:58.707865+0000","last_became_active":"2023-10-16T19:39:57.058309+0000","last_became_peered":"2023-10-16T19:39:57.058309+0000","last_unstale":"2023-10-16T19:39:58.707865+0000","last_undegraded":"2023-10-16T19:39:58.707865+0000","last_fullsized":"2023-10-16T19:39:58.707865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983378+0000","last_change":"2023-10-16T19:39:51.948746+0000","last_active":"2023-10-16T19:39:56.983378+0000","last_peered":"2023-10-16T19:39:56.983378+0000","last_clean":"2023-10-16T19:39:56.983378+0000","last_became_active":"2023-10-16T19:39:51.948396+0000","last_became_peered":"2023-10-16T19:39:51.948396+0000","last_unstale":"2023-10-16T19:39:56.983378+0000","last_undegraded":"2023-10-16T19:39:56.983378+0000","last_fullsized":"2023-10-16T19:39:56.983378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983007+0000","last_change":"2023-10-16T19:39:52.968344+0000","last_active":"2023-10-16T19:39:56.983007+0000","last_peered":"2023-10-16T19:39:56.983007+0000","last_clean":"2023-10-16T19:39:56.983007+0000","last_became_active":"2023-10-16T19:39:52.967192+0000","last_became_peered":"2023-10-16T19:39:52.967192+0000","last_unstale":"2023-10-16T19:39:56.983007+0000","last_undegraded":"2023-10-16T19:39:56.983007+0000","last_fullsized":"2023-10-16T19:39:56.983007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014138+0000","last_change":"2023-10-16T19:39:57.055830+0000","last_active":"2023-10-16T19:39:58.014138+0000","last_peered":"2023-10-16T19:39:58.014138+0000","last_clean":"2023-10-16T19:39:58.014138+0000","last_became_active":"2023-10-16T19:39:57.055354+0000","last_became_peered":"2023-10-16T19:39:57.055354+0000","last_unstale":"2023-10-16T19:39:58.014138+0000","last_undegraded":"2023-10-16T19:39:58.014138+0000","last_fullsized":"2023-10-16T19:39:58.014138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:29.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983949+0000","last_change":"2023-10-16T19:39:51.964774+0000","last_active":"2023-10-16T19:39:56.983949+0000","last_peered":"2023-10-16T19:39:56.983949+0000","last_clean":"2023-10-16T19:39:56.983949+0000","last_became_active":"2023-10-16T19:39:51.964474+0000","last_became_peered":"2023-10-16T19:39:51.964474+0000","last_unstale":"2023-10-16T19:39:56.983949+0000","last_undegraded":"2023-10-16T19:39:56.983949+0000","last_fullsized":"2023-10-16T19:39:56.983949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055729+0000","last_change":"2023-10-16T19:39:52.968350+0000","last_active":"2023-10-16T19:39:57.055729+0000","last_peered":"2023-10-16T19:39:57.055729+0000","last_clean":"2023-10-16T19:39:57.055729+0000","last_became_active":"2023-10-16T19:39:52.968051+0000","last_became_peered":"2023-10-16T19:39:52.968051+0000","last_unstale":"2023-10-16T19:39:57.055729+0000","last_undegraded":"2023-10-16T19:39:57.055729+0000","last_fullsized":"2023-10-16T19:39:57.055729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014589+0000","last_change":"2023-10-16T19:39:57.059505+0000","last_active":"2023-10-16T19:39:58.014589+0000","last_peered":"2023-10-16T19:39:58.014589+0000","last_clean":"2023-10-16T19:39:58.014589+0000","last_became_active":"2023-10-16T19:39:57.059040+0000","last_became_peered":"2023-10-16T19:39:57.059040+0000","last_unstale":"2023-10-16T19:39:58.014589+0000","last_undegraded":"2023-10-16T19:39:58.014589+0000","last_fullsized":"2023-10-16T19:39:58.014589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:11.600778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978736+0000","last_change":"2023-10-16T19:39:51.953128+0000","last_active":"2023-10-16T19:39:56.978736+0000","last_peered":"2023-10-16T19:39:56.978736+0000","last_clean":"2023-10-16T19:39:56.978736+0000","last_became_active":"2023-10-16T19:39:51.952236+0000","last_became_peered":"2023-10-16T19:39:51.952236+0000","last_unstale":"2023-10-16T19:39:56.978736+0000","last_undegraded":"2023-10-16T19:39:56.978736+0000","last_fullsized":"2023-10-16T19:39:56.978736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:33.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977997+0000","last_change":"2023-10-16T19:39:52.967912+0000","last_active":"2023-10-16T19:39:56.977997+0000","last_peered":"2023-10-16T19:39:56.977997+0000","last_clean":"2023-10-16T19:39:56.977997+0000","last_became_active":"2023-10-16T19:39:52.967616+0000","last_became_peered":"2023-10-16T19:39:52.967616+0000","last_unstale":"2023-10-16T19:39:56.977997+0000","last_undegraded":"2023-10-16T19:39:56.977997+0000","last_fullsized":"2023-10-16T19:39:56.977997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.000483+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.000036+0000","last_became_peered":"2023-10-16T19:39:57.000036+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:47.756036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976895+0000","last_change":"2023-10-16T19:39:51.956225+0000","last_active":"2023-10-16T19:39:56.976895+0000","last_peered":"2023-10-16T19:39:56.976895+0000","last_clean":"2023-10-16T19:39:56.976895+0000","last_became_active":"2023-10-16T19:39:51.955913+0000","last_became_peered":"2023-10-16T19:39:51.955913+0000","last_unstale":"2023-10-16T19:39:56.976895+0000","last_undegraded":"2023-10-16T19:39:56.976895+0000","last_fullsized":"2023-10-16T19:39:56.976895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:55.435969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055053+0000","last_change":"2023-10-16T19:39:52.968227+0000","last_active":"2023-10-16T19:39:57.055053+0000","last_peered":"2023-10-16T19:39:57.055053+0000","last_clean":"2023-10-16T19:39:57.055053+0000","last_became_active":"2023-10-16T19:39:52.967354+0000","last_became_peered":"2023-10-16T19:39:52.967354+0000","last_unstale":"2023-10-16T19:39:57.055053+0000","last_undegraded":"2023-10-16T19:39:57.055053+0000","last_fullsized":"2023-10-16T19:39:57.055053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015289+0000","last_change":"2023-10-16T19:39:56.999092+0000","last_active":"2023-10-16T19:39:58.015289+0000","last_peered":"2023-10-16T19:39:58.015289+0000","last_clean":"2023-10-16T19:39:58.015289+0000","last_became_active":"2023-10-16T19:39:56.998522+0000","last_became_peered":"2023-10-16T19:39:56.998522+0000","last_unstale":"2023-10-16T19:39:58.015289+0000","last_undegraded":"2023-10-16T19:39:58.015289+0000","last_fullsized":"2023-10-16T19:39:58.015289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:40.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979452+0000","last_change":"2023-10-16T19:39:51.962668+0000","last_active":"2023-10-16T19:39:56.979452+0000","last_peered":"2023-10-16T19:39:56.979452+0000","last_clean":"2023-10-16T19:39:56.979452+0000","last_became_active":"2023-10-16T19:39:51.962380+0000","last_became_peered":"2023-10-16T19:39:51.962380+0000","last_unstale":"2023-10-16T19:39:56.979452+0000","last_undegraded":"2023-10-16T19:39:56.979452+0000","last_fullsized":"2023-10-16T19:39:56.979452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055973+0000","last_change":"2023-10-16T19:39:52.967234+0000","last_active":"2023-10-16T19:39:57.055973+0000","last_peered":"2023-10-16T19:39:57.055973+0000","last_clean":"2023-10-16T19:39:57.055973+0000","last_became_active":"2023-10-16T19:39:52.966932+0000","last_became_peered":"2023-10-16T19:39:52.966932+0000","last_unstale":"2023-10-16T19:39:57.055973+0000","last_undegraded":"2023-10-16T19:39:57.055973+0000","last_fullsized":"2023-10-16T19:39:57.055973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988889+0000","last_change":"2023-10-16T19:39:57.008404+0000","last_active":"2023-10-16T19:39:58.988889+0000","last_peered":"2023-10-16T19:39:58.988889+0000","last_clean":"2023-10-16T19:39:58.988889+0000","last_became_active":"2023-10-16T19:39:57.007860+0000","last_became_peered":"2023-10-16T19:39:57.007860+0000","last_unstale":"2023-10-16T19:39:58.988889+0000","last_undegraded":"2023-10-16T19:39:58.988889+0000","last_fullsized":"2023-10-16T19:39:58.988889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993704+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.993704+0000","last_peered":"2023-10-16T19:39:56.993704+0000","last_clean":"2023-10-16T19:39:56.993704+0000","last_became_active":"2023-10-16T19:39:51.956344+0000","last_became_peered":"2023-10-16T19:39:51.956344+0000","last_unstale":"2023-10-16T19:39:56.993704+0000","last_undegraded":"2023-10-16T19:39:56.993704+0000","last_fullsized":"2023-10-16T19:39:56.993704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:07.860685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984972+0000","last_change":"2023-10-16T19:39:52.976139+0000","last_active":"2023-10-16T19:39:56.984972+0000","last_peered":"2023-10-16T19:39:56.984972+0000","last_clean":"2023-10-16T19:39:56.984972+0000","last_became_active":"2023-10-16T19:39:52.975846+0000","last_became_peered":"2023-10-16T19:39:52.975846+0000","last_unstale":"2023-10-16T19:39:56.984972+0000","last_undegraded":"2023-10-16T19:39:56.984972+0000","last_fullsized":"2023-10-16T19:39:56.984972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988843+0000","last_change":"2023-10-16T19:39:57.005213+0000","last_active":"2023-10-16T19:39:58.988843+0000","last_peered":"2023-10-16T19:39:58.988843+0000","last_clean":"2023-10-16T19:39:58.988843+0000","last_became_active":"2023-10-16T19:39:57.004875+0000","last_became_peered":"2023-10-16T19:39:57.004875+0000","last_unstale":"2023-10-16T19:39:58.988843+0000","last_undegraded":"2023-10-16T19:39:58.988843+0000","last_fullsized":"2023-10-16T19:39:58.988843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983833+0000","last_change":"2023-10-16T19:39:51.966189+0000","last_active":"2023-10-16T19:39:56.983833+0000","last_peered":"2023-10-16T19:39:56.983833+0000","last_clean":"2023-10-16T19:39:56.983833+0000","last_became_active":"2023-10-16T19:39:51.965851+0000","last_became_peered":"2023-10-16T19:39:51.965851+0000","last_unstale":"2023-10-16T19:39:56.983833+0000","last_undegraded":"2023-10-16T19:39:56.983833+0000","last_fullsized":"2023-10-16T19:39:56.983833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979924+0000","last_change":"2023-10-16T19:39:52.969798+0000","last_active":"2023-10-16T19:39:56.979924+0000","last_peered":"2023-10-16T19:39:56.979924+0000","last_clean":"2023-10-16T19:39:56.979924+0000","last_became_active":"2023-10-16T19:39:52.969403+0000","last_became_peered":"2023-10-16T19:39:52.969403+0000","last_unstale":"2023-10-16T19:39:56.979924+0000","last_undegraded":"2023-10-16T19:39:56.979924+0000","last_fullsized":"2023-10-16T19:39:56.979924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:18.043026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989269+0000","last_change":"2023-10-16T19:39:57.006715+0000","last_active":"2023-10-16T19:39:58.989269+0000","last_peered":"2023-10-16T19:39:58.989269+0000","last_clean":"2023-10-16T19:39:58.989269+0000","last_became_active":"2023-10-16T19:39:57.006456+0000","last_became_peered":"2023-10-16T19:39:57.006456+0000","last_unstale":"2023-10-16T19:39:58.989269+0000","last_undegraded":"2023-10-16T19:39:58.989269+0000","last_fullsized":"2023-10-16T19:39:58.989269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992572+0000","last_change":"2023-10-16T19:39:52.959610+0000","last_active":"2023-10-16T19:39:56.992572+0000","last_peered":"2023-10-16T19:39:56.992572+0000","last_clean":"2023-10-16T19:39:56.992572+0000","last_became_active":"2023-10-16T19:39:52.959281+0000","last_became_peered":"2023-10-16T19:39:52.959281+0000","last_unstale":"2023-10-16T19:39:56.992572+0000","last_undegraded":"2023-10-16T19:39:56.992572+0000","last_fullsized":"2023-10-16T19:39:56.992572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976892+0000","last_change":"2023-10-16T19:39:51.959600+0000","last_active":"2023-10-16T19:39:56.976892+0000","last_peered":"2023-10-16T19:39:56.976892+0000","last_clean":"2023-10-16T19:39:56.976892+0000","last_became_active":"2023-10-16T19:39:51.959297+0000","last_became_peered":"2023-10-16T19:39:51.959297+0000","last_unstale":"2023-10-16T19:39:56.976892+0000","last_undegraded":"2023-10-16T19:39:56.976892+0000","last_fullsized":"2023-10-16T19:39:56.976892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015841+0000","last_change":"2023-10-16T19:39:57.059572+0000","last_active":"2023-10-16T19:39:58.015841+0000","last_peered":"2023-10-16T19:39:58.015841+0000","last_clean":"2023-10-16T19:39:58.015841+0000","last_became_active":"2023-10-16T19:39:57.059178+0000","last_became_peered":"2023-10-16T19:39:57.059178+0000","last_unstale":"2023-10-16T19:39:58.015841+0000","last_undegraded":"2023-10-16T19:39:58.015841+0000","last_fullsized":"2023-10-16T19:39:58.015841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.986497+0000","last_change":"2023-10-16T19:39:52.976022+0000","last_active":"2023-10-16T19:39:56.986497+0000","last_peered":"2023-10-16T19:39:56.986497+0000","last_clean":"2023-10-16T19:39:56.986497+0000","last_became_active":"2023-10-16T19:39:52.971031+0000","last_became_peered":"2023-10-16T19:39:52.971031+0000","last_unstale":"2023-10-16T19:39:56.986497+0000","last_undegraded":"2023-10-16T19:39:56.986497+0000","last_fullsized":"2023-10-16T19:39:56.986497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984582+0000","last_change":"2023-10-16T19:39:51.965776+0000","last_active":"2023-10-16T19:39:56.984582+0000","last_peered":"2023-10-16T19:39:56.984582+0000","last_clean":"2023-10-16T19:39:56.984582+0000","last_became_active":"2023-10-16T19:39:51.965449+0000","last_became_peered":"2023-10-16T19:39:51.965449+0000","last_unstale":"2023-10-16T19:39:56.984582+0000","last_undegraded":"2023-10-16T19:39:56.984582+0000","last_fullsized":"2023-10-16T19:39:56.984582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054846+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:39:57.054846+0000","last_peered":"2023-10-16T19:39:57.054846+0000","last_clean":"2023-10-16T19:39:57.054846+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:39:57.054846+0000","last_undegraded":"2023-10-16T19:39:57.054846+0000","last_fullsized":"2023-10-16T19:39:57.054846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.057034+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.056631+0000","last_became_peered":"2023-10-16T19:39:57.056631+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.981859+0000","last_change":"2023-10-16T19:39:52.968932+0000","last_active":"2023-10-16T19:39:56.981859+0000","last_peered":"2023-10-16T19:39:56.981859+0000","last_clean":"2023-10-16T19:39:56.981859+0000","last_became_active":"2023-10-16T19:39:52.968511+0000","last_became_peered":"2023-10-16T19:39:52.968511+0000","last_unstale":"2023-10-16T19:39:56.981859+0000","last_undegraded":"2023-10-16T19:39:56.981859+0000","last_fullsized":"2023-10-16T19:39:56.981859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:11.479736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054988+0000","last_change":"2023-10-16T19:39:51.960837+0000","last_active":"2023-10-16T19:39:57.054988+0000","last_peered":"2023-10-16T19:39:57.054988+0000","last_clean":"2023-10-16T19:39:57.054988+0000","last_became_active":"2023-10-16T19:39:51.960545+0000","last_became_peered":"2023-10-16T19:39:51.960545+0000","last_unstale":"2023-10-16T19:39:57.054988+0000","last_undegraded":"2023-10-16T19:39:57.054988+0000","last_fullsized":"2023-10-16T19:39:57.054988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752919+0000","last_change":"2023-10-16T19:39:57.055815+0000","last_active":"2023-10-16T19:39:58.752919+0000","last_peered":"2023-10-16T19:39:58.752919+0000","last_clean":"2023-10-16T19:39:58.752919+0000","last_became_active":"2023-10-16T19:39:57.055391+0000","last_became_peered":"2023-10-16T19:39:57.055391+0000","last_unstale":"2023-10-16T19:39:58.752919+0000","last_undegraded":"2023-10-16T19:39:58.752919+0000","last_fullsized":"2023-10-16T19:39:58.752919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055422+0000","last_change":"2023-10-16T19:39:51.967737+0000","last_active":"2023-10-16T19:39:57.055422+0000","last_peered":"2023-10-16T19:39:57.055422+0000","last_clean":"2023-10-16T19:39:57.055422+0000","last_became_active":"2023-10-16T19:39:51.967471+0000","last_became_peered":"2023-10-16T19:39:51.967471+0000","last_unstale":"2023-10-16T19:39:57.055422+0000","last_undegraded":"2023-10-16T19:39:57.055422+0000","last_fullsized":"2023-10-16T19:39:57.055422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:25.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993807+0000","last_change":"2023-10-16T19:39:52.955655+0000","last_active":"2023-10-16T19:39:56.993807+0000","last_peered":"2023-10-16T19:39:56.993807+0000","last_clean":"2023-10-16T19:39:56.993807+0000","last_became_active":"2023-10-16T19:39:52.955304+0000","last_became_peered":"2023-10-16T19:39:52.955304+0000","last_unstale":"2023-10-16T19:39:56.993807+0000","last_undegraded":"2023-10-16T19:39:56.993807+0000","last_fullsized":"2023-10-16T19:39:56.993807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013463+0000","last_change":"2023-10-16T19:39:57.059558+0000","last_active":"2023-10-16T19:39:58.013463+0000","last_peered":"2023-10-16T19:39:58.013463+0000","last_clean":"2023-10-16T19:39:58.013463+0000","last_became_active":"2023-10-16T19:39:57.059184+0000","last_became_peered":"2023-10-16T19:39:57.059184+0000","last_unstale":"2023-10-16T19:39:58.013463+0000","last_undegraded":"2023-10-16T19:39:58.013463+0000","last_fullsized":"2023-10-16T19:39:58.013463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995142+0000","last_change":"2023-10-16T19:39:51.959372+0000","last_active":"2023-10-16T19:39:56.995142+0000","last_peered":"2023-10-16T19:39:56.995142+0000","last_clean":"2023-10-16T19:39:56.995142+0000","last_became_active":"2023-10-16T19:39:51.959042+0000","last_became_peered":"2023-10-16T19:39:51.959042+0000","last_unstale":"2023-10-16T19:39:56.995142+0000","last_undegraded":"2023-10-16T19:39:56.995142+0000","last_fullsized":"2023-10-16T19:39:56.995142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000396+0000","last_change":"2023-10-16T19:39:52.971901+0000","last_active":"2023-10-16T19:39:57.000396+0000","last_peered":"2023-10-16T19:39:57.000396+0000","last_clean":"2023-10-16T19:39:57.000396+0000","last_became_active":"2023-10-16T19:39:52.971585+0000","last_became_peered":"2023-10-16T19:39:52.971585+0000","last_unstale":"2023-10-16T19:39:57.000396+0000","last_undegraded":"2023-10-16T19:39:57.000396+0000","last_fullsized":"2023-10-16T19:39:57.000396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014361+0000","last_change":"2023-10-16T19:39:57.058350+0000","last_active":"2023-10-16T19:39:58.014361+0000","last_peered":"2023-10-16T19:39:58.014361+0000","last_clean":"2023-10-16T19:39:58.014361+0000","last_became_active":"2023-10-16T19:39:57.057923+0000","last_became_peered":"2023-10-16T19:39:57.057923+0000","last_unstale":"2023-10-16T19:39:58.014361+0000","last_undegraded":"2023-10-16T19:39:58.014361+0000","last_fullsized":"2023-10-16T19:39:58.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:30.363712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978788+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.978788+0000","last_peered":"2023-10-16T19:39:56.978788+0000","last_clean":"2023-10-16T19:39:56.978788+0000","last_became_active":"2023-10-16T19:39:51.956150+0000","last_became_peered":"2023-10-16T19:39:51.956150+0000","last_unstale":"2023-10-16T19:39:56.978788+0000","last_undegraded":"2023-10-16T19:39:56.978788+0000","last_fullsized":"2023-10-16T19:39:56.978788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.989271+0000","last_change":"2023-10-16T19:39:52.966065+0000","last_active":"2023-10-16T19:39:56.989271+0000","last_peered":"2023-10-16T19:39:56.989271+0000","last_clean":"2023-10-16T19:39:56.989271+0000","last_became_active":"2023-10-16T19:39:52.965732+0000","last_became_peered":"2023-10-16T19:39:52.965732+0000","last_unstale":"2023-10-16T19:39:56.989271+0000","last_undegraded":"2023-10-16T19:39:56.989271+0000","last_fullsized":"2023-10-16T19:39:56.989271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014987+0000","last_change":"2023-10-16T19:39:56.998411+0000","last_active":"2023-10-16T19:39:58.014987+0000","last_peered":"2023-10-16T19:39:58.014987+0000","last_clean":"2023-10-16T19:39:58.014987+0000","last_became_active":"2023-10-16T19:39:56.997765+0000","last_became_peered":"2023-10-16T19:39:56.997765+0000","last_unstale":"2023-10-16T19:39:58.014987+0000","last_undegraded":"2023-10-16T19:39:58.014987+0000","last_fullsized":"2023-10-16T19:39:58.014987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:48.787388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054917+0000","last_change":"2023-10-16T19:39:51.967870+0000","last_active":"2023-10-16T19:39:57.054917+0000","last_peered":"2023-10-16T19:39:57.054917+0000","last_clean":"2023-10-16T19:39:57.054917+0000","last_became_active":"2023-10-16T19:39:51.967540+0000","last_became_peered":"2023-10-16T19:39:51.967540+0000","last_unstale":"2023-10-16T19:39:57.054917+0000","last_undegraded":"2023-10-16T19:39:57.054917+0000","last_fullsized":"2023-10-16T19:39:57.054917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979126+0000","last_change":"2023-10-16T19:39:52.969100+0000","last_active":"2023-10-16T19:39:56.979126+0000","last_peered":"2023-10-16T19:39:56.979126+0000","last_clean":"2023-10-16T19:39:56.979126+0000","last_became_active":"2023-10-16T19:39:52.968640+0000","last_became_peered":"2023-10-16T19:39:52.968640+0000","last_unstale":"2023-10-16T19:39:56.979126+0000","last_undegraded":"2023-10-16T19:39:56.979126+0000","last_fullsized":"2023-10-16T19:39:56.979126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:36.664859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989349+0000","last_change":"2023-10-16T19:39:57.055862+0000","last_active":"2023-10-16T19:39:58.989349+0000","last_peered":"2023-10-16T19:39:58.989349+0000","last_clean":"2023-10-16T19:39:58.989349+0000","last_became_active":"2023-10-16T19:39:57.055442+0000","last_became_peered":"2023-10-16T19:39:57.055442+0000","last_unstale":"2023-10-16T19:39:58.989349+0000","last_undegraded":"2023-10-16T19:39:58.989349+0000","last_fullsized":"2023-10-16T19:39:58.989349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992158+0000","last_change":"2023-10-16T19:39:51.963084+0000","last_active":"2023-10-16T19:39:56.992158+0000","last_peered":"2023-10-16T19:39:56.992158+0000","last_clean":"2023-10-16T19:39:56.992158+0000","last_became_active":"2023-10-16T19:39:51.962807+0000","last_became_peered":"2023-10-16T19:39:51.962807+0000","last_unstale":"2023-10-16T19:39:56.992158+0000","last_undegraded":"2023-10-16T19:39:56.992158+0000","last_fullsized":"2023-10-16T19:39:56.992158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988486+0000","last_change":"2023-10-16T19:39:52.978428+0000","last_active":"2023-10-16T19:39:56.988486+0000","last_peered":"2023-10-16T19:39:56.988486+0000","last_clean":"2023-10-16T19:39:56.988486+0000","last_became_active":"2023-10-16T19:39:52.978101+0000","last_became_peered":"2023-10-16T19:39:52.978101+0000","last_unstale":"2023-10-16T19:39:56.988486+0000","last_undegraded":"2023-10-16T19:39:56.988486+0000","last_fullsized":"2023-10-16T19:39:56.988486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015410+0000","last_change":"2023-10-16T19:39:56.998806+0000","last_active":"2023-10-16T19:39:58.015410+0000","last_peered":"2023-10-16T19:39:58.015410+0000","last_clean":"2023-10-16T19:39:58.015410+0000","last_became_active":"2023-10-16T19:39:56.997925+0000","last_became_peered":"2023-10-16T19:39:56.997925+0000","last_unstale":"2023-10-16T19:39:58.015410+0000","last_undegraded":"2023-10-16T19:39:58.015410+0000","last_fullsized":"2023-10-16T19:39:58.015410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:08.168565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992271+0000","last_change":"2023-10-16T19:39:51.964864+0000","last_active":"2023-10-16T19:39:56.992271+0000","last_peered":"2023-10-16T19:39:56.992271+0000","last_clean":"2023-10-16T19:39:56.992271+0000","last_became_active":"2023-10-16T19:39:51.964479+0000","last_became_peered":"2023-10-16T19:39:51.964479+0000","last_unstale":"2023-10-16T19:39:56.992271+0000","last_undegraded":"2023-10-16T19:39:56.992271+0000","last_fullsized":"2023-10-16T19:39:56.992271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.659971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996915+0000","last_change":"2023-10-16T19:39:52.971775+0000","last_active":"2023-10-16T19:39:56.996915+0000","last_peered":"2023-10-16T19:39:56.996915+0000","last_clean":"2023-10-16T19:39:56.996915+0000","last_became_active":"2023-10-16T19:39:52.971381+0000","last_became_peered":"2023-10-16T19:39:52.971381+0000","last_unstale":"2023-10-16T19:39:56.996915+0000","last_undegraded":"2023-10-16T19:39:56.996915+0000","last_fullsized":"2023-10-16T19:39:56.996915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015073+0000","last_change":"2023-10-16T19:39:56.995155+0000","last_active":"2023-10-16T19:39:58.015073+0000","last_peered":"2023-10-16T19:39:58.015073+0000","last_clean":"2023-10-16T19:39:58.015073+0000","last_became_active":"2023-10-16T19:39:56.994693+0000","last_became_peered":"2023-10-16T19:39:56.994693+0000","last_unstale":"2023-10-16T19:39:58.015073+0000","last_undegraded":"2023-10-16T19:39:58.015073+0000","last_fullsized":"2023-10-16T19:39:58.015073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055607+0000","last_change":"2023-10-16T19:39:51.961933+0000","last_active":"2023-10-16T19:39:57.055607+0000","last_peered":"2023-10-16T19:39:57.055607+0000","last_clean":"2023-10-16T19:39:57.055607+0000","last_became_active":"2023-10-16T19:39:51.961548+0000","last_became_peered":"2023-10-16T19:39:51.961548+0000","last_unstale":"2023-10-16T19:39:57.055607+0000","last_undegraded":"2023-10-16T19:39:57.055607+0000","last_fullsized":"2023-10-16T19:39:57.055607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978123+0000","last_change":"2023-10-16T19:39:52.959823+0000","last_active":"2023-10-16T19:39:56.978123+0000","last_peered":"2023-10-16T19:39:56.978123+0000","last_clean":"2023-10-16T19:39:56.978123+0000","last_became_active":"2023-10-16T19:39:52.959508+0000","last_became_peered":"2023-10-16T19:39:52.959508+0000","last_unstale":"2023-10-16T19:39:56.978123+0000","last_undegraded":"2023-10-16T19:39:56.978123+0000","last_fullsized":"2023-10-16T19:39:56.978123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015856+0000","last_change":"2023-10-16T19:39:57.055819+0000","last_active":"2023-10-16T19:39:58.015856+0000","last_peered":"2023-10-16T19:39:58.015856+0000","last_clean":"2023-10-16T19:39:58.015856+0000","last_became_active":"2023-10-16T19:39:57.055371+0000","last_became_peered":"2023-10-16T19:39:57.055371+0000","last_unstale":"2023-10-16T19:39:58.015856+0000","last_undegraded":"2023-10-16T19:39:58.015856+0000","last_fullsized":"2023-10-16T19:39:58.015856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977712+0000","last_change":"2023-10-16T19:39:51.962380+0000","last_active":"2023-10-16T19:39:56.977712+0000","last_peered":"2023-10-16T19:39:56.977712+0000","last_clean":"2023-10-16T19:39:56.977712+0000","last_became_active":"2023-10-16T19:39:51.962053+0000","last_became_peered":"2023-10-16T19:39:51.962053+0000","last_unstale":"2023-10-16T19:39:56.977712+0000","last_undegraded":"2023-10-16T19:39:56.977712+0000","last_fullsized":"2023-10-16T19:39:56.977712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055763+0000","last_change":"2023-10-16T19:39:52.973102+0000","last_active":"2023-10-16T19:39:57.055763+0000","last_peered":"2023-10-16T19:39:57.055763+0000","last_clean":"2023-10-16T19:39:57.055763+0000","last_became_active":"2023-10-16T19:39:52.972823+0000","last_became_peered":"2023-10-16T19:39:52.972823+0000","last_unstale":"2023-10-16T19:39:57.055763+0000","last_undegraded":"2023-10-16T19:39:57.055763+0000","last_fullsized":"2023-10-16T19:39:57.055763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752852+0000","last_change":"2023-10-16T19:39:56.998067+0000","last_active":"2023-10-16T19:39:58.752852+0000","last_peered":"2023-10-16T19:39:58.752852+0000","last_clean":"2023-10-16T19:39:58.752852+0000","last_became_active":"2023-10-16T19:39:56.996916+0000","last_became_peered":"2023-10-16T19:39:56.996916+0000","last_unstale":"2023-10-16T19:39:58.752852+0000","last_undegraded":"2023-10-16T19:39:58.752852+0000","last_fullsized":"2023-10-16T19:39:58.752852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993787+0000","last_change":"2023-10-16T19:39:51.962402+0000","last_active":"2023-10-16T19:39:56.993787+0000","last_peered":"2023-10-16T19:39:56.993787+0000","last_clean":"2023-10-16T19:39:56.993787+0000","last_became_active":"2023-10-16T19:39:51.961789+0000","last_became_peered":"2023-10-16T19:39:51.961789+0000","last_unstale":"2023-10-16T19:39:56.993787+0000","last_undegraded":"2023-10-16T19:39:56.993787+0000","last_fullsized":"2023-10-16T19:39:56.993787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984210+0000","last_change":"2023-10-16T19:39:52.972162+0000","last_active":"2023-10-16T19:39:56.984210+0000","last_peered":"2023-10-16T19:39:56.984210+0000","last_clean":"2023-10-16T19:39:56.984210+0000","last_became_active":"2023-10-16T19:39:52.971650+0000","last_became_peered":"2023-10-16T19:39:52.971650+0000","last_unstale":"2023-10-16T19:39:56.984210+0000","last_undegraded":"2023-10-16T19:39:56.984210+0000","last_fullsized":"2023-10-16T19:39:56.984210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707432+0000","last_change":"2023-10-16T19:39:57.057262+0000","last_active":"2023-10-16T19:39:58.707432+0000","last_peered":"2023-10-16T19:39:58.707432+0000","last_clean":"2023-10-16T19:39:58.707432+0000","last_became_active":"2023-10-16T19:39:57.056817+0000","last_became_peered":"2023-10-16T19:39:57.056817+0000","last_unstale":"2023-10-16T19:39:58.707432+0000","last_undegraded":"2023-10-16T19:39:58.707432+0000","last_fullsized":"2023-10-16T19:39:58.707432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977037+0000","last_change":"2023-10-16T19:39:51.962396+0000","last_active":"2023-10-16T19:39:56.977037+0000","last_peered":"2023-10-16T19:39:56.977037+0000","last_clean":"2023-10-16T19:39:56.977037+0000","last_became_active":"2023-10-16T19:39:51.962087+0000","last_became_peered":"2023-10-16T19:39:51.962087+0000","last_unstale":"2023-10-16T19:39:56.977037+0000","last_undegraded":"2023-10-16T19:39:56.977037+0000","last_fullsized":"2023-10-16T19:39:56.977037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056819+0000","last_change":"2023-10-16T19:39:52.966846+0000","last_active":"2023-10-16T19:39:57.056819+0000","last_peered":"2023-10-16T19:39:57.056819+0000","last_clean":"2023-10-16T19:39:57.056819+0000","last_became_active":"2023-10-16T19:39:52.966558+0000","last_became_peered":"2023-10-16T19:39:52.966558+0000","last_unstale":"2023-10-16T19:39:57.056819+0000","last_undegraded":"2023-10-16T19:39:57.056819+0000","last_fullsized":"2023-10-16T19:39:57.056819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978101+0000","last_change":"2023-10-16T19:39:52.968833+0000","last_active":"2023-10-16T19:39:56.978101+0000","last_peered":"2023-10-16T19:39:56.978101+0000","last_clean":"2023-10-16T19:39:56.978101+0000","last_became_active":"2023-10-16T19:39:52.968540+0000","last_became_peered":"2023-10-16T19:39:52.968540+0000","last_unstale":"2023-10-16T19:39:56.978101+0000","last_undegraded":"2023-10-16T19:39:56.978101+0000","last_fullsized":"2023-10-16T19:39:56.978101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977005+0000","last_change":"2023-10-16T19:39:52.966376+0000","last_active":"2023-10-16T19:39:56.977005+0000","last_peered":"2023-10-16T19:39:56.977005+0000","last_clean":"2023-10-16T19:39:56.977005+0000","last_became_active":"2023-10-16T19:39:52.966044+0000","last_became_peered":"2023-10-16T19:39:52.966044+0000","last_unstale":"2023-10-16T19:39:56.977005+0000","last_undegraded":"2023-10-16T19:39:56.977005+0000","last_fullsized":"2023-10-16T19:39:56.977005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984282+0000","last_change":"2023-10-16T19:39:52.971488+0000","last_active":"2023-10-16T19:39:56.984282+0000","last_peered":"2023-10-16T19:39:56.984282+0000","last_clean":"2023-10-16T19:39:56.984282+0000","last_became_active":"2023-10-16T19:39:52.970909+0000","last_became_peered":"2023-10-16T19:39:52.970909+0000","last_unstale":"2023-10-16T19:39:56.984282+0000","last_undegraded":"2023-10-16T19:39:56.984282+0000","last_fullsized":"2023-10-16T19:39:56.984282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982419+0000","last_change":"2023-10-16T19:39:52.975269+0000","last_active":"2023-10-16T19:39:56.982419+0000","last_peered":"2023-10-16T19:39:56.982419+0000","last_clean":"2023-10-16T19:39:56.982419+0000","last_became_active":"2023-10-16T19:39:52.973150+0000","last_became_peered":"2023-10-16T19:39:52.973150+0000","last_unstale":"2023-10-16T19:39:56.982419+0000","last_undegraded":"2023-10-16T19:39:56.982419+0000","last_fullsized":"2023-10-16T19:39:56.982419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997003+0000","last_change":"2023-10-16T19:39:52.969771+0000","last_active":"2023-10-16T19:39:56.997003+0000","last_peered":"2023-10-16T19:39:56.997003+0000","last_clean":"2023-10-16T19:39:56.997003+0000","last_became_active":"2023-10-16T19:39:52.969468+0000","last_became_peered":"2023-10-16T19:39:52.969468+0000","last_unstale":"2023-10-16T19:39:56.997003+0000","last_undegraded":"2023-10-16T19:39:56.997003+0000","last_fullsized":"2023-10-16T19:39:56.997003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993745+0000","last_change":"2023-10-16T19:39:52.957538+0000","last_active":"2023-10-16T19:39:56.993745+0000","last_peered":"2023-10-16T19:39:56.993745+0000","last_clean":"2023-10-16T19:39:56.993745+0000","last_became_active":"2023-10-16T19:39:52.957106+0000","last_became_peered":"2023-10-16T19:39:52.957106+0000","last_unstale":"2023-10-16T19:39:56.993745+0000","last_undegraded":"2023-10-16T19:39:56.993745+0000","last_fullsized":"2023-10-16T19:39:56.993745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978579+0000","last_change":"2023-10-16T19:39:52.970773+0000","last_active":"2023-10-16T19:39:56.978579+0000","last_peered":"2023-10-16T19:39:56.978579+0000","last_clean":"2023-10-16T19:39:56.978579+0000","last_became_active":"2023-10-16T19:39:52.970485+0000","last_became_peered":"2023-10-16T19:39:52.970485+0000","last_unstale":"2023-10-16T19:39:56.978579+0000","last_undegraded":"2023-10-16T19:39:56.978579+0000","last_fullsized":"2023-10-16T19:39:56.978579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000749+0000","last_change":"2023-10-16T19:39:52.969630+0000","last_active":"2023-10-16T19:39:57.000749+0000","last_peered":"2023-10-16T19:39:57.000749+0000","last_clean":"2023-10-16T19:39:57.000749+0000","last_became_active":"2023-10-16T19:39:52.969298+0000","last_became_peered":"2023-10-16T19:39:52.969298+0000","last_unstale":"2023-10-16T19:39:57.000749+0000","last_undegraded":"2023-10-16T19:39:57.000749+0000","last_fullsized":"2023-10-16T19:39:57.000749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983919+0000","last_change":"2023-10-16T19:39:52.979228+0000","last_active":"2023-10-16T19:39:56.983919+0000","last_peered":"2023-10-16T19:39:56.983919+0000","last_clean":"2023-10-16T19:39:56.983919+0000","last_became_active":"2023-10-16T19:39:52.978788+0000","last_became_peered":"2023-10-16T19:39:52.978788+0000","last_unstale":"2023-10-16T19:39:56.983919+0000","last_undegraded":"2023-10-16T19:39:56.983919+0000","last_fullsized":"2023-10-16T19:39:56.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995707+0000","last_change":"2023-10-16T19:39:52.962415+0000","last_active":"2023-10-16T19:39:56.995707+0000","last_peered":"2023-10-16T19:39:56.995707+0000","last_clean":"2023-10-16T19:39:56.995707+0000","last_became_active":"2023-10-16T19:39:52.962093+0000","last_became_peered":"2023-10-16T19:39:52.962093+0000","last_unstale":"2023-10-16T19:39:56.995707+0000","last_undegraded":"2023-10-16T19:39:56.995707+0000","last_fullsized":"2023-10-16T19:39:56.995707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984054+0000","last_change":"2023-10-16T19:39:52.971993+0000","last_active":"2023-10-16T19:39:56.984054+0000","last_peered":"2023-10-16T19:39:56.984054+0000","last_clean":"2023-10-16T19:39:56.984054+0000","last_became_active":"2023-10-16T19:39:52.971684+0000","last_became_peered":"2023-10-16T19:39:52.971684+0000","last_unstale":"2023-10-16T19:39:56.984054+0000","last_undegraded":"2023-10-16T19:39:56.984054+0000","last_fullsized":"2023-10-16T19:39:56.984054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983218+0000","last_change":"2023-10-16T19:39:52.977733+0000","last_active":"2023-10-16T19:39:56.983218+0000","last_peered":"2023-10-16T19:39:56.983218+0000","last_clean":"2023-10-16T19:39:56.983218+0000","last_became_active":"2023-10-16T19:39:52.977383+0000","last_became_peered":"2023-10-16T19:39:52.977383+0000","last_unstale":"2023-10-16T19:39:56.983218+0000","last_undegraded":"2023-10-16T19:39:56.983218+0000","last_fullsized":"2023-10-16T19:39:56.983218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978000+0000","last_change":"2023-10-16T19:39:52.961967+0000","last_active":"2023-10-16T19:39:56.978000+0000","last_peered":"2023-10-16T19:39:56.978000+0000","last_clean":"2023-10-16T19:39:56.978000+0000","last_became_active":"2023-10-16T19:39:52.961663+0000","last_became_peered":"2023-10-16T19:39:52.961663+0000","last_unstale":"2023-10-16T19:39:56.978000+0000","last_undegraded":"2023-10-16T19:39:56.978000+0000","last_fullsized":"2023-10-16T19:39:56.978000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:40:18.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:40:18.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.734+0000 7fb6d1011700 1 Processor -- start 2023-10-16T19:40:18.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 -- start start 2023-10-16T19:40:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6cc0c3350 0x7fb6cc1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6cc06db00 0x7fb6cc06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc155af0 con 0x7fb6cc14ec50 2023-10-16T19:40:18.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc152300 con 0x7fb6cc0c3350 2023-10-16T19:40:18.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6d1011700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc0c2e40 con 0x7fb6cc06db00 2023-10-16T19:40:18.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.735+0000 7fb6ca59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6cc0c3350 0x7fb6cc1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6cc0c3350 0x7fb6cc1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51636/0 (socket says 172.21.15.29:51636) 2023-10-16T19:40:18.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6cad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb6cc14ec50 0x7fb6cc071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37078/0 (socket says 172.21.15.29:37078) 2023-10-16T19:40:18.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 -- 172.21.15.29:0/3725472842 learned_addr learned my addr 172.21.15.29:0/3725472842 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:18.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6cb59e700 1 --2- 172.21.15.29:0/3725472842 >> v2:172.21.15.53:3300/0 conn(0x7fb6cc06db00 0x7fb6cc06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 -- 172.21.15.29:0/3725472842 >> v2:172.21.15.53:3300/0 conn(0x7fb6cc06db00 msgr2=0x7fb6cc06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:18.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 --2- 172.21.15.29:0/3725472842 >> v2:172.21.15.53:3300/0 conn(0x7fb6cc06db00 0x7fb6cc06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 -- 172.21.15.29:0/3725472842 >> v1:172.21.15.29:6789/0 conn(0x7fb6cc14ec50 legacy=0x7fb6cc071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 -- 172.21.15.29:0/3725472842 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc14f030 con 0x7fb6cc0c3350 2023-10-16T19:40:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6ca59c700 1 --2- 172.21.15.29:0/3725472842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc0c3350 0x7fb6cc1555b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc068e40 tx=0x7fb6c000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990248a065d795a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6c9d9b700 1 -- 172.21.15.29:0/3725472842 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000db70 con 0x7fb6cc0c3350 2023-10-16T19:40:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6c9d9b700 1 -- 172.21.15.29:0/3725472842 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c000dcd0 con 0x7fb6cc0c3350 2023-10-16T19:40:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.736+0000 7fb6c9d9b700 1 -- 172.21.15.29:0/3725472842 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0004030 con 0x7fb6cc0c3350 2023-10-16T19:40:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 -- 172.21.15.29:0/3725472842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc0c3350 msgr2=0x7fb6cc1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 --2- 172.21.15.29:0/3725472842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc0c3350 0x7fb6cc1555b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc068e40 tx=0x7fb6c000be70 comp rx=0 tx=0).stop 2023-10-16T19:40:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 -- 172.21.15.29:0/3725472842 shutdown_connections 2023-10-16T19:40:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 --2- 172.21.15.29:0/3725472842 >> v2:172.21.15.53:3300/0 conn(0x7fb6cc06db00 0x7fb6cc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 --2- 172.21.15.29:0/3725472842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc0c3350 0x7fb6cc1555b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 -- 172.21.15.29:0/3725472842 >> 172.21.15.29:0/3725472842 conn(0x7fb6cc0c7110 msgr2=0x7fb6cc0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 -- 172.21.15.29:0/3725472842 shutdown_connections 2023-10-16T19:40:18.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.737+0000 7fb6d1011700 1 -- 172.21.15.29:0/3725472842 wait complete. 2023-10-16T19:40:18.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.738+0000 7fb6d1011700 1 Processor -- start 2023-10-16T19:40:18.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.738+0000 7fb6d1011700 1 -- start start 2023-10-16T19:40:18.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb6cc0c3350 0x7fb6cc0c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6cc14ec50 0x7fb6cc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc14d070 con 0x7fb6cc06db00 2023-10-16T19:40:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc14c9d0 con 0x7fb6cc14ec50 2023-10-16T19:40:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6d1011700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0c12c0 con 0x7fb6cc0c3350 2023-10-16T19:40:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51640/0 (socket says 172.21.15.29:51640) 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 -- 172.21.15.29:0/2331812537 learned_addr learned my addr 172.21.15.29:0/2331812537 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6ca59c700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb6cc0c3350 0x7fb6cc0c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cb59e700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6cc14ec50 0x7fb6cc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 -- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb6cc0c3350 msgr2=0x7fb6cc0c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb6cc0c3350 0x7fb6cc0c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 -- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6cc14ec50 msgr2=0x7fb6cc152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6cc14ec50 0x7fb6cc152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.739+0000 7fb6cad9d700 1 -- 172.21.15.29:0/2331812537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c000b7f0 con 0x7fb6cc06db00 2023-10-16T19:40:18.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6cad9d700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c850 tx=0x7fb6bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc004c80 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc004de0 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1eafe0 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc007310 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.740+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1439d0 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.741+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc14cb10 con 0x7fb6cc06db00 2023-10-16T19:40:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.741+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb6bc007470 con 0x7fb6cc06db00 2023-10-16T19:40:18.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.742+0000 7fb6b37fe700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 0x7fb6b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:18.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.742+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6bc088d60 con 0x7fb6cc06db00 2023-10-16T19:40:18.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.742+0000 7fb6ca59c700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 0x7fb6b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:18.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.742+0000 7fb6ca59c700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 0x7fb6b806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc068e40 tx=0x7fb6c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:18.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.746+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6bc053bb0 con 0x7fb6cc06db00 2023-10-16T19:40:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.941+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6cc1519d0 con 0x7fb6b806af00 2023-10-16T19:40:18.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.951+0000 7fb6b37fe700 1 -- 172.21.15.29:0/2331812537 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345249 (secure 0 0 0) 0x7fb6c001f040 con 0x7fb6b806af00 2023-10-16T19:40:18.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:18.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 msgr2=0x7fb6b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 0x7fb6b806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc068e40 tx=0x7fb6c0008040 comp rx=0 tx=0).stop 2023-10-16T19:40:18.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 msgr2=0x7fb6cc1eaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:18.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c850 tx=0x7fb6bc00cc10 comp rx=0 tx=0).stop 2023-10-16T19:40:18.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 shutdown_connections 2023-10-16T19:40:18.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb6b806af00 0x7fb6b806d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6cc14ec50 0x7fb6cc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6cc06db00 0x7fb6cc1eaaa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 --2- 172.21.15.29:0/2331812537 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb6cc0c3350 0x7fb6cc0c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:18.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 >> 172.21.15.29:0/2331812537 conn(0x7fb6cc0c7110 msgr2=0x7fb6cc0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:18.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 shutdown_connections 2023-10-16T19:40:18.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:18.955+0000 7fb6d1011700 1 -- 172.21.15.29:0/2331812537 wait complete. 2023-10-16T19:40:18.963 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:40:18.969 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-16T19:40:18.561801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2025624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003597"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056933+0000","last_change":"2023-10-16T19:39:52.970740+0000","last_active":"2023-10-16T19:39:57.056933+0000","last_peered":"2023-10-16T19:39:57.056933+0000","last_clean":"2023-10-16T19:39:57.056933+0000","last_became_active":"2023-10-16T19:39:52.970471+0000","last_became_peered":"2023-10-16T19:39:52.970471+0000","last_unstale":"2023-10-16T19:39:57.056933+0000","last_undegraded":"2023-10-16T19:39:57.056933+0000","last_fullsized":"2023-10-16T19:39:57.056933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:28.159875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995299+0000","last_change":"2023-10-16T19:39:52.967596+0000","last_active":"2023-10-16T19:39:56.995299+0000","last_peered":"2023-10-16T19:39:56.995299+0000","last_clean":"2023-10-16T19:39:56.995299+0000","last_became_active":"2023-10-16T19:39:52.967235+0000","last_became_peered":"2023-10-16T19:39:52.967235+0000","last_unstale":"2023-10-16T19:39:56.995299+0000","last_undegraded":"2023-10-16T19:39:56.995299+0000","last_fullsized":"2023-10-16T19:39:56.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983237+0000","last_change":"2023-10-16T19:39:52.973343+0000","last_active":"2023-10-16T19:39:56.983237+0000","last_peered":"2023-10-16T19:39:56.983237+0000","last_clean":"2023-10-16T19:39:56.983237+0000","last_became_active":"2023-10-16T19:39:52.973035+0000","last_became_peered":"2023-10-16T19:39:52.973035+0000","last_unstale":"2023-10-16T19:39:56.983237+0000","last_undegraded":"2023-10-16T19:39:56.983237+0000","last_fullsized":"2023-10-16T19:39:56.983237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:11.377449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984370+0000","last_change":"2023-10-16T19:39:52.971942+0000","last_active":"2023-10-16T19:39:56.984370+0000","last_peered":"2023-10-16T19:39:56.984370+0000","last_clean":"2023-10-16T19:39:56.984370+0000","last_became_active":"2023-10-16T19:39:52.971194+0000","last_became_peered":"2023-10-16T19:39:52.971194+0000","last_unstale":"2023-10-16T19:39:56.984370+0000","last_undegraded":"2023-10-16T19:39:56.984370+0000","last_fullsized":"2023-10-16T19:39:56.984370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055336+0000","last_change":"2023-10-16T19:39:52.968333+0000","last_active":"2023-10-16T19:39:57.055336+0000","last_peered":"2023-10-16T19:39:57.055336+0000","last_clean":"2023-10-16T19:39:57.055336+0000","last_became_active":"2023-10-16T19:39:52.968039+0000","last_became_peered":"2023-10-16T19:39:52.968039+0000","last_unstale":"2023-10-16T19:39:57.055336+0000","last_undegraded":"2023-10-16T19:39:57.055336+0000","last_fullsized":"2023-10-16T19:39:57.055336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984153+0000","last_change":"2023-10-16T19:39:52.977137+0000","last_active":"2023-10-16T19:39:56.984153+0000","last_peered":"2023-10-16T19:39:56.984153+0000","last_clean":"2023-10-16T19:39:56.984153+0000","last_became_active":"2023-10-16T19:39:52.976671+0000","last_became_peered":"2023-10-16T19:39:52.976671+0000","last_unstale":"2023-10-16T19:39:56.984153+0000","last_undegraded":"2023-10-16T19:39:56.984153+0000","last_fullsized":"2023-10-16T19:39:56.984153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054955+0000","last_change":"2023-10-16T19:39:52.969912+0000","last_active":"2023-10-16T19:39:57.054955+0000","last_peered":"2023-10-16T19:39:57.054955+0000","last_clean":"2023-10-16T19:39:57.054955+0000","last_became_active":"2023-10-16T19:39:52.969619+0000","last_became_peered":"2023-10-16T19:39:52.969619+0000","last_unstale":"2023-10-16T19:39:57.054955+0000","last_undegraded":"2023-10-16T19:39:57.054955+0000","last_fullsized":"2023-10-16T19:39:57.054955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988599+0000","last_change":"2023-10-16T19:39:52.977292+0000","last_active":"2023-10-16T19:39:56.988599+0000","last_peered":"2023-10-16T19:39:56.988599+0000","last_clean":"2023-10-16T19:39:56.988599+0000","last_became_active":"2023-10-16T19:39:52.976867+0000","last_became_peered":"2023-10-16T19:39:52.976867+0000","last_unstale":"2023-10-16T19:39:56.988599+0000","last_undegraded":"2023-10-16T19:39:56.988599+0000","last_fullsized":"2023-10-16T19:39:56.988599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056855+0000","last_change":"2023-10-16T19:39:52.971411+0000","last_active":"2023-10-16T19:39:57.056855+0000","last_peered":"2023-10-16T19:39:57.056855+0000","last_clean":"2023-10-16T19:39:57.056855+0000","last_became_active":"2023-10-16T19:39:52.971042+0000","last_became_peered":"2023-10-16T19:39:52.971042+0000","last_unstale":"2023-10-16T19:39:57.056855+0000","last_undegraded":"2023-10-16T19:39:57.056855+0000","last_fullsized":"2023-10-16T19:39:57.056855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:43.719224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978310+0000","last_change":"2023-10-16T19:39:52.966574+0000","last_active":"2023-10-16T19:39:56.978310+0000","last_peered":"2023-10-16T19:39:56.978310+0000","last_clean":"2023-10-16T19:39:56.978310+0000","last_became_active":"2023-10-16T19:39:52.966277+0000","last_became_peered":"2023-10-16T19:39:52.966277+0000","last_unstale":"2023-10-16T19:39:56.978310+0000","last_undegraded":"2023-10-16T19:39:56.978310+0000","last_fullsized":"2023-10-16T19:39:56.978310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978886+0000","last_change":"2023-10-16T19:39:52.971359+0000","last_active":"2023-10-16T19:39:56.978886+0000","last_peered":"2023-10-16T19:39:56.978886+0000","last_clean":"2023-10-16T19:39:56.978886+0000","last_became_active":"2023-10-16T19:39:52.971111+0000","last_became_peered":"2023-10-16T19:39:52.971111+0000","last_unstale":"2023-10-16T19:39:56.978886+0000","last_undegraded":"2023-10-16T19:39:56.978886+0000","last_fullsized":"2023-10-16T19:39:56.978886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979383+0000","last_change":"2023-10-16T19:39:52.966121+0000","last_active":"2023-10-16T19:39:56.979383+0000","last_peered":"2023-10-16T19:39:56.979383+0000","last_clean":"2023-10-16T19:39:56.979383+0000","last_became_active":"2023-10-16T19:39:52.965817+0000","last_became_peered":"2023-10-16T19:39:52.965817+0000","last_unstale":"2023-10-16T19:39:56.979383+0000","last_undegraded":"2023-10-16T19:39:56.979383+0000","last_fullsized":"2023-10-16T19:39:56.979383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996155+0000","last_change":"2023-10-16T19:39:52.971739+0000","last_active":"2023-10-16T19:39:56.996155+0000","last_peered":"2023-10-16T19:39:56.996155+0000","last_clean":"2023-10-16T19:39:56.996155+0000","last_became_active":"2023-10-16T19:39:52.970983+0000","last_became_peered":"2023-10-16T19:39:52.970983+0000","last_unstale":"2023-10-16T19:39:56.996155+0000","last_undegraded":"2023-10-16T19:39:56.996155+0000","last_fullsized":"2023-10-16T19:39:56.996155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982897+0000","last_change":"2023-10-16T19:39:52.962992+0000","last_active":"2023-10-16T19:39:56.982897+0000","last_peered":"2023-10-16T19:39:56.982897+0000","last_clean":"2023-10-16T19:39:56.982897+0000","last_became_active":"2023-10-16T19:39:52.962658+0000","last_became_peered":"2023-10-16T19:39:52.962658+0000","last_unstale":"2023-10-16T19:39:56.982897+0000","last_undegraded":"2023-10-16T19:39:56.982897+0000","last_fullsized":"2023-10-16T19:39:56.982897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.991949+0000","last_change":"2023-10-16T19:39:52.965403+0000","last_active":"2023-10-16T19:39:56.991949+0000","last_peered":"2023-10-16T19:39:56.991949+0000","last_clean":"2023-10-16T19:39:56.991949+0000","last_became_active":"2023-10-16T19:39:52.965160+0000","last_became_peered":"2023-10-16T19:39:52.965160+0000","last_unstale":"2023-10-16T19:39:56.991949+0000","last_undegraded":"2023-10-16T19:39:56.991949+0000","last_fullsized":"2023-10-16T19:39:56.991949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983686+0000","last_change":"2023-10-16T19:39:52.969063+0000","last_active":"2023-10-16T19:39:56.983686+0000","last_peered":"2023-10-16T19:39:56.983686+0000","last_clean":"2023-10-16T19:39:56.983686+0000","last_became_active":"2023-10-16T19:39:52.968770+0000","last_became_peered":"2023-10-16T19:39:52.968770+0000","last_unstale":"2023-10-16T19:39:56.983686+0000","last_undegraded":"2023-10-16T19:39:56.983686+0000","last_fullsized":"2023-10-16T19:39:56.983686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984501+0000","last_change":"2023-10-16T19:39:52.973031+0000","last_active":"2023-10-16T19:39:56.984501+0000","last_peered":"2023-10-16T19:39:56.984501+0000","last_clean":"2023-10-16T19:39:56.984501+0000","last_became_active":"2023-10-16T19:39:52.972734+0000","last_became_peered":"2023-10-16T19:39:52.972734+0000","last_unstale":"2023-10-16T19:39:56.984501+0000","last_undegraded":"2023-10-16T19:39:56.984501+0000","last_fullsized":"2023-10-16T19:39:56.984501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977146+0000","last_change":"2023-10-16T19:39:52.953856+0000","last_active":"2023-10-16T19:39:56.977146+0000","last_peered":"2023-10-16T19:39:56.977146+0000","last_clean":"2023-10-16T19:39:56.977146+0000","last_became_active":"2023-10-16T19:39:52.953556+0000","last_became_peered":"2023-10-16T19:39:52.953556+0000","last_unstale":"2023-10-16T19:39:56.977146+0000","last_undegraded":"2023-10-16T19:39:56.977146+0000","last_fullsized":"2023-10-16T19:39:56.977146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056318+0000","last_change":"2023-10-16T19:39:52.966778+0000","last_active":"2023-10-16T19:39:57.056318+0000","last_peered":"2023-10-16T19:39:57.056318+0000","last_clean":"2023-10-16T19:39:57.056318+0000","last_became_active":"2023-10-16T19:39:52.966444+0000","last_became_peered":"2023-10-16T19:39:52.966444+0000","last_unstale":"2023-10-16T19:39:57.056318+0000","last_undegraded":"2023-10-16T19:39:57.056318+0000","last_fullsized":"2023-10-16T19:39:57.056318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014044+0000","last_change":"2023-10-16T19:39:57.060100+0000","last_active":"2023-10-16T19:39:58.014044+0000","last_peered":"2023-10-16T19:39:58.014044+0000","last_clean":"2023-10-16T19:39:58.014044+0000","last_became_active":"2023-10-16T19:39:57.059654+0000","last_became_peered":"2023-10-16T19:39:57.059654+0000","last_unstale":"2023-10-16T19:39:58.014044+0000","last_undegraded":"2023-10-16T19:39:58.014044+0000","last_fullsized":"2023-10-16T19:39:58.014044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983501+0000","last_change":"2023-10-16T19:39:51.960397+0000","last_active":"2023-10-16T19:39:56.983501+0000","last_peered":"2023-10-16T19:39:56.983501+0000","last_clean":"2023-10-16T19:39:56.983501+0000","last_became_active":"2023-10-16T19:39:51.959720+0000","last_became_peered":"2023-10-16T19:39:51.959720+0000","last_unstale":"2023-10-16T19:39:56.983501+0000","last_undegraded":"2023-10-16T19:39:56.983501+0000","last_fullsized":"2023-10-16T19:39:56.983501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997016+0000","last_change":"2023-10-16T19:39:52.970235+0000","last_active":"2023-10-16T19:39:56.997016+0000","last_peered":"2023-10-16T19:39:56.997016+0000","last_clean":"2023-10-16T19:39:56.997016+0000","last_became_active":"2023-10-16T19:39:52.969954+0000","last_became_peered":"2023-10-16T19:39:52.969954+0000","last_unstale":"2023-10-16T19:39:56.997016+0000","last_undegraded":"2023-10-16T19:39:56.997016+0000","last_fullsized":"2023-10-16T19:39:56.997016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014481+0000","last_change":"2023-10-16T19:39:56.998346+0000","last_active":"2023-10-16T19:39:58.014481+0000","last_peered":"2023-10-16T19:39:58.014481+0000","last_clean":"2023-10-16T19:39:58.014481+0000","last_became_active":"2023-10-16T19:39:56.997873+0000","last_became_peered":"2023-10-16T19:39:56.997873+0000","last_unstale":"2023-10-16T19:39:58.014481+0000","last_undegraded":"2023-10-16T19:39:58.014481+0000","last_fullsized":"2023-10-16T19:39:58.014481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:23.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997110+0000","last_change":"2023-10-16T19:39:51.953173+0000","last_active":"2023-10-16T19:39:56.997110+0000","last_peered":"2023-10-16T19:39:56.997110+0000","last_clean":"2023-10-16T19:39:56.997110+0000","last_became_active":"2023-10-16T19:39:51.952008+0000","last_became_peered":"2023-10-16T19:39:51.952008+0000","last_unstale":"2023-10-16T19:39:56.997110+0000","last_undegraded":"2023-10-16T19:39:56.997110+0000","last_fullsized":"2023-10-16T19:39:56.997110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983121+0000","last_change":"2023-10-16T19:39:52.972725+0000","last_active":"2023-10-16T19:39:56.983121+0000","last_peered":"2023-10-16T19:39:56.983121+0000","last_clean":"2023-10-16T19:39:56.983121+0000","last_became_active":"2023-10-16T19:39:52.972414+0000","last_became_peered":"2023-10-16T19:39:52.972414+0000","last_unstale":"2023-10-16T19:39:56.983121+0000","last_undegraded":"2023-10-16T19:39:56.983121+0000","last_fullsized":"2023-10-16T19:39:56.983121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014362+0000","last_change":"2023-10-16T19:39:56.999448+0000","last_active":"2023-10-16T19:39:58.014362+0000","last_peered":"2023-10-16T19:39:58.014362+0000","last_clean":"2023-10-16T19:39:58.014362+0000","last_became_active":"2023-10-16T19:39:56.997855+0000","last_became_peered":"2023-10-16T19:39:56.997855+0000","last_unstale":"2023-10-16T19:39:58.014362+0000","last_undegraded":"2023-10-16T19:39:58.014362+0000","last_fullsized":"2023-10-16T19:39:58.014362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:56.072025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055844+0000","last_change":"2023-10-16T19:39:51.960815+0000","last_active":"2023-10-16T19:39:57.055844+0000","last_peered":"2023-10-16T19:39:57.055844+0000","last_clean":"2023-10-16T19:39:57.055844+0000","last_became_active":"2023-10-16T19:39:51.960470+0000","last_became_peered":"2023-10-16T19:39:51.960470+0000","last_unstale":"2023-10-16T19:39:57.055844+0000","last_undegraded":"2023-10-16T19:39:57.055844+0000","last_fullsized":"2023-10-16T19:39:57.055844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:35.736680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984118+0000","last_change":"2023-10-16T19:39:52.965519+0000","last_active":"2023-10-16T19:39:56.984118+0000","last_peered":"2023-10-16T19:39:56.984118+0000","last_clean":"2023-10-16T19:39:56.984118+0000","last_became_active":"2023-10-16T19:39:52.965232+0000","last_became_peered":"2023-10-16T19:39:52.965232+0000","last_unstale":"2023-10-16T19:39:56.984118+0000","last_undegraded":"2023-10-16T19:39:56.984118+0000","last_fullsized":"2023-10-16T19:39:56.984118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014702+0000","last_change":"2023-10-16T19:39:56.998686+0000","last_active":"2023-10-16T19:39:58.014702+0000","last_peered":"2023-10-16T19:39:58.014702+0000","last_clean":"2023-10-16T19:39:58.014702+0000","last_became_active":"2023-10-16T19:39:56.998124+0000","last_became_peered":"2023-10-16T19:39:56.998124+0000","last_unstale":"2023-10-16T19:39:58.014702+0000","last_undegraded":"2023-10-16T19:39:58.014702+0000","last_fullsized":"2023-10-16T19:39:58.014702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:09.298354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055487+0000","last_change":"2023-10-16T19:39:51.963066+0000","last_active":"2023-10-16T19:39:57.055487+0000","last_peered":"2023-10-16T19:39:57.055487+0000","last_clean":"2023-10-16T19:39:57.055487+0000","last_became_active":"2023-10-16T19:39:51.962643+0000","last_became_peered":"2023-10-16T19:39:51.962643+0000","last_unstale":"2023-10-16T19:39:57.055487+0000","last_undegraded":"2023-10-16T19:39:57.055487+0000","last_fullsized":"2023-10-16T19:39:57.055487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:47.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984874+0000","last_change":"2023-10-16T19:39:52.965735+0000","last_active":"2023-10-16T19:39:56.984874+0000","last_peered":"2023-10-16T19:39:56.984874+0000","last_clean":"2023-10-16T19:39:56.984874+0000","last_became_active":"2023-10-16T19:39:52.965467+0000","last_became_peered":"2023-10-16T19:39:52.965467+0000","last_unstale":"2023-10-16T19:39:56.984874+0000","last_undegraded":"2023-10-16T19:39:56.984874+0000","last_fullsized":"2023-10-16T19:39:56.984874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014328+0000","last_change":"2023-10-16T19:39:57.004000+0000","last_active":"2023-10-16T19:39:58.014328+0000","last_peered":"2023-10-16T19:39:58.014328+0000","last_clean":"2023-10-16T19:39:58.014328+0000","last_became_active":"2023-10-16T19:39:57.003585+0000","last_became_peered":"2023-10-16T19:39:57.003585+0000","last_unstale":"2023-10-16T19:39:58.014328+0000","last_undegraded":"2023-10-16T19:39:58.014328+0000","last_fullsized":"2023-10-16T19:39:58.014328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:49.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996688+0000","last_change":"2023-10-16T19:39:51.963390+0000","last_active":"2023-10-16T19:39:56.996688+0000","last_peered":"2023-10-16T19:39:56.996688+0000","last_clean":"2023-10-16T19:39:56.996688+0000","last_became_active":"2023-10-16T19:39:51.963076+0000","last_became_peered":"2023-10-16T19:39:51.963076+0000","last_unstale":"2023-10-16T19:39:56.996688+0000","last_undegraded":"2023-10-16T19:39:56.996688+0000","last_fullsized":"2023-10-16T19:39:56.996688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978342+0000","last_change":"2023-10-16T19:39:52.961791+0000","last_active":"2023-10-16T19:39:56.978342+0000","last_peered":"2023-10-16T19:39:56.978342+0000","last_clean":"2023-10-16T19:39:56.978342+0000","last_became_active":"2023-10-16T19:39:52.960383+0000","last_became_peered":"2023-10-16T19:39:52.960383+0000","last_unstale":"2023-10-16T19:39:56.978342+0000","last_undegraded":"2023-10-16T19:39:56.978342+0000","last_fullsized":"2023-10-16T19:39:56.978342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:48.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.375697+0000","last_change":"2023-10-16T19:39:56.998866+0000","last_active":"2023-10-16T19:39:58.375697+0000","last_peered":"2023-10-16T19:39:58.375697+0000","last_clean":"2023-10-16T19:39:58.375697+0000","last_became_active":"2023-10-16T19:39:56.998515+0000","last_became_peered":"2023-10-16T19:39:56.998515+0000","last_unstale":"2023-10-16T19:39:58.375697+0000","last_undegraded":"2023-10-16T19:39:58.375697+0000","last_fullsized":"2023-10-16T19:39:58.375697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:15.516547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978023+0000","last_change":"2023-10-16T19:39:51.952902+0000","last_active":"2023-10-16T19:39:56.978023+0000","last_peered":"2023-10-16T19:39:56.978023+0000","last_clean":"2023-10-16T19:39:56.978023+0000","last_became_active":"2023-10-16T19:39:51.952591+0000","last_became_peered":"2023-10-16T19:39:51.952591+0000","last_unstale":"2023-10-16T19:39:56.978023+0000","last_undegraded":"2023-10-16T19:39:56.978023+0000","last_fullsized":"2023-10-16T19:39:56.978023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982312+0000","last_change":"2023-10-16T19:39:52.970475+0000","last_active":"2023-10-16T19:39:56.982312+0000","last_peered":"2023-10-16T19:39:56.982312+0000","last_clean":"2023-10-16T19:39:56.982312+0000","last_became_active":"2023-10-16T19:39:52.968544+0000","last_became_peered":"2023-10-16T19:39:52.968544+0000","last_unstale":"2023-10-16T19:39:56.982312+0000","last_undegraded":"2023-10-16T19:39:56.982312+0000","last_fullsized":"2023-10-16T19:39:56.982312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015980+0000","last_change":"2023-10-16T19:39:56.994009+0000","last_active":"2023-10-16T19:39:58.015980+0000","last_peered":"2023-10-16T19:39:58.015980+0000","last_clean":"2023-10-16T19:39:58.015980+0000","last_became_active":"2023-10-16T19:39:56.993681+0000","last_became_peered":"2023-10-16T19:39:56.993681+0000","last_unstale":"2023-10-16T19:39:58.015980+0000","last_undegraded":"2023-10-16T19:39:58.015980+0000","last_fullsized":"2023-10-16T19:39:58.015980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995806+0000","last_change":"2023-10-16T19:39:51.963829+0000","last_active":"2023-10-16T19:39:56.995806+0000","last_peered":"2023-10-16T19:39:56.995806+0000","last_clean":"2023-10-16T19:39:56.995806+0000","last_became_active":"2023-10-16T19:39:51.962756+0000","last_became_peered":"2023-10-16T19:39:51.962756+0000","last_unstale":"2023-10-16T19:39:56.995806+0000","last_undegraded":"2023-10-16T19:39:56.995806+0000","last_fullsized":"2023-10-16T19:39:56.995806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988378+0000","last_change":"2023-10-16T19:39:52.969328+0000","last_active":"2023-10-16T19:39:56.988378+0000","last_peered":"2023-10-16T19:39:56.988378+0000","last_clean":"2023-10-16T19:39:56.988378+0000","last_became_active":"2023-10-16T19:39:52.968930+0000","last_became_peered":"2023-10-16T19:39:52.968930+0000","last_unstale":"2023-10-16T19:39:56.988378+0000","last_undegraded":"2023-10-16T19:39:56.988378+0000","last_fullsized":"2023-10-16T19:39:56.988378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753706+0000","last_change":"2023-10-16T19:39:57.060169+0000","last_active":"2023-10-16T19:39:58.753706+0000","last_peered":"2023-10-16T19:39:58.753706+0000","last_clean":"2023-10-16T19:39:58.753706+0000","last_became_active":"2023-10-16T19:39:57.059047+0000","last_became_peered":"2023-10-16T19:39:57.059047+0000","last_unstale":"2023-10-16T19:39:58.753706+0000","last_undegraded":"2023-10-16T19:39:58.753706+0000","last_fullsized":"2023-10-16T19:39:58.753706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983925+0000","last_change":"2023-10-16T19:39:51.965322+0000","last_active":"2023-10-16T19:39:56.983925+0000","last_peered":"2023-10-16T19:39:56.983925+0000","last_clean":"2023-10-16T19:39:56.983925+0000","last_became_active":"2023-10-16T19:39:51.964942+0000","last_became_peered":"2023-10-16T19:39:51.964942+0000","last_unstale":"2023-10-16T19:39:56.983925+0000","last_undegraded":"2023-10-16T19:39:56.983925+0000","last_fullsized":"2023-10-16T19:39:56.983925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992388+0000","last_change":"2023-10-16T19:39:52.959908+0000","last_active":"2023-10-16T19:39:56.992388+0000","last_peered":"2023-10-16T19:39:56.992388+0000","last_clean":"2023-10-16T19:39:56.992388+0000","last_became_active":"2023-10-16T19:39:52.959614+0000","last_became_peered":"2023-10-16T19:39:52.959614+0000","last_unstale":"2023-10-16T19:39:56.992388+0000","last_undegraded":"2023-10-16T19:39:56.992388+0000","last_fullsized":"2023-10-16T19:39:56.992388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013814+0000","last_change":"2023-10-16T19:39:57.060218+0000","last_active":"2023-10-16T19:39:58.013814+0000","last_peered":"2023-10-16T19:39:58.013814+0000","last_clean":"2023-10-16T19:39:58.013814+0000","last_became_active":"2023-10-16T19:39:57.059234+0000","last_became_peered":"2023-10-16T19:39:57.059234+0000","last_unstale":"2023-10-16T19:39:58.013814+0000","last_undegraded":"2023-10-16T19:39:58.013814+0000","last_fullsized":"2023-10-16T19:39:58.013814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978943+0000","last_change":"2023-10-16T19:39:51.958717+0000","last_active":"2023-10-16T19:39:56.978943+0000","last_peered":"2023-10-16T19:39:56.978943+0000","last_clean":"2023-10-16T19:39:56.978943+0000","last_became_active":"2023-10-16T19:39:51.958416+0000","last_became_peered":"2023-10-16T19:39:51.958416+0000","last_unstale":"2023-10-16T19:39:56.978943+0000","last_undegraded":"2023-10-16T19:39:56.978943+0000","last_fullsized":"2023-10-16T19:39:56.978943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983880+0000","last_change":"2023-10-16T19:39:52.972637+0000","last_active":"2023-10-16T19:39:56.983880+0000","last_peered":"2023-10-16T19:39:56.983880+0000","last_clean":"2023-10-16T19:39:56.983880+0000","last_became_active":"2023-10-16T19:39:52.970837+0000","last_became_peered":"2023-10-16T19:39:52.970837+0000","last_unstale":"2023-10-16T19:39:56.983880+0000","last_undegraded":"2023-10-16T19:39:56.983880+0000","last_fullsized":"2023-10-16T19:39:56.983880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013875+0000","last_change":"2023-10-16T19:39:57.000167+0000","last_active":"2023-10-16T19:39:58.013875+0000","last_peered":"2023-10-16T19:39:58.013875+0000","last_clean":"2023-10-16T19:39:58.013875+0000","last_became_active":"2023-10-16T19:39:56.999442+0000","last_became_peered":"2023-10-16T19:39:56.999442+0000","last_unstale":"2023-10-16T19:39:58.013875+0000","last_undegraded":"2023-10-16T19:39:58.013875+0000","last_fullsized":"2023-10-16T19:39:58.013875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:03.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983872+0000","last_change":"2023-10-16T19:39:51.961261+0000","last_active":"2023-10-16T19:39:56.983872+0000","last_peered":"2023-10-16T19:39:56.983872+0000","last_clean":"2023-10-16T19:39:56.983872+0000","last_became_active":"2023-10-16T19:39:51.960815+0000","last_became_peered":"2023-10-16T19:39:51.960815+0000","last_unstale":"2023-10-16T19:39:56.983872+0000","last_undegraded":"2023-10-16T19:39:56.983872+0000","last_fullsized":"2023-10-16T19:39:56.983872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:20.342371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983682+0000","last_change":"2023-10-16T19:39:52.972640+0000","last_active":"2023-10-16T19:39:56.983682+0000","last_peered":"2023-10-16T19:39:56.983682+0000","last_clean":"2023-10-16T19:39:56.983682+0000","last_became_active":"2023-10-16T19:39:52.972308+0000","last_became_peered":"2023-10-16T19:39:52.972308+0000","last_unstale":"2023-10-16T19:39:56.983682+0000","last_undegraded":"2023-10-16T19:39:56.983682+0000","last_fullsized":"2023-10-16T19:39:56.983682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014924+0000","last_change":"2023-10-16T19:39:56.995225+0000","last_active":"2023-10-16T19:39:58.014924+0000","last_peered":"2023-10-16T19:39:58.014924+0000","last_clean":"2023-10-16T19:39:58.014924+0000","last_became_active":"2023-10-16T19:39:56.994760+0000","last_became_peered":"2023-10-16T19:39:56.994760+0000","last_unstale":"2023-10-16T19:39:58.014924+0000","last_undegraded":"2023-10-16T19:39:58.014924+0000","last_fullsized":"2023-10-16T19:39:58.014924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:43.007379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993849+0000","last_change":"2023-10-16T19:39:51.962481+0000","last_active":"2023-10-16T19:39:56.993849+0000","last_peered":"2023-10-16T19:39:56.993849+0000","last_clean":"2023-10-16T19:39:56.993849+0000","last_became_active":"2023-10-16T19:39:51.962183+0000","last_became_peered":"2023-10-16T19:39:51.962183+0000","last_unstale":"2023-10-16T19:39:56.993849+0000","last_undegraded":"2023-10-16T19:39:56.993849+0000","last_fullsized":"2023-10-16T19:39:56.993849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979596+0000","last_change":"2023-10-16T19:39:52.974753+0000","last_active":"2023-10-16T19:39:56.979596+0000","last_peered":"2023-10-16T19:39:56.979596+0000","last_clean":"2023-10-16T19:39:56.979596+0000","last_became_active":"2023-10-16T19:39:52.974437+0000","last_became_peered":"2023-10-16T19:39:52.974437+0000","last_unstale":"2023-10-16T19:39:56.979596+0000","last_undegraded":"2023-10-16T19:39:56.979596+0000","last_fullsized":"2023-10-16T19:39:56.979596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988925+0000","last_change":"2023-10-16T19:39:57.008281+0000","last_active":"2023-10-16T19:39:58.988925+0000","last_peered":"2023-10-16T19:39:58.988925+0000","last_clean":"2023-10-16T19:39:58.988925+0000","last_became_active":"2023-10-16T19:39:57.007275+0000","last_became_peered":"2023-10-16T19:39:57.007275+0000","last_unstale":"2023-10-16T19:39:58.988925+0000","last_undegraded":"2023-10-16T19:39:58.988925+0000","last_fullsized":"2023-10-16T19:39:58.988925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:40:08.652465+0000","last_change":"2023-10-16T19:39:51.949368+0000","last_active":"2023-10-16T19:40:08.652465+0000","last_peered":"2023-10-16T19:40:08.652465+0000","last_clean":"2023-10-16T19:40:08.652465+0000","last_became_active":"2023-10-16T19:39:51.948876+0000","last_became_peered":"2023-10-16T19:39:51.948876+0000","last_unstale":"2023-10-16T19:40:08.652465+0000","last_undegraded":"2023-10-16T19:40:08.652465+0000","last_fullsized":"2023-10-16T19:40:08.652465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.058349+0000","last_change":"2023-10-16T19:39:52.975376+0000","last_active":"2023-10-16T19:39:57.058349+0000","last_peered":"2023-10-16T19:39:57.058349+0000","last_clean":"2023-10-16T19:39:57.058349+0000","last_became_active":"2023-10-16T19:39:52.975093+0000","last_became_peered":"2023-10-16T19:39:52.975093+0000","last_unstale":"2023-10-16T19:39:57.058349+0000","last_undegraded":"2023-10-16T19:39:57.058349+0000","last_fullsized":"2023-10-16T19:39:57.058349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707865+0000","last_change":"2023-10-16T19:39:57.058788+0000","last_active":"2023-10-16T19:39:58.707865+0000","last_peered":"2023-10-16T19:39:58.707865+0000","last_clean":"2023-10-16T19:39:58.707865+0000","last_became_active":"2023-10-16T19:39:57.058309+0000","last_became_peered":"2023-10-16T19:39:57.058309+0000","last_unstale":"2023-10-16T19:39:58.707865+0000","last_undegraded":"2023-10-16T19:39:58.707865+0000","last_fullsized":"2023-10-16T19:39:58.707865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983378+0000","last_change":"2023-10-16T19:39:51.948746+0000","last_active":"2023-10-16T19:39:56.983378+0000","last_peered":"2023-10-16T19:39:56.983378+0000","last_clean":"2023-10-16T19:39:56.983378+0000","last_became_active":"2023-10-16T19:39:51.948396+0000","last_became_peered":"2023-10-16T19:39:51.948396+0000","last_unstale":"2023-10-16T19:39:56.983378+0000","last_undegraded":"2023-10-16T19:39:56.983378+0000","last_fullsized":"2023-10-16T19:39:56.983378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983007+0000","last_change":"2023-10-16T19:39:52.968344+0000","last_active":"2023-10-16T19:39:56.983007+0000","last_peered":"2023-10-16T19:39:56.983007+0000","last_clean":"2023-10-16T19:39:56.983007+0000","last_became_active":"2023-10-16T19:39:52.967192+0000","last_became_peered":"2023-10-16T19:39:52.967192+0000","last_unstale":"2023-10-16T19:39:56.983007+0000","last_undegraded":"2023-10-16T19:39:56.983007+0000","last_fullsized":"2023-10-16T19:39:56.983007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014138+0000","last_change":"2023-10-16T19:39:57.055830+0000","last_active":"2023-10-16T19:39:58.014138+0000","last_peered":"2023-10-16T19:39:58.014138+0000","last_clean":"2023-10-16T19:39:58.014138+0000","last_became_active":"2023-10-16T19:39:57.055354+0000","last_became_peered":"2023-10-16T19:39:57.055354+0000","last_unstale":"2023-10-16T19:39:58.014138+0000","last_undegraded":"2023-10-16T19:39:58.014138+0000","last_fullsized":"2023-10-16T19:39:58.014138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:29.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983949+0000","last_change":"2023-10-16T19:39:51.964774+0000","last_active":"2023-10-16T19:39:56.983949+0000","last_peered":"2023-10-16T19:39:56.983949+0000","last_clean":"2023-10-16T19:39:56.983949+0000","last_became_active":"2023-10-16T19:39:51.964474+0000","last_became_peered":"2023-10-16T19:39:51.964474+0000","last_unstale":"2023-10-16T19:39:56.983949+0000","last_undegraded":"2023-10-16T19:39:56.983949+0000","last_fullsized":"2023-10-16T19:39:56.983949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055729+0000","last_change":"2023-10-16T19:39:52.968350+0000","last_active":"2023-10-16T19:39:57.055729+0000","last_peered":"2023-10-16T19:39:57.055729+0000","last_clean":"2023-10-16T19:39:57.055729+0000","last_became_active":"2023-10-16T19:39:52.968051+0000","last_became_peered":"2023-10-16T19:39:52.968051+0000","last_unstale":"2023-10-16T19:39:57.055729+0000","last_undegraded":"2023-10-16T19:39:57.055729+0000","last_fullsized":"2023-10-16T19:39:57.055729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014589+0000","last_change":"2023-10-16T19:39:57.059505+0000","last_active":"2023-10-16T19:39:58.014589+0000","last_peered":"2023-10-16T19:39:58.014589+0000","last_clean":"2023-10-16T19:39:58.014589+0000","last_became_active":"2023-10-16T19:39:57.059040+0000","last_became_peered":"2023-10-16T19:39:57.059040+0000","last_unstale":"2023-10-16T19:39:58.014589+0000","last_undegraded":"2023-10-16T19:39:58.014589+0000","last_fullsized":"2023-10-16T19:39:58.014589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:11.600778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978736+0000","last_change":"2023-10-16T19:39:51.953128+0000","last_active":"2023-10-16T19:39:56.978736+0000","last_peered":"2023-10-16T19:39:56.978736+0000","last_clean":"2023-10-16T19:39:56.978736+0000","last_became_active":"2023-10-16T19:39:51.952236+0000","last_became_peered":"2023-10-16T19:39:51.952236+0000","last_unstale":"2023-10-16T19:39:56.978736+0000","last_undegraded":"2023-10-16T19:39:56.978736+0000","last_fullsized":"2023-10-16T19:39:56.978736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:33.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977997+0000","last_change":"2023-10-16T19:39:52.967912+0000","last_active":"2023-10-16T19:39:56.977997+0000","last_peered":"2023-10-16T19:39:56.977997+0000","last_clean":"2023-10-16T19:39:56.977997+0000","last_became_active":"2023-10-16T19:39:52.967616+0000","last_became_peered":"2023-10-16T19:39:52.967616+0000","last_unstale":"2023-10-16T19:39:56.977997+0000","last_undegraded":"2023-10-16T19:39:56.977997+0000","last_fullsized":"2023-10-16T19:39:56.977997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.000483+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.000036+0000","last_became_peered":"2023-10-16T19:39:57.000036+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:47.756036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976895+0000","last_change":"2023-10-16T19:39:51.956225+0000","last_active":"2023-10-16T19:39:56.976895+0000","last_peered":"2023-10-16T19:39:56.976895+0000","last_clean":"2023-10-16T19:39:56.976895+0000","last_became_active":"2023-10-16T19:39:51.955913+0000","last_became_peered":"2023-10-16T19:39:51.955913+0000","last_unstale":"2023-10-16T19:39:56.976895+0000","last_undegraded":"2023-10-16T19:39:56.976895+0000","last_fullsized":"2023-10-16T19:39:56.976895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:55.435969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055053+0000","last_change":"2023-10-16T19:39:52.968227+0000","last_active":"2023-10-16T19:39:57.055053+0000","last_peered":"2023-10-16T19:39:57.055053+0000","last_clean":"2023-10-16T19:39:57.055053+0000","last_became_active":"2023-10-16T19:39:52.967354+0000","last_became_peered":"2023-10-16T19:39:52.967354+0000","last_unstale":"2023-10-16T19:39:57.055053+0000","last_undegraded":"2023-10-16T19:39:57.055053+0000","last_fullsized":"2023-10-16T19:39:57.055053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015289+0000","last_change":"2023-10-16T19:39:56.999092+0000","last_active":"2023-10-16T19:39:58.015289+0000","last_peered":"2023-10-16T19:39:58.015289+0000","last_clean":"2023-10-16T19:39:58.015289+0000","last_became_active":"2023-10-16T19:39:56.998522+0000","last_became_peered":"2023-10-16T19:39:56.998522+0000","last_unstale":"2023-10-16T19:39:58.015289+0000","last_undegraded":"2023-10-16T19:39:58.015289+0000","last_fullsized":"2023-10-16T19:39:58.015289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:40.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979452+0000","last_change":"2023-10-16T19:39:51.962668+0000","last_active":"2023-10-16T19:39:56.979452+0000","last_peered":"2023-10-16T19:39:56.979452+0000","last_clean":"2023-10-16T19:39:56.979452+0000","last_became_active":"2023-10-16T19:39:51.962380+0000","last_became_peered":"2023-10-16T19:39:51.962380+0000","last_unstale":"2023-10-16T19:39:56.979452+0000","last_undegraded":"2023-10-16T19:39:56.979452+0000","last_fullsized":"2023-10-16T19:39:56.979452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055973+0000","last_change":"2023-10-16T19:39:52.967234+0000","last_active":"2023-10-16T19:39:57.055973+0000","last_peered":"2023-10-16T19:39:57.055973+0000","last_clean":"2023-10-16T19:39:57.055973+0000","last_became_active":"2023-10-16T19:39:52.966932+0000","last_became_peered":"2023-10-16T19:39:52.966932+0000","last_unstale":"2023-10-16T19:39:57.055973+0000","last_undegraded":"2023-10-16T19:39:57.055973+0000","last_fullsized":"2023-10-16T19:39:57.055973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988889+0000","last_change":"2023-10-16T19:39:57.008404+0000","last_active":"2023-10-16T19:39:58.988889+0000","last_peered":"2023-10-16T19:39:58.988889+0000","last_clean":"2023-10-16T19:39:58.988889+0000","last_became_active":"2023-10-16T19:39:57.007860+0000","last_became_peered":"2023-10-16T19:39:57.007860+0000","last_unstale":"2023-10-16T19:39:58.988889+0000","last_undegraded":"2023-10-16T19:39:58.988889+0000","last_fullsized":"2023-10-16T19:39:58.988889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993704+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.993704+0000","last_peered":"2023-10-16T19:39:56.993704+0000","last_clean":"2023-10-16T19:39:56.993704+0000","last_became_active":"2023-10-16T19:39:51.956344+0000","last_became_peered":"2023-10-16T19:39:51.956344+0000","last_unstale":"2023-10-16T19:39:56.993704+0000","last_undegraded":"2023-10-16T19:39:56.993704+0000","last_fullsized":"2023-10-16T19:39:56.993704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:07.860685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984972+0000","last_change":"2023-10-16T19:39:52.976139+0000","last_active":"2023-10-16T19:39:56.984972+0000","last_peered":"2023-10-16T19:39:56.984972+0000","last_clean":"2023-10-16T19:39:56.984972+0000","last_became_active":"2023-10-16T19:39:52.975846+0000","last_became_peered":"2023-10-16T19:39:52.975846+0000","last_unstale":"2023-10-16T19:39:56.984972+0000","last_undegraded":"2023-10-16T19:39:56.984972+0000","last_fullsized":"2023-10-16T19:39:56.984972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988843+0000","last_change":"2023-10-16T19:39:57.005213+0000","last_active":"2023-10-16T19:39:58.988843+0000","last_peered":"2023-10-16T19:39:58.988843+0000","last_clean":"2023-10-16T19:39:58.988843+0000","last_became_active":"2023-10-16T19:39:57.004875+0000","last_became_peered":"2023-10-16T19:39:57.004875+0000","last_unstale":"2023-10-16T19:39:58.988843+0000","last_undegraded":"2023-10-16T19:39:58.988843+0000","last_fullsized":"2023-10-16T19:39:58.988843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983833+0000","last_change":"2023-10-16T19:39:51.966189+0000","last_active":"2023-10-16T19:39:56.983833+0000","last_peered":"2023-10-16T19:39:56.983833+0000","last_clean":"2023-10-16T19:39:56.983833+0000","last_became_active":"2023-10-16T19:39:51.965851+0000","last_became_peered":"2023-10-16T19:39:51.965851+0000","last_unstale":"2023-10-16T19:39:56.983833+0000","last_undegraded":"2023-10-16T19:39:56.983833+0000","last_fullsized":"2023-10-16T19:39:56.983833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979924+0000","last_change":"2023-10-16T19:39:52.969798+0000","last_active":"2023-10-16T19:39:56.979924+0000","last_peered":"2023-10-16T19:39:56.979924+0000","last_clean":"2023-10-16T19:39:56.979924+0000","last_became_active":"2023-10-16T19:39:52.969403+0000","last_became_peered":"2023-10-16T19:39:52.969403+0000","last_unstale":"2023-10-16T19:39:56.979924+0000","last_undegraded":"2023-10-16T19:39:56.979924+0000","last_fullsized":"2023-10-16T19:39:56.979924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:18.043026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989269+0000","last_change":"2023-10-16T19:39:57.006715+0000","last_active":"2023-10-16T19:39:58.989269+0000","last_peered":"2023-10-16T19:39:58.989269+0000","last_clean":"2023-10-16T19:39:58.989269+0000","last_became_active":"2023-10-16T19:39:57.006456+0000","last_became_peered":"2023-10-16T19:39:57.006456+0000","last_unstale":"2023-10-16T19:39:58.989269+0000","last_undegraded":"2023-10-16T19:39:58.989269+0000","last_fullsized":"2023-10-16T19:39:58.989269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992572+0000","last_change":"2023-10-16T19:39:52.959610+0000","last_active":"2023-10-16T19:39:56.992572+0000","last_peered":"2023-10-16T19:39:56.992572+0000","last_clean":"2023-10-16T19:39:56.992572+0000","last_became_active":"2023-10-16T19:39:52.959281+0000","last_became_peered":"2023-10-16T19:39:52.959281+0000","last_unstale":"2023-10-16T19:39:56.992572+0000","last_undegraded":"2023-10-16T19:39:56.992572+0000","last_fullsized":"2023-10-16T19:39:56.992572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976892+0000","last_change":"2023-10-16T19:39:51.959600+0000","last_active":"2023-10-16T19:39:56.976892+0000","last_peered":"2023-10-16T19:39:56.976892+0000","last_clean":"2023-10-16T19:39:56.976892+0000","last_became_active":"2023-10-16T19:39:51.959297+0000","last_became_peered":"2023-10-16T19:39:51.959297+0000","last_unstale":"2023-10-16T19:39:56.976892+0000","last_undegraded":"2023-10-16T19:39:56.976892+0000","last_fullsized":"2023-10-16T19:39:56.976892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015841+0000","last_change":"2023-10-16T19:39:57.059572+0000","last_active":"2023-10-16T19:39:58.015841+0000","last_peered":"2023-10-16T19:39:58.015841+0000","last_clean":"2023-10-16T19:39:58.015841+0000","last_became_active":"2023-10-16T19:39:57.059178+0000","last_became_peered":"2023-10-16T19:39:57.059178+0000","last_unstale":"2023-10-16T19:39:58.015841+0000","last_undegraded":"2023-10-16T19:39:58.015841+0000","last_fullsized":"2023-10-16T19:39:58.015841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.986497+0000","last_change":"2023-10-16T19:39:52.976022+0000","last_active":"2023-10-16T19:39:56.986497+0000","last_peered":"2023-10-16T19:39:56.986497+0000","last_clean":"2023-10-16T19:39:56.986497+0000","last_became_active":"2023-10-16T19:39:52.971031+0000","last_became_peered":"2023-10-16T19:39:52.971031+0000","last_unstale":"2023-10-16T19:39:56.986497+0000","last_undegraded":"2023-10-16T19:39:56.986497+0000","last_fullsized":"2023-10-16T19:39:56.986497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984582+0000","last_change":"2023-10-16T19:39:51.965776+0000","last_active":"2023-10-16T19:39:56.984582+0000","last_peered":"2023-10-16T19:39:56.984582+0000","last_clean":"2023-10-16T19:39:56.984582+0000","last_became_active":"2023-10-16T19:39:51.965449+0000","last_became_peered":"2023-10-16T19:39:51.965449+0000","last_unstale":"2023-10-16T19:39:56.984582+0000","last_undegraded":"2023-10-16T19:39:56.984582+0000","last_fullsized":"2023-10-16T19:39:56.984582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054846+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:39:57.054846+0000","last_peered":"2023-10-16T19:39:57.054846+0000","last_clean":"2023-10-16T19:39:57.054846+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:39:57.054846+0000","last_undegraded":"2023-10-16T19:39:57.054846+0000","last_fullsized":"2023-10-16T19:39:57.054846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.057034+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.056631+0000","last_became_peered":"2023-10-16T19:39:57.056631+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.981859+0000","last_change":"2023-10-16T19:39:52.968932+0000","last_active":"2023-10-16T19:39:56.981859+0000","last_peered":"2023-10-16T19:39:56.981859+0000","last_clean":"2023-10-16T19:39:56.981859+0000","last_became_active":"2023-10-16T19:39:52.968511+0000","last_became_peered":"2023-10-16T19:39:52.968511+0000","last_unstale":"2023-10-16T19:39:56.981859+0000","last_undegraded":"2023-10-16T19:39:56.981859+0000","last_fullsized":"2023-10-16T19:39:56.981859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:11.479736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054988+0000","last_change":"2023-10-16T19:39:51.960837+0000","last_active":"2023-10-16T19:39:57.054988+0000","last_peered":"2023-10-16T19:39:57.054988+0000","last_clean":"2023-10-16T19:39:57.054988+0000","last_became_active":"2023-10-16T19:39:51.960545+0000","last_became_peered":"2023-10-16T19:39:51.960545+0000","last_unstale":"2023-10-16T19:39:57.054988+0000","last_undegraded":"2023-10-16T19:39:57.054988+0000","last_fullsized":"2023-10-16T19:39:57.054988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752919+0000","last_change":"2023-10-16T19:39:57.055815+0000","last_active":"2023-10-16T19:39:58.752919+0000","last_peered":"2023-10-16T19:39:58.752919+0000","last_clean":"2023-10-16T19:39:58.752919+0000","last_became_active":"2023-10-16T19:39:57.055391+0000","last_became_peered":"2023-10-16T19:39:57.055391+0000","last_unstale":"2023-10-16T19:39:58.752919+0000","last_undegraded":"2023-10-16T19:39:58.752919+0000","last_fullsized":"2023-10-16T19:39:58.752919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055422+0000","last_change":"2023-10-16T19:39:51.967737+0000","last_active":"2023-10-16T19:39:57.055422+0000","last_peered":"2023-10-16T19:39:57.055422+0000","last_clean":"2023-10-16T19:39:57.055422+0000","last_became_active":"2023-10-16T19:39:51.967471+0000","last_became_peered":"2023-10-16T19:39:51.967471+0000","last_unstale":"2023-10-16T19:39:57.055422+0000","last_undegraded":"2023-10-16T19:39:57.055422+0000","last_fullsized":"2023-10-16T19:39:57.055422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:25.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993807+0000","last_change":"2023-10-16T19:39:52.955655+0000","last_active":"2023-10-16T19:39:56.993807+0000","last_peered":"2023-10-16T19:39:56.993807+0000","last_clean":"2023-10-16T19:39:56.993807+0000","last_became_active":"2023-10-16T19:39:52.955304+0000","last_became_peered":"2023-10-16T19:39:52.955304+0000","last_unstale":"2023-10-16T19:39:56.993807+0000","last_undegraded":"2023-10-16T19:39:56.993807+0000","last_fullsized":"2023-10-16T19:39:56.993807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013463+0000","last_change":"2023-10-16T19:39:57.059558+0000","last_active":"2023-10-16T19:39:58.013463+0000","last_peered":"2023-10-16T19:39:58.013463+0000","last_clean":"2023-10-16T19:39:58.013463+0000","last_became_active":"2023-10-16T19:39:57.059184+0000","last_became_peered":"2023-10-16T19:39:57.059184+0000","last_unstale":"2023-10-16T19:39:58.013463+0000","last_undegraded":"2023-10-16T19:39:58.013463+0000","last_fullsized":"2023-10-16T19:39:58.013463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995142+0000","last_change":"2023-10-16T19:39:51.959372+0000","last_active":"2023-10-16T19:39:56.995142+0000","last_peered":"2023-10-16T19:39:56.995142+0000","last_clean":"2023-10-16T19:39:56.995142+0000","last_became_active":"2023-10-16T19:39:51.959042+0000","last_became_peered":"2023-10-16T19:39:51.959042+0000","last_unstale":"2023-10-16T19:39:56.995142+0000","last_undegraded":"2023-10-16T19:39:56.995142+0000","last_fullsized":"2023-10-16T19:39:56.995142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000396+0000","last_change":"2023-10-16T19:39:52.971901+0000","last_active":"2023-10-16T19:39:57.000396+0000","last_peered":"2023-10-16T19:39:57.000396+0000","last_clean":"2023-10-16T19:39:57.000396+0000","last_became_active":"2023-10-16T19:39:52.971585+0000","last_became_peered":"2023-10-16T19:39:52.971585+0000","last_unstale":"2023-10-16T19:39:57.000396+0000","last_undegraded":"2023-10-16T19:39:57.000396+0000","last_fullsized":"2023-10-16T19:39:57.000396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014361+0000","last_change":"2023-10-16T19:39:57.058350+0000","last_active":"2023-10-16T19:39:58.014361+0000","last_peered":"2023-10-16T19:39:58.014361+0000","last_clean":"2023-10-16T19:39:58.014361+0000","last_became_active":"2023-10-16T19:39:57.057923+0000","last_became_peered":"2023-10-16T19:39:57.057923+0000","last_unstale":"2023-10-16T19:39:58.014361+0000","last_undegraded":"2023-10-16T19:39:58.014361+0000","last_fullsized":"2023-10-16T19:39:58.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:30.363712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978788+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.978788+0000","last_peered":"2023-10-16T19:39:56.978788+0000","last_clean":"2023-10-16T19:39:56.978788+0000","last_became_active":"2023-10-16T19:39:51.956150+0000","last_became_peered":"2023-10-16T19:39:51.956150+0000","last_unstale":"2023-10-16T19:39:56.978788+0000","last_undegraded":"2023-10-16T19:39:56.978788+0000","last_fullsized":"2023-10-16T19:39:56.978788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.989271+0000","last_change":"2023-10-16T19:39:52.966065+0000","last_active":"2023-10-16T19:39:56.989271+0000","last_peered":"2023-10-16T19:39:56.989271+0000","last_clean":"2023-10-16T19:39:56.989271+0000","last_became_active":"2023-10-16T19:39:52.965732+0000","last_became_peered":"2023-10-16T19:39:52.965732+0000","last_unstale":"2023-10-16T19:39:56.989271+0000","last_undegraded":"2023-10-16T19:39:56.989271+0000","last_fullsized":"2023-10-16T19:39:56.989271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014987+0000","last_change":"2023-10-16T19:39:56.998411+0000","last_active":"2023-10-16T19:39:58.014987+0000","last_peered":"2023-10-16T19:39:58.014987+0000","last_clean":"2023-10-16T19:39:58.014987+0000","last_became_active":"2023-10-16T19:39:56.997765+0000","last_became_peered":"2023-10-16T19:39:56.997765+0000","last_unstale":"2023-10-16T19:39:58.014987+0000","last_undegraded":"2023-10-16T19:39:58.014987+0000","last_fullsized":"2023-10-16T19:39:58.014987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:48.787388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054917+0000","last_change":"2023-10-16T19:39:51.967870+0000","last_active":"2023-10-16T19:39:57.054917+0000","last_peered":"2023-10-16T19:39:57.054917+0000","last_clean":"2023-10-16T19:39:57.054917+0000","last_became_active":"2023-10-16T19:39:51.967540+0000","last_became_peered":"2023-10-16T19:39:51.967540+0000","last_unstale":"2023-10-16T19:39:57.054917+0000","last_undegraded":"2023-10-16T19:39:57.054917+0000","last_fullsized":"2023-10-16T19:39:57.054917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979126+0000","last_change":"2023-10-16T19:39:52.969100+0000","last_active":"2023-10-16T19:39:56.979126+0000","last_peered":"2023-10-16T19:39:56.979126+0000","last_clean":"2023-10-16T19:39:56.979126+0000","last_became_active":"2023-10-16T19:39:52.968640+0000","last_became_peered":"2023-10-16T19:39:52.968640+0000","last_unstale":"2023-10-16T19:39:56.979126+0000","last_undegraded":"2023-10-16T19:39:56.979126+0000","last_fullsized":"2023-10-16T19:39:56.979126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:36.664859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989349+0000","last_change":"2023-10-16T19:39:57.055862+0000","last_active":"2023-10-16T19:39:58.989349+0000","last_peered":"2023-10-16T19:39:58.989349+0000","last_clean":"2023-10-16T19:39:58.989349+0000","last_became_active":"2023-10-16T19:39:57.055442+0000","last_became_peered":"2023-10-16T19:39:57.055442+0000","last_unstale":"2023-10-16T19:39:58.989349+0000","last_undegraded":"2023-10-16T19:39:58.989349+0000","last_fullsized":"2023-10-16T19:39:58.989349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992158+0000","last_change":"2023-10-16T19:39:51.963084+0000","last_active":"2023-10-16T19:39:56.992158+0000","last_peered":"2023-10-16T19:39:56.992158+0000","last_clean":"2023-10-16T19:39:56.992158+0000","last_became_active":"2023-10-16T19:39:51.962807+0000","last_became_peered":"2023-10-16T19:39:51.962807+0000","last_unstale":"2023-10-16T19:39:56.992158+0000","last_undegraded":"2023-10-16T19:39:56.992158+0000","last_fullsized":"2023-10-16T19:39:56.992158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988486+0000","last_change":"2023-10-16T19:39:52.978428+0000","last_active":"2023-10-16T19:39:56.988486+0000","last_peered":"2023-10-16T19:39:56.988486+0000","last_clean":"2023-10-16T19:39:56.988486+0000","last_became_active":"2023-10-16T19:39:52.978101+0000","last_became_peered":"2023-10-16T19:39:52.978101+0000","last_unstale":"2023-10-16T19:39:56.988486+0000","last_undegraded":"2023-10-16T19:39:56.988486+0000","last_fullsized":"2023-10-16T19:39:56.988486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015410+0000","last_change":"2023-10-16T19:39:56.998806+0000","last_active":"2023-10-16T19:39:58.015410+0000","last_peered":"2023-10-16T19:39:58.015410+0000","last_clean":"2023-10-16T19:39:58.015410+0000","last_became_active":"2023-10-16T19:39:56.997925+0000","last_became_peered":"2023-10-16T19:39:56.997925+0000","last_unstale":"2023-10-16T19:39:58.015410+0000","last_undegraded":"2023-10-16T19:39:58.015410+0000","last_fullsized":"2023-10-16T19:39:58.015410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:08.168565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992271+0000","last_change":"2023-10-16T19:39:51.964864+0000","last_active":"2023-10-16T19:39:56.992271+0000","last_peered":"2023-10-16T19:39:56.992271+0000","last_clean":"2023-10-16T19:39:56.992271+0000","last_became_active":"2023-10-16T19:39:51.964479+0000","last_became_peered":"2023-10-16T19:39:51.964479+0000","last_unstale":"2023-10-16T19:39:56.992271+0000","last_undegraded":"2023-10-16T19:39:56.992271+0000","last_fullsized":"2023-10-16T19:39:56.992271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.659971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996915+0000","last_change":"2023-10-16T19:39:52.971775+0000","last_active":"2023-10-16T19:39:56.996915+0000","last_peered":"2023-10-16T19:39:56.996915+0000","last_clean":"2023-10-16T19:39:56.996915+0000","last_became_active":"2023-10-16T19:39:52.971381+0000","last_became_peered":"2023-10-16T19:39:52.971381+0000","last_unstale":"2023-10-16T19:39:56.996915+0000","last_undegraded":"2023-10-16T19:39:56.996915+0000","last_fullsized":"2023-10-16T19:39:56.996915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015073+0000","last_change":"2023-10-16T19:39:56.995155+0000","last_active":"2023-10-16T19:39:58.015073+0000","last_peered":"2023-10-16T19:39:58.015073+0000","last_clean":"2023-10-16T19:39:58.015073+0000","last_became_active":"2023-10-16T19:39:56.994693+0000","last_became_peered":"2023-10-16T19:39:56.994693+0000","last_unstale":"2023-10-16T19:39:58.015073+0000","last_undegraded":"2023-10-16T19:39:58.015073+0000","last_fullsized":"2023-10-16T19:39:58.015073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055607+0000","last_change":"2023-10-16T19:39:51.961933+0000","last_active":"2023-10-16T19:39:57.055607+0000","last_peered":"2023-10-16T19:39:57.055607+0000","last_clean":"2023-10-16T19:39:57.055607+0000","last_became_active":"2023-10-16T19:39:51.961548+0000","last_became_peered":"2023-10-16T19:39:51.961548+0000","last_unstale":"2023-10-16T19:39:57.055607+0000","last_undegraded":"2023-10-16T19:39:57.055607+0000","last_fullsized":"2023-10-16T19:39:57.055607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978123+0000","last_change":"2023-10-16T19:39:52.959823+0000","last_active":"2023-10-16T19:39:56.978123+0000","last_peered":"2023-10-16T19:39:56.978123+0000","last_clean":"2023-10-16T19:39:56.978123+0000","last_became_active":"2023-10-16T19:39:52.959508+0000","last_became_peered":"2023-10-16T19:39:52.959508+0000","last_unstale":"2023-10-16T19:39:56.978123+0000","last_undegraded":"2023-10-16T19:39:56.978123+0000","last_fullsized":"2023-10-16T19:39:56.978123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015856+0000","last_change":"2023-10-16T19:39:57.055819+0000","last_active":"2023-10-16T19:39:58.015856+0000","last_peered":"2023-10-16T19:39:58.015856+0000","last_clean":"2023-10-16T19:39:58.015856+0000","last_became_active":"2023-10-16T19:39:57.055371+0000","last_became_peered":"2023-10-16T19:39:57.055371+0000","last_unstale":"2023-10-16T19:39:58.015856+0000","last_undegraded":"2023-10-16T19:39:58.015856+0000","last_fullsized":"2023-10-16T19:39:58.015856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977712+0000","last_change":"2023-10-16T19:39:51.962380+0000","last_active":"2023-10-16T19:39:56.977712+0000","last_peered":"2023-10-16T19:39:56.977712+0000","last_clean":"2023-10-16T19:39:56.977712+0000","last_became_active":"2023-10-16T19:39:51.962053+0000","last_became_peered":"2023-10-16T19:39:51.962053+0000","last_unstale":"2023-10-16T19:39:56.977712+0000","last_undegraded":"2023-10-16T19:39:56.977712+0000","last_fullsized":"2023-10-16T19:39:56.977712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055763+0000","last_change":"2023-10-16T19:39:52.973102+0000","last_active":"2023-10-16T19:39:57.055763+0000","last_peered":"2023-10-16T19:39:57.055763+0000","last_clean":"2023-10-16T19:39:57.055763+0000","last_became_active":"2023-10-16T19:39:52.972823+0000","last_became_peered":"2023-10-16T19:39:52.972823+0000","last_unstale":"2023-10-16T19:39:57.055763+0000","last_undegraded":"2023-10-16T19:39:57.055763+0000","last_fullsized":"2023-10-16T19:39:57.055763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752852+0000","last_change":"2023-10-16T19:39:56.998067+0000","last_active":"2023-10-16T19:39:58.752852+0000","last_peered":"2023-10-16T19:39:58.752852+0000","last_clean":"2023-10-16T19:39:58.752852+0000","last_became_active":"2023-10-16T19:39:56.996916+0000","last_became_peered":"2023-10-16T19:39:56.996916+0000","last_unstale":"2023-10-16T19:39:58.752852+0000","last_undegraded":"2023-10-16T19:39:58.752852+0000","last_fullsized":"2023-10-16T19:39:58.752852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993787+0000","last_change":"2023-10-16T19:39:51.962402+0000","last_active":"2023-10-16T19:39:56.993787+0000","last_peered":"2023-10-16T19:39:56.993787+0000","last_clean":"2023-10-16T19:39:56.993787+0000","last_became_active":"2023-10-16T19:39:51.961789+0000","last_became_peered":"2023-10-16T19:39:51.961789+0000","last_unstale":"2023-10-16T19:39:56.993787+0000","last_undegraded":"2023-10-16T19:39:56.993787+0000","last_fullsized":"2023-10-16T19:39:56.993787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984210+0000","last_change":"2023-10-16T19:39:52.972162+0000","last_active":"2023-10-16T19:39:56.984210+0000","last_peered":"2023-10-16T19:39:56.984210+0000","last_clean":"2023-10-16T19:39:56.984210+0000","last_became_active":"2023-10-16T19:39:52.971650+0000","last_became_peered":"2023-10-16T19:39:52.971650+0000","last_unstale":"2023-10-16T19:39:56.984210+0000","last_undegraded":"2023-10-16T19:39:56.984210+0000","last_fullsized":"2023-10-16T19:39:56.984210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707432+0000","last_change":"2023-10-16T19:39:57.057262+0000","last_active":"2023-10-16T19:39:58.707432+0000","last_peered":"2023-10-16T19:39:58.707432+0000","last_clean":"2023-10-16T19:39:58.707432+0000","last_became_active":"2023-10-16T19:39:57.056817+0000","last_became_peered":"2023-10-16T19:39:57.056817+0000","last_unstale":"2023-10-16T19:39:58.707432+0000","last_undegraded":"2023-10-16T19:39:58.707432+0000","last_fullsized":"2023-10-16T19:39:58.707432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977037+0000","last_change":"2023-10-16T19:39:51.962396+0000","last_active":"2023-10-16T19:39:56.977037+0000","last_peered":"2023-10-16T19:39:56.977037+0000","last_clean":"2023-10-16T19:39:56.977037+0000","last_became_active":"2023-10-16T19:39:51.962087+0000","last_became_peered":"2023-10-16T19:39:51.962087+0000","last_unstale":"2023-10-16T19:39:56.977037+0000","last_undegraded":"2023-10-16T19:39:56.977037+0000","last_fullsized":"2023-10-16T19:39:56.977037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056819+0000","last_change":"2023-10-16T19:39:52.966846+0000","last_active":"2023-10-16T19:39:57.056819+0000","last_peered":"2023-10-16T19:39:57.056819+0000","last_clean":"2023-10-16T19:39:57.056819+0000","last_became_active":"2023-10-16T19:39:52.966558+0000","last_became_peered":"2023-10-16T19:39:52.966558+0000","last_unstale":"2023-10-16T19:39:57.056819+0000","last_undegraded":"2023-10-16T19:39:57.056819+0000","last_fullsized":"2023-10-16T19:39:57.056819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978101+0000","last_change":"2023-10-16T19:39:52.968833+0000","last_active":"2023-10-16T19:39:56.978101+0000","last_peered":"2023-10-16T19:39:56.978101+0000","last_clean":"2023-10-16T19:39:56.978101+0000","last_became_active":"2023-10-16T19:39:52.968540+0000","last_became_peered":"2023-10-16T19:39:52.968540+0000","last_unstale":"2023-10-16T19:39:56.978101+0000","last_undegraded":"2023-10-16T19:39:56.978101+0000","last_fullsized":"2023-10-16T19:39:56.978101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977005+0000","last_change":"2023-10-16T19:39:52.966376+0000","last_active":"2023-10-16T19:39:56.977005+0000","last_peered":"2023-10-16T19:39:56.977005+0000","last_clean":"2023-10-16T19:39:56.977005+0000","last_became_active":"2023-10-16T19:39:52.966044+0000","last_became_peered":"2023-10-16T19:39:52.966044+0000","last_unstale":"2023-10-16T19:39:56.977005+0000","last_undegraded":"2023-10-16T19:39:56.977005+0000","last_fullsized":"2023-10-16T19:39:56.977005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984282+0000","last_change":"2023-10-16T19:39:52.971488+0000","last_active":"2023-10-16T19:39:56.984282+0000","last_peered":"2023-10-16T19:39:56.984282+0000","last_clean":"2023-10-16T19:39:56.984282+0000","last_became_active":"2023-10-16T19:39:52.970909+0000","last_became_peered":"2023-10-16T19:39:52.970909+0000","last_unstale":"2023-10-16T19:39:56.984282+0000","last_undegraded":"2023-10-16T19:39:56.984282+0000","last_fullsized":"2023-10-16T19:39:56.984282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982419+0000","last_change":"2023-10-16T19:39:52.975269+0000","last_active":"2023-10-16T19:39:56.982419+0000","last_peered":"2023-10-16T19:39:56.982419+0000","last_clean":"2023-10-16T19:39:56.982419+0000","last_became_active":"2023-10-16T19:39:52.973150+0000","last_became_peered":"2023-10-16T19:39:52.973150+0000","last_unstale":"2023-10-16T19:39:56.982419+0000","last_undegraded":"2023-10-16T19:39:56.982419+0000","last_fullsized":"2023-10-16T19:39:56.982419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997003+0000","last_change":"2023-10-16T19:39:52.969771+0000","last_active":"2023-10-16T19:39:56.997003+0000","last_peered":"2023-10-16T19:39:56.997003+0000","last_clean":"2023-10-16T19:39:56.997003+0000","last_became_active":"2023-10-16T19:39:52.969468+0000","last_became_peered":"2023-10-16T19:39:52.969468+0000","last_unstale":"2023-10-16T19:39:56.997003+0000","last_undegraded":"2023-10-16T19:39:56.997003+0000","last_fullsized":"2023-10-16T19:39:56.997003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993745+0000","last_change":"2023-10-16T19:39:52.957538+0000","last_active":"2023-10-16T19:39:56.993745+0000","last_peered":"2023-10-16T19:39:56.993745+0000","last_clean":"2023-10-16T19:39:56.993745+0000","last_became_active":"2023-10-16T19:39:52.957106+0000","last_became_peered":"2023-10-16T19:39:52.957106+0000","last_unstale":"2023-10-16T19:39:56.993745+0000","last_undegraded":"2023-10-16T19:39:56.993745+0000","last_fullsized":"2023-10-16T19:39:56.993745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978579+0000","last_change":"2023-10-16T19:39:52.970773+0000","last_active":"2023-10-16T19:39:56.978579+0000","last_peered":"2023-10-16T19:39:56.978579+0000","last_clean":"2023-10-16T19:39:56.978579+0000","last_became_active":"2023-10-16T19:39:52.970485+0000","last_became_peered":"2023-10-16T19:39:52.970485+0000","last_unstale":"2023-10-16T19:39:56.978579+0000","last_undegraded":"2023-10-16T19:39:56.978579+0000","last_fullsized":"2023-10-16T19:39:56.978579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000749+0000","last_change":"2023-10-16T19:39:52.969630+0000","last_active":"2023-10-16T19:39:57.000749+0000","last_peered":"2023-10-16T19:39:57.000749+0000","last_clean":"2023-10-16T19:39:57.000749+0000","last_became_active":"2023-10-16T19:39:52.969298+0000","last_became_peered":"2023-10-16T19:39:52.969298+0000","last_unstale":"2023-10-16T19:39:57.000749+0000","last_undegraded":"2023-10-16T19:39:57.000749+0000","last_fullsized":"2023-10-16T19:39:57.000749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983919+0000","last_change":"2023-10-16T19:39:52.979228+0000","last_active":"2023-10-16T19:39:56.983919+0000","last_peered":"2023-10-16T19:39:56.983919+0000","last_clean":"2023-10-16T19:39:56.983919+0000","last_became_active":"2023-10-16T19:39:52.978788+0000","last_became_peered":"2023-10-16T19:39:52.978788+0000","last_unstale":"2023-10-16T19:39:56.983919+0000","last_undegraded":"2023-10-16T19:39:56.983919+0000","last_fullsized":"2023-10-16T19:39:56.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995707+0000","last_change":"2023-10-16T19:39:52.962415+0000","last_active":"2023-10-16T19:39:56.995707+0000","last_peered":"2023-10-16T19:39:56.995707+0000","last_clean":"2023-10-16T19:39:56.995707+0000","last_became_active":"2023-10-16T19:39:52.962093+0000","last_became_peered":"2023-10-16T19:39:52.962093+0000","last_unstale":"2023-10-16T19:39:56.995707+0000","last_undegraded":"2023-10-16T19:39:56.995707+0000","last_fullsized":"2023-10-16T19:39:56.995707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984054+0000","last_change":"2023-10-16T19:39:52.971993+0000","last_active":"2023-10-16T19:39:56.984054+0000","last_peered":"2023-10-16T19:39:56.984054+0000","last_clean":"2023-10-16T19:39:56.984054+0000","last_became_active":"2023-10-16T19:39:52.971684+0000","last_became_peered":"2023-10-16T19:39:52.971684+0000","last_unstale":"2023-10-16T19:39:56.984054+0000","last_undegraded":"2023-10-16T19:39:56.984054+0000","last_fullsized":"2023-10-16T19:39:56.984054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983218+0000","last_change":"2023-10-16T19:39:52.977733+0000","last_active":"2023-10-16T19:39:56.983218+0000","last_peered":"2023-10-16T19:39:56.983218+0000","last_clean":"2023-10-16T19:39:56.983218+0000","last_became_active":"2023-10-16T19:39:52.977383+0000","last_became_peered":"2023-10-16T19:39:52.977383+0000","last_unstale":"2023-10-16T19:39:56.983218+0000","last_undegraded":"2023-10-16T19:39:56.983218+0000","last_fullsized":"2023-10-16T19:39:56.983218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978000+0000","last_change":"2023-10-16T19:39:52.961967+0000","last_active":"2023-10-16T19:39:56.978000+0000","last_peered":"2023-10-16T19:39:56.978000+0000","last_clean":"2023-10-16T19:39:56.978000+0000","last_became_active":"2023-10-16T19:39:52.961663+0000","last_became_peered":"2023-10-16T19:39:52.961663+0000","last_unstale":"2023-10-16T19:39:56.978000+0000","last_undegraded":"2023-10-16T19:39:56.978000+0000","last_fullsized":"2023-10-16T19:39:56.978000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:40:18.976 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T19:40:18.976 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T19:40:18.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T19:40:18.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T19:40:18.978 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T19:40:19.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.132+0000 7fd743a15700 1 Processor -- start 2023-10-16T19:40:19.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.132+0000 7fd743a15700 1 -- start start 2023-10-16T19:40:19.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.132+0000 7fd743a15700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd73c06f6e0 0x7fd73c156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd743a15700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c150100 0x7fd73c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd743a15700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c0724a0 con 0x7fd73c0c18b0 2023-10-16T19:40:19.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd743a15700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c152780 con 0x7fd73c06f6e0 2023-10-16T19:40:19.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd743a15700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c2660 con 0x7fd73c150100 2023-10-16T19:40:19.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd740fb0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd73c0c18b0 0x7fd73c14f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37092/0 (socket says 172.21.15.29:37092) 2023-10-16T19:40:19.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd740fb0700 1 -- 172.21.15.29:0/529449852 learned_addr learned my addr 172.21.15.29:0/529449852 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:19.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 --2- 172.21.15.29:0/529449852 >> v2:172.21.15.53:3300/0 conn(0x7fd73c06f6e0 0x7fd73c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd741fb2700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c150100 0x7fd73c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639892842 0 0) 0x7fd73c0724a0 con 0x7fd73c0c18b0 2023-10-16T19:40:19.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7280035b0 con 0x7fd73c0c18b0 2023-10-16T19:40:19.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572716837 0 0) 0x7fd7280035b0 con 0x7fd73c0c18b0 2023-10-16T19:40:19.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 -- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c150100 msgr2=0x7fd73c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:19.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c150100 0x7fd73c152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 -- 172.21.15.29:0/529449852 >> v1:172.21.15.29:6789/0 conn(0x7fd73c0c18b0 legacy=0x7fd73c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 -- 172.21.15.29:0/529449852 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0a8490 con 0x7fd73c06f6e0 2023-10-16T19:40:19.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.133+0000 7fd7417b1700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c156670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd738009840 tx=0x7fd738009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b956b732f2ef0e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c001670 con 0x7fd73c06f6e0 2023-10-16T19:40:19.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd738004030 con 0x7fd73c06f6e0 2023-10-16T19:40:19.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd733fff700 1 -- 172.21.15.29:0/529449852 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380043c0 con 0x7fd73c06f6e0 2023-10-16T19:40:19.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 -- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 msgr2=0x7fd73c156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c156670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd738009840 tx=0x7fd738009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:19.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 -- 172.21.15.29:0/529449852 shutdown_connections 2023-10-16T19:40:19.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c150100 0x7fd73c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 --2- 172.21.15.29:0/529449852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c156670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 -- 172.21.15.29:0/529449852 >> 172.21.15.29:0/529449852 conn(0x7fd73c0c7110 msgr2=0x7fd73c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 -- 172.21.15.29:0/529449852 shutdown_connections 2023-10-16T19:40:19.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.134+0000 7fd743a15700 1 -- 172.21.15.29:0/529449852 wait complete. 2023-10-16T19:40:19.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.135+0000 7fd743a15700 1 Processor -- start 2023-10-16T19:40:19.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 -- start start 2023-10-16T19:40:19.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 0x7fd73c0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1eda70 con 0x7fd73c150100 2023-10-16T19:40:19.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c151990 con 0x7fd73c06f6e0 2023-10-16T19:40:19.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd743a15700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c156ae0 con 0x7fd73c0c18b0 2023-10-16T19:40:19.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd741fb2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd741fb2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51658/0 (socket says 172.21.15.29:51658) 2023-10-16T19:40:19.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.136+0000 7fd741fb2700 1 -- 172.21.15.29:0/1492316696 learned_addr learned my addr 172.21.15.29:0/1492316696 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:19.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd740fb0700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 0x7fd73c0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd7417b1700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 -- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 msgr2=0x7fd73c0c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 0x7fd73c0c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 -- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 msgr2=0x7fd73c1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 -- 172.21.15.29:0/1492316696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094a0 con 0x7fd73c150100 2023-10-16T19:40:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd740fb0700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 0x7fd73c0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd7417b1700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd741fb2700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ef90 tx=0x7fd73400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734009b20 con 0x7fd73c150100 2023-10-16T19:40:19.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400f040 con 0x7fd73c150100 2023-10-16T19:40:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c0c5040 con 0x7fd73c150100 2023-10-16T19:40:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734009e50 con 0x7fd73c150100 2023-10-16T19:40:19.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.137+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c0c0970 con 0x7fd73c150100 2023-10-16T19:40:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.138+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c04f400 con 0x7fd73c150100 2023-10-16T19:40:19.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.139+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd734014480 con 0x7fd73c150100 2023-10-16T19:40:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.139+0000 7fd731ffb700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 0x7fd72006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.139+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd73408a490 con 0x7fd73c150100 2023-10-16T19:40:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.139+0000 7fd7417b1700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 0x7fd72006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.140+0000 7fd7417b1700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 0x7fd72006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd738008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.143+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd734055250 con 0x7fd73c150100 2023-10-16T19:40:19.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.407+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd73c14d200 con 0x7fd73c150100 2023-10-16T19:40:19.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.410+0000 7fd731ffb700 1 -- 172.21.15.29:0/1492316696 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7fd734058870 con 0x7fd73c150100 2023-10-16T19:40:19.414 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 msgr2=0x7fd72006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 0x7fd72006d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd738008030 comp rx=0 tx=0).stop 2023-10-16T19:40:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 msgr2=0x7fd73c144350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ef90 tx=0x7fd73400c3a0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 shutdown_connections 2023-10-16T19:40:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd72006af00 0x7fd72006d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c150100 0x7fd73c144350 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c06f6e0 0x7fd73c1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 --2- 172.21.15.29:0/1492316696 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd73c0c18b0 0x7fd73c0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 >> 172.21.15.29:0/1492316696 conn(0x7fd73c0c7110 msgr2=0x7fd73c0abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 shutdown_connections 2023-10-16T19:40:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.413+0000 7fd743a15700 1 -- 172.21.15.29:0/1492316696 wait complete. 2023-10-16T19:40:19.427 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2936749946},{"type":"v1","addr":"172.21.15.53:6833","nonce":2936749946}]},"active_addr":"172.21.15.53:6833/2936749946","active_change":"2023-10-16T19:39:40.545165+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4117,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3819077328}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":2677077888}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1407641630}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1214219110}]}]} 2023-10-16T19:40:19.432 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T19:40:19.432 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T19:40:19.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:19.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 Processor -- start 2023-10-16T19:40:19.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 -- start start 2023-10-16T19:40:19.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc180ac0a0 0x7efc18153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc1806a880 0x7efc1806ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc18156c60 con 0x7efc1814c780 2023-10-16T19:40:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180ac7d0 con 0x7efc180ac0a0 2023-10-16T19:40:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.556+0000 7efc1e6e8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc181537d0 con 0x7efc1806a880 2023-10-16T19:40:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc17fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc1814c780 0x7efc1806d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37106/0 (socket says 172.21.15.29:37106) 2023-10-16T19:40:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc17fff700 1 -- 172.21.15.29:0/2961812895 learned_addr learned my addr 172.21.15.29:0/2961812895 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 --2- 172.21.15.29:0/2961812895 >> v2:172.21.15.53:3300/0 conn(0x7efc180ac0a0 0x7efc18153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc1cc85700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc1806a880 0x7efc1806ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc16ffd700 1 -- 172.21.15.29:0/2961812895 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105000464 0 0) 0x7efc18156c60 con 0x7efc1814c780 2023-10-16T19:40:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc16ffd700 1 -- 172.21.15.29:0/2961812895 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc000035b0 con 0x7efc1814c780 2023-10-16T19:40:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 -- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc1806a880 msgr2=0x7efc1806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc1806a880 0x7efc1806ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 -- 172.21.15.29:0/2961812895 >> v1:172.21.15.29:6789/0 conn(0x7efc1814c780 legacy=0x7efc1806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 -- 172.21.15.29:0/2961812895 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180ac500 con 0x7efc180ac0a0 2023-10-16T19:40:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc177fe700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc180ac0a0 0x7efc18153290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac2c3412638bb9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc16ffd700 1 -- 172.21.15.29:0/2961812895 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011830 con 0x7efc180ac0a0 2023-10-16T19:40:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc16ffd700 1 -- 172.21.15.29:0/2961812895 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c011990 con 0x7efc180ac0a0 2023-10-16T19:40:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.557+0000 7efc16ffd700 1 -- 172.21.15.29:0/2961812895 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011d20 con 0x7efc180ac0a0 2023-10-16T19:40:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 -- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc180ac0a0 msgr2=0x7efc18153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc180ac0a0 0x7efc18153290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c009b80 comp rx=0 tx=0).stop 2023-10-16T19:40:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 -- 172.21.15.29:0/2961812895 shutdown_connections 2023-10-16T19:40:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc1806a880 0x7efc1806ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/2961812895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc180ac0a0 0x7efc18153290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 -- 172.21.15.29:0/2961812895 >> 172.21.15.29:0/2961812895 conn(0x7efc180c66d0 msgr2=0x7efc180c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 -- 172.21.15.29:0/2961812895 shutdown_connections 2023-10-16T19:40:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.558+0000 7efc1e6e8700 1 -- 172.21.15.29:0/2961812895 wait complete. 2023-10-16T19:40:19.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.559+0000 7efc1e6e8700 1 Processor -- start 2023-10-16T19:40:19.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.559+0000 7efc1e6e8700 1 -- start start 2023-10-16T19:40:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1806a880 0x7efc180aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc180ac0a0 0x7efc180c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1814a770 con 0x7efc1814c780 2023-10-16T19:40:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc18141420 con 0x7efc1806a880 2023-10-16T19:40:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1e6e8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1814a120 con 0x7efc180ac0a0 2023-10-16T19:40:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51672/0 (socket says 172.21.15.29:51672) 2023-10-16T19:40:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 -- 172.21.15.29:0/637090707 learned_addr learned my addr 172.21.15.29:0/637090707 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc17fff700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1806a880 0x7efc180aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc177fe700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc180ac0a0 0x7efc180c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 -- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc180ac0a0 msgr2=0x7efc180c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc180ac0a0 0x7efc180c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 -- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1806a880 msgr2=0x7efc180aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1806a880 0x7efc180aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.560+0000 7efc1cc85700 1 -- 172.21.15.29:0/637090707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0094a0 con 0x7efc1814c780 2023-10-16T19:40:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc1cc85700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc1000efc0 tx=0x7efc1000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000cb50 con 0x7efc1814c780 2023-10-16T19:40:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1000f040 con 0x7efc1814c780 2023-10-16T19:40:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10014480 con 0x7efc1814c780 2023-10-16T19:40:19.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1814a400 con 0x7efc1814c780 2023-10-16T19:40:19.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.561+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc180ab3c0 con 0x7efc1814c780 2023-10-16T19:40:19.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.562+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1814a920 con 0x7efc1814c780 2023-10-16T19:40:19.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.562+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc100145e0 con 0x7efc1814c780 2023-10-16T19:40:19.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.563+0000 7efc14ff9700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 0x7efc0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.563+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc1008a3e0 con 0x7efc1814c780 2023-10-16T19:40:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.563+0000 7efc17fff700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 0x7efc0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.563+0000 7efc17fff700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 0x7efc0406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc08007fd0 tx=0x7efc08007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.567+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc1814a920 con 0x7efc1814c780 2023-10-16T19:40:19.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.770+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc1814a920 con 0x7efc1814c780 2023-10-16T19:40:19.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.771+0000 7efc14ff9700 1 -- 172.21.15.29:0/637090707 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7efc1814a920 con 0x7efc1814c780 2023-10-16T19:40:19.773 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:19.773 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:19.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 msgr2=0x7efc0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 0x7efc0406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc08007fd0 tx=0x7efc08007dc0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 msgr2=0x7efc181eb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc1000efc0 tx=0x7efc1000c0c0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 shutdown_connections 2023-10-16T19:40:19.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efc0406af00 0x7efc0406d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc1814c780 0x7efc181eb3d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc1806a880 0x7efc180aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 --2- 172.21.15.29:0/637090707 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc180ac0a0 0x7efc180c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 >> 172.21.15.29:0/637090707 conn(0x7efc180c66d0 msgr2=0x7efc18150780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 shutdown_connections 2023-10-16T19:40:19.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.773+0000 7efc1e6e8700 1 -- 172.21.15.29:0/637090707 wait complete. 2023-10-16T19:40:19.787 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T19:40:19.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:19.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.910+0000 7f929a054700 1 Processor -- start 2023-10-16T19:40:19.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.910+0000 7f929a054700 1 -- start start 2023-10-16T19:40:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f929a054700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f929414e390 0x7f929406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f929a054700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 0x7f9294072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f929a054700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929414e770 con 0x7f929406e0d0 2023-10-16T19:40:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f929a054700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9294070f80 con 0x7f929414e390 2023-10-16T19:40:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f929a054700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929406c0e0 con 0x7f9294072070 2023-10-16T19:40:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f92937fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f929414e390 0x7f929406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f92937fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f929414e390 0x7f929406b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51676/0 (socket says 172.21.15.29:51676) 2023-10-16T19:40:19.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.911+0000 7f92937fe700 1 -- 172.21.15.29:0/460107519 learned_addr learned my addr 172.21.15.29:0/460107519 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:19.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f9293fff700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 0x7f9294072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92937fe700 1 -- 172.21.15.29:0/460107519 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 msgr2=0x7f9294072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:19.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92937fe700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 0x7f9294072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92937fe700 1 -- 172.21.15.29:0/460107519 >> v1:172.21.15.53:6789/0 conn(0x7f929406e0d0 legacy=0x7f929406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92937fe700 1 -- 172.21.15.29:0/460107519 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294151760 con 0x7f929414e390 2023-10-16T19:40:19.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f9293fff700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 0x7f9294072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:19.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92937fe700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929414e390 0x7f929406b490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f928400bbc0 tx=0x7f928400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b6f68f8f1223ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92927fc700 1 -- 172.21.15.29:0/460107519 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400dc40 con 0x7f929414e390 2023-10-16T19:40:19.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92927fc700 1 -- 172.21.15.29:0/460107519 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400dda0 con 0x7f929414e390 2023-10-16T19:40:19.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.912+0000 7f92927fc700 1 -- 172.21.15.29:0/460107519 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284017630 con 0x7f929414e390 2023-10-16T19:40:19.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 -- 172.21.15.29:0/460107519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929414e390 msgr2=0x7f929406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929414e390 0x7f929406b490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f928400bbc0 tx=0x7f928400bed0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 -- 172.21.15.29:0/460107519 shutdown_connections 2023-10-16T19:40:19.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9294072070 0x7f9294072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 --2- 172.21.15.29:0/460107519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f929414e390 0x7f929406b490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 -- 172.21.15.29:0/460107519 >> 172.21.15.29:0/460107519 conn(0x7f92940c6670 msgr2=0x7f92940c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:19.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 -- 172.21.15.29:0/460107519 shutdown_connections 2023-10-16T19:40:19.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.913+0000 7f929a054700 1 -- 172.21.15.29:0/460107519 wait complete. 2023-10-16T19:40:19.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.914+0000 7f929a054700 1 Processor -- start 2023-10-16T19:40:19.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.914+0000 7f929a054700 1 -- start start 2023-10-16T19:40:19.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 0x7f92940aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 0x7f929414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940bb6b0 con 0x7f9294072070 2023-10-16T19:40:19.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940bb990 con 0x7f929414e390 2023-10-16T19:40:19.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929414b010 con 0x7f929406e0d0 2023-10-16T19:40:19.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51684/0 (socket says 172.21.15.29:51684) 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 -- 172.21.15.29:0/2969426681 learned_addr learned my addr 172.21.15.29:0/2969426681 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9293fff700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 0x7f929414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 -- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 msgr2=0x7f92940aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f92937fe700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 0x7f92940aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 0x7f92940aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 -- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 msgr2=0x7f929414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:19.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 0x7f929414fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:19.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 -- 172.21.15.29:0/2969426681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928400b7f0 con 0x7f9294072070 2023-10-16T19:40:19.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9293fff700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 0x7f929414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:19.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f92937fe700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 0x7f92940aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:19.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f9292ffd700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c420 tx=0x7f927c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c0052d0 con 0x7f9294072070 2023-10-16T19:40:19.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c005430 con 0x7f9294072070 2023-10-16T19:40:19.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.915+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929414b2f0 con 0x7f9294072070 2023-10-16T19:40:19.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.916+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c0038c0 con 0x7f9294072070 2023-10-16T19:40:19.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.916+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929414d4a0 con 0x7f9294072070 2023-10-16T19:40:19.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.917+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929414f6b0 con 0x7f9294072070 2023-10-16T19:40:19.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.917+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f927c003a20 con 0x7f9294072070 2023-10-16T19:40:19.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.917+0000 7f928bfff700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 0x7f927406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:19.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.918+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f927c088c30 con 0x7f9294072070 2023-10-16T19:40:19.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.918+0000 7f92937fe700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 0x7f927406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:19.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.918+0000 7f92937fe700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 0x7f927406d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb10 tx=0x7f9284014000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:19.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:19.922+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f929414f6b0 con 0x7f9294072070 2023-10-16T19:40:20.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.121+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f929414f6b0 con 0x7f9294072070 2023-10-16T19:40:20.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.122+0000 7f928bfff700 1 -- 172.21.15.29:0/2969426681 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f929414f6b0 con 0x7f9294072070 2023-10-16T19:40:20.125 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:20.125 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:20.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 msgr2=0x7f927406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 0x7f927406d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb10 tx=0x7f9284014000 comp rx=0 tx=0).stop 2023-10-16T19:40:20.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 msgr2=0x7f929414f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c420 tx=0x7f927c00c7e0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 shutdown_connections 2023-10-16T19:40:20.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f927406af00 0x7f927406d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f929414e390 0x7f929414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f929406e0d0 0x7f92940aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 --2- 172.21.15.29:0/2969426681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9294072070 0x7f929414f990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.124+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 >> 172.21.15.29:0/2969426681 conn(0x7f92940c6670 msgr2=0x7f92940c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.125+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 shutdown_connections 2023-10-16T19:40:20.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.125+0000 7f929a054700 1 -- 172.21.15.29:0/2969426681 wait complete. 2023-10-16T19:40:20.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T19:40:20.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T19:40:20.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T19:40:20.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T19:40:20.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T19:40:20.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T19:40:20.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T19:40:20.143 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T19:40:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.358+0000 7f1df8933700 1 Processor -- start 2023-10-16T19:40:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.358+0000 7f1df8933700 1 -- start start 2023-10-16T19:40:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.359+0000 7f1df8933700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 0x7f1df406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.359+0000 7f1df8933700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 0x7f1df406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.359+0000 7f1df8933700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df40c3d70 con 0x7f1df40c5660 2023-10-16T19:40:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.359+0000 7f1df8933700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df4156230 con 0x7f1df4155da0 2023-10-16T19:40:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.359+0000 7f1df8933700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4156510 con 0x7f1df40ab9a0 2023-10-16T19:40:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df259c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1df40c5660 0x7f1df40c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:59960/0 (socket says 172.21.15.29:59960) 2023-10-16T19:40:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df259c700 1 -- 172.21.15.29:0/3353739415 learned_addr learned my addr 172.21.15.29:0/3353739415 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3353739415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 0x7f1df406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df2d9d700 1 --2- 172.21.15.29:0/3353739415 >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 0x7f1df406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 -- 172.21.15.29:0/3353739415 >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 msgr2=0x7f1df406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3353739415 >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 0x7f1df406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 -- 172.21.15.29:0/3353739415 >> v1:172.21.15.53:6789/0 conn(0x7f1df40c5660 legacy=0x7f1df40c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 -- 172.21.15.29:0/3353739415 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df41567f0 con 0x7f1df40ab9a0 2023-10-16T19:40:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df2d9d700 1 --2- 172.21.15.29:0/3353739415 >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 0x7f1df406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:20.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3353739415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 0x7f1df406d7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009840 tx=0x7f1de4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff18ef5d7fda4b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7fc507f1d700 1 Processor -- start 2023-10-16T19:40:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.358+0000 7faba1bac700 1 Processor -- start 2023-10-16T19:40:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.358+0000 7faba1bac700 1 -- start start 2023-10-16T19:40:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7faba1bac700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab9c1565b0 0x7fab9c06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7faba1bac700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab9c06adc0 0x7fab9c071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7faba1bac700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c0c3710 con 0x7fab9c0c2a50 2023-10-16T19:40:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7faba1bac700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c159da0 con 0x7fab9c1565b0 2023-10-16T19:40:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7faba1bac700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c072160 con 0x7fab9c06adc0 2023-10-16T19:40:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab9c06adc0 0x7fab9c071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab9c06adc0 0x7fab9c071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41984/0 (socket says 172.21.15.29:41984) 2023-10-16T19:40:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 -- 172.21.15.29:0/3110986668 learned_addr learned my addr 172.21.15.29:0/3110986668 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 -- 172.21.15.29:0/3110986668 >> v2:172.21.15.29:3300/0 conn(0x7fab9c1565b0 msgr2=0x7fab9c06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 --2- 172.21.15.29:0/3110986668 >> v2:172.21.15.29:3300/0 conn(0x7fab9c1565b0 0x7fab9c06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 -- 172.21.15.29:0/3110986668 >> v1:172.21.15.29:6789/0 conn(0x7fab9c0c2a50 legacy=0x7fab9c071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.360+0000 7fab9bfff700 1 -- 172.21.15.29:0/3110986668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c159800 con 0x7fab9c06adc0 2023-10-16T19:40:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.361+0000 7fab9bfff700 1 --2- 172.21.15.29:0/3110986668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c071c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0ac960 tx=0x7fab9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8848c08a9f90dedf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.361+0000 7fab9a7fc700 1 -- 172.21.15.29:0/3110986668 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400e070 con 0x7fab9c06adc0 2023-10-16T19:40:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.361+0000 7fab9a7fc700 1 -- 172.21.15.29:0/3110986668 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94003a70 con 0x7fab9c06adc0 2023-10-16T19:40:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.361+0000 7fab9a7fc700 1 -- 172.21.15.29:0/3110986668 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94003e20 con 0x7fab9c06adc0 2023-10-16T19:40:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 -- 172.21.15.29:0/3110986668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 msgr2=0x7fab9c071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 --2- 172.21.15.29:0/3110986668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c071c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0ac960 tx=0x7fab9400b330 comp rx=0 tx=0).stop 2023-10-16T19:40:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 -- 172.21.15.29:0/3110986668 shutdown_connections 2023-10-16T19:40:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 --2- 172.21.15.29:0/3110986668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c071c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 --2- 172.21.15.29:0/3110986668 >> v2:172.21.15.29:3300/0 conn(0x7fab9c1565b0 0x7fab9c06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 -- 172.21.15.29:0/3110986668 >> 172.21.15.29:0/3110986668 conn(0x7fab9c0c7100 msgr2=0x7fab9c0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 -- 172.21.15.29:0/3110986668 shutdown_connections 2023-10-16T19:40:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.362+0000 7faba1bac700 1 -- 172.21.15.29:0/3110986668 wait complete. 2023-10-16T19:40:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7fc507f1d700 1 -- start start 2023-10-16T19:40:20.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7faba1bac700 1 Processor -- start 2023-10-16T19:40:20.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7f1df159a700 1 -- 172.21.15.29:0/3353739415 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4004230 con 0x7f1df40ab9a0 2023-10-16T19:40:20.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7f1df159a700 1 -- 172.21.15.29:0/3353739415 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4004390 con 0x7f1df40ab9a0 2023-10-16T19:40:20.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7f1df159a700 1 -- 172.21.15.29:0/3353739415 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40036a0 con 0x7f1df40ab9a0 2023-10-16T19:40:20.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7f1df8933700 1 -- 172.21.15.29:0/3353739415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 msgr2=0x7f1df406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7f1df8933700 1 --2- 172.21.15.29:0/3353739415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 0x7f1df406d7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009840 tx=0x7f1de4009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:20.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.364+0000 7faba1bac700 1 -- start start 2023-10-16T19:40:20.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fc507f1d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5000c3350 0x7fc50014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fc507f1d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5001555b0 0x7fc500071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fc507f1d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc500152300 con 0x7fc500071840 2023-10-16T19:40:20.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fc507f1d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5000c2e40 con 0x7fc5001555b0 2023-10-16T19:40:20.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fc507f1d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc500157f40 con 0x7fc5000c3350 2023-10-16T19:40:20.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab9c0c2a50 0x7fab9c1366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fab9c1565b0 0x7fab9c136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c137130 con 0x7fab9c0c2a50 2023-10-16T19:40:20.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1faeb0 con 0x7fab9c06adc0 2023-10-16T19:40:20.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7faba1bac700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1fb3e0 con 0x7fab9c1565b0 2023-10-16T19:40:20.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7f11f9331700 1 Processor -- start 2023-10-16T19:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 -- 172.21.15.29:0/3353739415 shutdown_connections 2023-10-16T19:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 --2- 172.21.15.29:0/3353739415 >> v2:172.21.15.53:3300/0 conn(0x7f1df4155da0 0x7f1df406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 --2- 172.21.15.29:0/3353739415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40ab9a0 0x7f1df406d7b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 -- 172.21.15.29:0/3353739415 >> 172.21.15.29:0/3353739415 conn(0x7f1df40a7c20 msgr2=0x7f1df40a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 -- 172.21.15.29:0/3353739415 shutdown_connections 2023-10-16T19:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7f1df8933700 1 -- 172.21.15.29:0/3353739415 wait complete. 2023-10-16T19:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc5064ba700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc500071840 0x7fc50006db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:59982/0 (socket says 172.21.15.29:59982) 2023-10-16T19:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc5064ba700 1 -- 172.21.15.29:0/456979166 learned_addr learned my addr 172.21.15.29:0/456979166 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc505cb9700 1 --2- 172.21.15.29:0/456979166 >> v2:172.21.15.53:3300/0 conn(0x7fc5000c3350 0x7fc50014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc5054b8700 1 --2- 172.21.15.29:0/456979166 >> v2:172.21.15.29:3300/0 conn(0x7fc5001555b0 0x7fc500071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc505cb9700 1 -- 172.21.15.29:0/456979166 >> v2:172.21.15.29:3300/0 conn(0x7fc5001555b0 msgr2=0x7fc500071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc505cb9700 1 --2- 172.21.15.29:0/456979166 >> v2:172.21.15.29:3300/0 conn(0x7fc5001555b0 0x7fc500071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc505cb9700 1 -- 172.21.15.29:0/456979166 >> v1:172.21.15.53:6789/0 conn(0x7fc500071840 legacy=0x7fc50006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc504cb7700 1 -- 172.21.15.29:0/456979166 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248238727 0 0) 0x7fc500152300 con 0x7fc500071840 2023-10-16T19:40:20.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fc505cb9700 1 -- 172.21.15.29:0/456979166 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500155a60 con 0x7fc5000c3350 2023-10-16T19:40:20.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fc505cb9700 1 --2- 172.21.15.29:0/456979166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5000c3350 0x7fc50014ec50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5000728d0 tx=0x7fc4f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd77e1ec1d4729ff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fab9b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7fab9b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c0c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:41990/0 (socket says 172.21.15.29:41990) 2023-10-16T19:40:20.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9b7fe700 1 -- 172.21.15.29:0/737107480 learned_addr learned my addr 172.21.15.29:0/737107480 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fab9c1565b0 0x7fab9c136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9affd700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab9c0c2a50 0x7fab9c1366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 -- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 msgr2=0x7fab9c0c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab9c06adc0 0x7fab9c0c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 -- 172.21.15.29:0/737107480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab9c0c2a50 msgr2=0x7fab9c1366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab9c0c2a50 0x7fab9c1366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.366+0000 7fab9bfff700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94009b30 con 0x7fab9c1565b0 2023-10-16T19:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fab9bfff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fab9c1565b0 0x7fab9c136bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab94014000 tx=0x7fab94004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.365+0000 7f11f9331700 1 -- start start 2023-10-16T19:40:20.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f9331700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f40c07f0 0x7f11f4070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f9331700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11f4070c40 0x7f11f41547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f9331700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f40c1190 con 0x7f11f40c30b0 2023-10-16T19:40:20.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f9331700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40c2000 con 0x7f11f4070c40 2023-10-16T19:40:20.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f9331700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40c4c40 con 0x7f11f40c07f0 2023-10-16T19:40:20.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fc504cb7700 1 -- 172.21.15.29:0/456979166 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800e070 con 0x7fc5000c3350 2023-10-16T19:40:20.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fc504cb7700 1 -- 172.21.15.29:0/456979166 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800bb20 con 0x7fc5000c3350 2023-10-16T19:40:20.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fc504cb7700 1 -- 172.21.15.29:0/456979166 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8012430 con 0x7fc5000c3350 2023-10-16T19:40:20.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94004240 con 0x7fab9c1565b0 2023-10-16T19:40:20.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c157090 con 0x7fab9c1565b0 2023-10-16T19:40:20.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c1fb100 con 0x7fab9c1565b0 2023-10-16T19:40:20.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.367+0000 7f11f2ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f11f40c30b0 0x7f11f40c53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37162/0 (socket says 172.21.15.29:37162) 2023-10-16T19:40:20.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2110491212 learned_addr learned my addr 172.21.15.29:0/2110491212 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940043e0 con 0x7fab9c1565b0 2023-10-16T19:40:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94004790 con 0x7fab9c1565b0 2023-10-16T19:40:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950253052 0 0) 0x7f11f40c1190 con 0x7f11f40c30b0 2023-10-16T19:40:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11dc0035b0 con 0x7f11f40c30b0 2023-10-16T19:40:20.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 -- 172.21.15.29:0/456979166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5000c3350 msgr2=0x7fc50014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 --2- 172.21.15.29:0/456979166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5000c3350 0x7fc50014ec50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5000728d0 tx=0x7fc4f800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:20.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7f1df8933700 1 Processor -- start 2023-10-16T19:40:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 -- 172.21.15.29:0/456979166 shutdown_connections 2023-10-16T19:40:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 --2- 172.21.15.29:0/456979166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5000c3350 0x7fc50014ec50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 --2- 172.21.15.29:0/456979166 >> v2:172.21.15.29:3300/0 conn(0x7fc5001555b0 0x7fc500071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7fc507f1d700 1 -- 172.21.15.29:0/456979166 >> 172.21.15.29:0/456979166 conn(0x7fc5000c7110 msgr2=0x7fc5000c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.368+0000 7f1df8933700 1 -- start start 2023-10-16T19:40:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480900229 0 0) 0x7f11dc0035b0 con 0x7f11f40c30b0 2023-10-16T19:40:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f40c07f0 msgr2=0x7f11f4070700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:20.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f40c07f0 0x7f11f4070700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab7c000fc0 con 0x7fab9c1565b0 2023-10-16T19:40:20.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 >> v2:172.21.15.53:3300/0 conn(0x7f11f4070c40 msgr2=0x7f11f41547f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:20.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 --2- 172.21.15.29:0/2110491212 >> v2:172.21.15.53:3300/0 conn(0x7f11f4070c40 0x7f11f41547f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40c4f20 con 0x7f11f40c30b0 2023-10-16T19:40:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f11e80016c0 con 0x7f11f40c30b0 2023-10-16T19:40:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 >> v1:172.21.15.29:6789/0 conn(0x7f11f40c30b0 legacy=0x7f11f40c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11dc003a00 0x7f11dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11dc004850 0x7f11dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11dc005410 0x7f11dc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40c4c40 con 0x7f11dc003a00 2023-10-16T19:40:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc00c2c0 con 0x7f11dc004850 2023-10-16T19:40:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc00c480 con 0x7f11dc005410 2023-10-16T19:40:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11dc003a00 0x7f11dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11dc005410 msgr2=0x7f11dc00ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11dc005410 0x7f11dc00ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11dc004850 msgr2=0x7f11dc004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11dc004850 0x7f11dc004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2110491212 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40c4f20 con 0x7f11dc003a00 2023-10-16T19:40:20.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df40ab9a0 0x7f1df40a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40c5660 0x7f1df41464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 0x7f1df4143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4153600 con 0x7f1df40aa5f0 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b83b0 con 0x7f1df40ab9a0 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df8933700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b77e0 con 0x7f1df40c5660 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 0x7f1df4143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 0x7f1df4143e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51724/0 (socket says 172.21.15.29:51724) 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 -- 172.21.15.29:0/3007516189 learned_addr learned my addr 172.21.15.29:0/3007516189 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40c5660 0x7f1df41464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df259c700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df40ab9a0 0x7f1df40a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 -- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40c5660 msgr2=0x7f1df41464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1df40c5660 0x7f1df41464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 -- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df40ab9a0 msgr2=0x7f1df40a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df40ab9a0 0x7f1df40a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f1df2d9d700 1 -- 172.21.15.29:0/3007516189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40094a0 con 0x7f1df40aa5f0 2023-10-16T19:40:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11dc003a00 0x7f11dc003e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11e800d3d0 tx=0x7f11dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90f41e54d254e73 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.369+0000 7fc507f1d700 1 -- 172.21.15.29:0/456979166 shutdown_connections 2023-10-16T19:40:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1df2d9d700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 0x7f1df4143e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007df0 tx=0x7f1dec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00ddd0 con 0x7f1df40aa5f0 2023-10-16T19:40:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800f400 con 0x7f11dc003a00 2023-10-16T19:40:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800f560 con 0x7f11dc003a00 2023-10-16T19:40:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7f11f1ffb700 1 -- 172.21.15.29:0/2110491212 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800f8d0 con 0x7f11dc003a00 2023-10-16T19:40:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f11f9331700 1 -- 172.21.15.29:0/2110491212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11dc003a00 msgr2=0x7f11dc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f11f9331700 1 --2- 172.21.15.29:0/2110491212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11dc003a00 0x7f11dc003e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11e800d3d0 tx=0x7f11dc005880 comp rx=0 tx=0).stop 2023-10-16T19:40:20.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.370+0000 7fc507f1d700 1 -- 172.21.15.29:0/456979166 wait complete. 2023-10-16T19:40:20.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40a5c10 con 0x7f1df40aa5f0 2023-10-16T19:40:20.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec00f040 con 0x7f1df40aa5f0 2023-10-16T19:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec003c40 con 0x7f1df40aa5f0 2023-10-16T19:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.371+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df40b7d60 con 0x7f1df40aa5f0 2023-10-16T19:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.372+0000 7fc507f1d700 1 Processor -- start 2023-10-16T19:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.372+0000 7f11f37fe700 1 -- 172.21.15.29:0/2110491212 reap_dead start 2023-10-16T19:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7f11f9331700 1 -- 172.21.15.29:0/2110491212 shutdown_connections 2023-10-16T19:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7f11f9331700 1 -- 172.21.15.29:0/2110491212 >> 172.21.15.29:0/2110491212 conn(0x7f11f40a7c20 msgr2=0x7f11f40a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1dec004030 con 0x7f1df40aa5f0 2023-10-16T19:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab94019070 con 0x7fab9c1565b0 2023-10-16T19:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fab83fff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fab8806af30 0x7fab8806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7ff3b171a700 1 Processor -- start 2023-10-16T19:40:20.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab9408a510 con 0x7fab9c1565b0 2023-10-16T19:40:20.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fab83fff700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7fab88074570 0x7fab880769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab88077080 con 0x7fab88074570 2023-10-16T19:40:20.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab9408cb30 con 0x7fab9c1565b0 2023-10-16T19:40:20.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.372+0000 7fc507f1d700 1 -- start start 2023-10-16T19:40:20.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 0x7fc50014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5000c3350 0x7fc500135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5001555b0 0x7fc5001363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001603e0 con 0x7fc5000c3350 2023-10-16T19:40:20.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500160520 con 0x7fc500071840 2023-10-16T19:40:20.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7fc507f1d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc500160690 con 0x7fc5001555b0 2023-10-16T19:40:20.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 0x7fc50014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 0x7fc50014d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42014/0 (socket says 172.21.15.29:42014) 2023-10-16T19:40:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 -- 172.21.15.29:0/346603162 learned_addr learned my addr 172.21.15.29:0/346603162 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc5064ba700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5001555b0 0x7fc5001363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc5054b8700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5000c3350 0x7fc500135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fab9b7fe700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fab8806af30 0x7fab8806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f6169644700 1 Processor -- start 2023-10-16T19:40:20.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f6169644700 1 -- start start 2023-10-16T19:40:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 -- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5001555b0 msgr2=0x7fc5001363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5001555b0 0x7fc5001363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 -- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5000c3350 msgr2=0x7fc500135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5000c3350 0x7fc500135ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc505cb9700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f8009a70 con 0x7fc500071840 2023-10-16T19:40:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7fc5054b8700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5000c3350 0x7fc500135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f11f9331700 1 -- 172.21.15.29:0/2110491212 shutdown_connections 2023-10-16T19:40:20.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f11f9331700 1 -- 172.21.15.29:0/2110491212 wait complete. 2023-10-16T19:40:20.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f1de2ffd700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1dd406af00 0x7f1dd406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dec089820 con 0x7f1df40aa5f0 2023-10-16T19:40:20.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7f1df259c700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1dd406af00 0x7f1dd406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc505cb9700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 0x7fc50014d110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5000c3980 tx=0x7fc4f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fab9b7fe700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fab8806af30 0x7fab8806d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab90009ad0 tx=0x7fab90009290 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.373+0000 7ff3b171a700 1 -- start start 2023-10-16T19:40:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7ff3b171a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3ac0c30b0 0x7ff3ac0c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.374+0000 7ff3b171a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3ac0c07f0 0x7ff3ac070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3b171a700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0c1190 con 0x7ff3ac070c40 2023-10-16T19:40:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3b171a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0c2000 con 0x7ff3ac0c07f0 2023-10-16T19:40:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3b171a700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0c4c40 con 0x7ff3ac0c30b0 2023-10-16T19:40:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3aaffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3ac0c30b0 0x7ff3ac0c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fab9affd700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7fab88074570 0x7fab880769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f1df259c700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1dd406af00 0x7f1dd406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1df40b9050 tx=0x7f1de8004aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8004800 con 0x7fc500071840 2023-10-16T19:40:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8020070 con 0x7fc500071840 2023-10-16T19:40:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80276c0 con 0x7fc500071840 2023-10-16T19:40:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc500160850 con 0x7fc500071840 2023-10-16T19:40:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc500160d10 con 0x7fc500071840 2023-10-16T19:40:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3ab7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff3ac070c40 0x7ff3ac06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:60012/0 (socket says 172.21.15.29:60012) 2023-10-16T19:40:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7ff3ab7fe700 1 -- 172.21.15.29:0/2744465547 learned_addr learned my addr 172.21.15.29:0/2744465547 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f1df8933700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f1df4155da0 0x7f1df4144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 --> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1df40b8560 con 0x7f1df4155da0 2023-10-16T19:40:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7fab9affd700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7fab88074570 0x7fab880769b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7ff3aa7fc700 1 --2- 172.21.15.29:0/2744465547 >> v2:172.21.15.29:3300/0 conn(0x7ff3ac0c07f0 0x7ff3ac070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f6169644700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 0x7f61640c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f6169644700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f616408a9c0 0x7f61641655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f6169644700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640c0f00 con 0x7f61640c1200 2023-10-16T19:40:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f6169644700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640c48b0 con 0x7f616408a9c0 2023-10-16T19:40:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f6169644700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640a5280 con 0x7f616406e060 2023-10-16T19:40:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f615bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 0x7f61640c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f615bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 0x7f61640c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42034/0 (socket says 172.21.15.29:42034) 2023-10-16T19:40:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f615bfff700 1 -- 172.21.15.29:0/826778893 learned_addr learned my addr 172.21.15.29:0/826778893 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.375+0000 7f61637fe700 1 --2- 172.21.15.29:0/826778893 >> v2:172.21.15.29:3300/0 conn(0x7f616408a9c0 0x7f61641655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f61637fe700 1 -- 172.21.15.29:0/826778893 >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 msgr2=0x7f61640c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f61637fe700 1 --2- 172.21.15.29:0/826778893 >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 0x7f61640c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f61637fe700 1 -- 172.21.15.29:0/826778893 >> v1:172.21.15.53:6789/0 conn(0x7f61640c1200 legacy=0x7f61640c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614885519 0 0) 0x7ff3ac0c1190 con 0x7ff3ac070c40 2023-10-16T19:40:20.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3940035b0 con 0x7ff3ac070c40 2023-10-16T19:40:20.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f11f9331700 1 Processor -- start 2023-10-16T19:40:20.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f1df4155da0 0x7f1df4144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7f11f9331700 1 -- start start 2023-10-16T19:40:20.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== osd.4 v2:172.21.15.53:6816/4281980506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fab88077080 con 0x7fab88074570 2023-10-16T19:40:20.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.376+0000 7f61637fe700 1 -- 172.21.15.29:0/826778893 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640c5650 con 0x7f616408a9c0 2023-10-16T19:40:20.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7f61637fe700 1 --2- 172.21.15.29:0/826778893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616408a9c0 0x7f61641655a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f61640ac000 tx=0x7f615c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f95949c8c514f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681113359 0 0) 0x7ff3940035b0 con 0x7ff3ac070c40 2023-10-16T19:40:20.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 >> v2:172.21.15.53:3300/0 conn(0x7ff3ac0c30b0 msgr2=0x7ff3ac0c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 --2- 172.21.15.29:0/2744465547 >> v2:172.21.15.53:3300/0 conn(0x7ff3ac0c30b0 0x7ff3ac0c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 >> v2:172.21.15.29:3300/0 conn(0x7ff3ac0c07f0 msgr2=0x7ff3ac070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 --2- 172.21.15.29:0/2744465547 >> v2:172.21.15.29:3300/0 conn(0x7ff3ac0c07f0 0x7ff3ac070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0c4f20 con 0x7ff3ac070c40 2023-10-16T19:40:20.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.1 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7ff3a40019f0 con 0x7ff3ac070c40 2023-10-16T19:40:20.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 >> v1:172.21.15.53:6789/0 conn(0x7ff3ac070c40 legacy=0x7ff3ac06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 0x7ff394003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff394004850 0x7ff394004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394005210 0x7ff39400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0c4c40 con 0x7ff394005210 2023-10-16T19:40:20.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39400c110 con 0x7ff394004850 2023-10-16T19:40:20.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39400c2d0 con 0x7ff394003a00 2023-10-16T19:40:20.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5001519d0 con 0x7fc500071840 2023-10-16T19:40:20.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 0x7ff394003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7ff3ab7fe700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394005210 0x7ff39400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 0x7f11f41e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f40a8290 0x7f11f40bc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f41fa080 0x7f11f40a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b9c30 con 0x7f11f41f9ca0 2023-10-16T19:40:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40aa880 con 0x7f11f40a8290 2023-10-16T19:40:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f11f9331700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41fa650 con 0x7f11f41fa080 2023-10-16T19:40:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3aaffd700 1 -- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff394004850 msgr2=0x7ff394004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff394004850 0x7ff394004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3aaffd700 1 -- 172.21.15.29:0/2744465547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394005210 msgr2=0x7ff39400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394005210 0x7ff39400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3aaffd700 1 -- 172.21.15.29:0/2744465547 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0c4f20 con 0x7ff394003a00 2023-10-16T19:40:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fce8a219700 1 Processor -- start 2023-10-16T19:40:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7f1df1d9b700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f1df4155da0 0x7f1df4144340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fce8a219700 1 -- start start 2023-10-16T19:40:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.377+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4f8012430 con 0x7fc500071840 2023-10-16T19:40:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fc4f67fc700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4e406af50 0x7fc4e406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4f8022070 con 0x7fc500071840 2023-10-16T19:40:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fc5054b8700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4e406af50 0x7fc4e406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fc4f67fc700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7fc4e4074590 0x7fc4e40769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4e40770a0 con 0x7fc4e4074590 2023-10-16T19:40:20.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.378+0000 7ff3ab7fe700 1 -- 172.21.15.29:0/2744465547 reap_dead start 2023-10-16T19:40:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f808dc60 con 0x7fc500071840 2023-10-16T19:40:20.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 0x7ff394003e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0095e0 tx=0x7ff394005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389bc1f911493a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c00c070 con 0x7ff394003a00 2023-10-16T19:40:20.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c005c20 con 0x7ff394003a00 2023-10-16T19:40:20.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7ff3a9ffb700 1 -- 172.21.15.29:0/2744465547 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c013710 con 0x7ff394003a00 2023-10-16T19:40:20.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fc5054b8700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4e406af50 0x7fc4e406d410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc5000ac670 tx=0x7fc4f0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== osd.0 v2:172.21.15.29:6800/1770422682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1df40b8560 con 0x7f1df4155da0 2023-10-16T19:40:20.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fce8a219700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce84152930 0x7fce840a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fce8a219700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840a6dc0 con 0x7fce8406f4c0 2023-10-16T19:40:20.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fce8a219700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840701d0 con 0x7fce840c7860 2023-10-16T19:40:20.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fce8a219700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840a75e0 con 0x7fce84152930 2023-10-16T19:40:20.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.379+0000 7fce837fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce840c7860 0x7fce840c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:60036/0 (socket says 172.21.15.29:60036) 2023-10-16T19:40:20.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce837fe700 1 -- 172.21.15.29:0/1661606427 learned_addr learned my addr 172.21.15.29:0/1661606427 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7ff3b171a700 1 -- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 msgr2=0x7ff394003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7ff3b171a700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 0x7ff394003e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0095e0 tx=0x7ff394005880 comp rx=0 tx=0).stop 2023-10-16T19:40:20.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce82ffd700 1 --2- 172.21.15.29:0/1661606427 >> v2:172.21.15.53:3300/0 conn(0x7fce84152930 0x7fce840a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7ff3b171a700 1 -- 172.21.15.29:0/2744465547 shutdown_connections 2023-10-16T19:40:20.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7ff3b171a700 1 --2- 172.21.15.29:0/2744465547 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff394003a00 0x7ff394003e20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7ff3b171a700 1 -- 172.21.15.29:0/2744465547 >> 172.21.15.29:0/2744465547 conn(0x7ff3ac0a7c20 msgr2=0x7ff3ac0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830867275 0 0) 0x7fce840701d0 con 0x7fce840c7860 2023-10-16T19:40:20.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c0035b0 con 0x7fce840c7860 2023-10-16T19:40:20.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904283671 0 0) 0x7fce840a6dc0 con 0x7fce8406f4c0 2023-10-16T19:40:20.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce840701d0 con 0x7fce8406f4c0 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce82ffd700 1 -- 172.21.15.29:0/1661606427 >> v1:172.21.15.53:6789/0 conn(0x7fce840c7860 legacy=0x7fce840c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce82ffd700 1 -- 172.21.15.29:0/1661606427 >> v1:172.21.15.29:6789/0 conn(0x7fce8406f4c0 legacy=0x7fce84156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce82ffd700 1 -- 172.21.15.29:0/1661606427 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840704b0 con 0x7fce84152930 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce82ffd700 1 --2- 172.21.15.29:0/1661606427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84152930 0x7fce840a70a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce74009870 tx=0x7fce74009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b1b94bed318d4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.380+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011830 con 0x7fce84152930 2023-10-16T19:40:20.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74011990 con 0x7fce84152930 2023-10-16T19:40:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7fce827fc700 1 -- 172.21.15.29:0/1661606427 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011d20 con 0x7fce84152930 2023-10-16T19:40:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7ff3b171a700 1 -- 172.21.15.29:0/2744465547 shutdown_connections 2023-10-16T19:40:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7fce8a219700 1 -- 172.21.15.29:0/1661606427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84152930 msgr2=0x7fce840a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7fce8a219700 1 --2- 172.21.15.29:0/1661606427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84152930 0x7fce840a70a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce74009870 tx=0x7fce74009b80 comp rx=0 tx=0).stop 2023-10-16T19:40:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.381+0000 7ff3b171a700 1 -- 172.21.15.29:0/2744465547 wait complete. 2023-10-16T19:40:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.382+0000 7fce8a219700 1 -- 172.21.15.29:0/1661606427 shutdown_connections 2023-10-16T19:40:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.382+0000 7fce8a219700 1 --2- 172.21.15.29:0/1661606427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84152930 0x7fce840a70a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.382+0000 7fce8a219700 1 -- 172.21.15.29:0/1661606427 >> 172.21.15.29:0/1661606427 conn(0x7fce8406ac70 msgr2=0x7fce8406b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.382+0000 7fce8a219700 1 -- 172.21.15.29:0/1661606427 shutdown_connections 2023-10-16T19:40:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.382+0000 7fce8a219700 1 -- 172.21.15.29:0/1661606427 wait complete. 2023-10-16T19:40:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.383+0000 7fce8a219700 1 Processor -- start 2023-10-16T19:40:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7ff3b171a700 1 Processor -- start 2023-10-16T19:40:20.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7f61627fc700 1 -- 172.21.15.29:0/826778893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00e070 con 0x7f616408a9c0 2023-10-16T19:40:20.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7fce8a219700 1 -- start start 2023-10-16T19:40:20.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 0x7f11f41e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 0x7f11f41e96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51760/0 (socket says 172.21.15.29:51760) 2023-10-16T19:40:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2732089673 learned_addr learned my addr 172.21.15.29:0/2732089673 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f37fe700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f41fa080 0x7f11f40a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f27fc700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f40a8290 0x7f11f40bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f41fa080 msgr2=0x7f11f40a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f41fa080 0x7f11f40a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f40a8290 msgr2=0x7f11f40bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f40a8290 0x7f11f40bc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f11f2ffd700 1 -- 172.21.15.29:0/2732089673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40b96d0 con 0x7f11f41f9ca0 2023-10-16T19:40:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f11f37fe700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11f41fa080 0x7f11f40a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7f61627fc700 1 -- 172.21.15.29:0/826778893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00bbd0 con 0x7f616408a9c0 2023-10-16T19:40:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7f61627fc700 1 -- 172.21.15.29:0/826778893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c012430 con 0x7f616408a9c0 2023-10-16T19:40:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f6169644700 1 -- 172.21.15.29:0/826778893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616408a9c0 msgr2=0x7f61641655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7f6169644700 1 --2- 172.21.15.29:0/826778893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616408a9c0 0x7f61641655a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f61640ac000 tx=0x7f615c00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:20.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.384+0000 7ff3b171a700 1 -- start start 2023-10-16T19:40:20.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394003a00 0x7ff3ac071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3ac0bbac0 0x7ff3ac0bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac0a2240 0x7ff3ac0a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac1ee700 con 0x7ff394003a00 2023-10-16T19:40:20.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0bc480 con 0x7ff3ac0a2240 2023-10-16T19:40:20.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3b171a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0bffb0 con 0x7ff3ac0bbac0 2023-10-16T19:40:20.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3aa7fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3ac0bbac0 0x7ff3ac0bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3aa7fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3ac0bbac0 0x7ff3ac0bbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44234/0 (socket says 172.21.15.29:44234) 2023-10-16T19:40:20.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3aa7fc700 1 -- 172.21.15.29:0/1202640832 learned_addr learned my addr 172.21.15.29:0/1202640832 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3ab7fe700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac0a2240 0x7ff3ac0a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394003a00 0x7ff3ac071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 -- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3ac0bbac0 msgr2=0x7ff3ac0bbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3ac0bbac0 0x7ff3ac0bbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 -- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac0a2240 msgr2=0x7ff3ac0a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac0a2240 0x7ff3ac0a26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac1edaf0 con 0x7ff394003a00 2023-10-16T19:40:20.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7ff3aaffd700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394003a00 0x7ff3ac071a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff39c01b000 tx=0x7ff39c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce8406f4c0 0x7fce840baa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 0x7fce840baf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84150110 0x7fce841e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840a8450 con 0x7fce840c7860 2023-10-16T19:40:20.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8406c480 con 0x7fce84150110 2023-10-16T19:40:20.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce8a219700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8406c760 con 0x7fce8406f4c0 2023-10-16T19:40:20.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 0x7fce840baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce82ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 0x7fce840baf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51782/0 (socket says 172.21.15.29:51782) 2023-10-16T19:40:20.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce82ffd700 1 -- 172.21.15.29:0/2889301172 learned_addr learned my addr 172.21.15.29:0/2889301172 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fce837fe700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce8406f4c0 0x7fce840baa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 -- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce8406f4c0 msgr2=0x7fce840baa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce8406f4c0 0x7fce840baa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 -- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84150110 msgr2=0x7fce841e6d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:20.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84150110 0x7fce841e6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 -- 172.21.15.29:0/2889301172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740094a0 con 0x7fce840c7860 2023-10-16T19:40:20.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f11f2ffd700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 0x7f11f41e96c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11e800d9c0 tx=0x7f11e8001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 -- 172.21.15.29:0/826778893 shutdown_connections 2023-10-16T19:40:20.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 --2- 172.21.15.29:0/826778893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616408a9c0 0x7f61641655a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 --2- 172.21.15.29:0/826778893 >> v2:172.21.15.53:3300/0 conn(0x7f616406e060 0x7f61640c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 -- 172.21.15.29:0/826778893 >> 172.21.15.29:0/826778893 conn(0x7f61640a7c20 msgr2=0x7f61640a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 -- 172.21.15.29:0/826778893 shutdown_connections 2023-10-16T19:40:20.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fce82ffd700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 0x7fce840baf70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce74000c00 tx=0x7fce74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7f6169644700 1 -- 172.21.15.29:0/826778893 wait complete. 2023-10-16T19:40:20.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8001480 con 0x7f11f41f9ca0 2023-10-16T19:40:20.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80015e0 con 0x7f11f41f9ca0 2023-10-16T19:40:20.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8018690 con 0x7f11f41f9ca0 2023-10-16T19:40:20.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40aaab0 con 0x7f11f41f9ca0 2023-10-16T19:40:20.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f40b9950 con 0x7f11f41f9ca0 2023-10-16T19:40:20.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.385+0000 7fd9a89cb700 1 Processor -- start 2023-10-16T19:40:20.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.386+0000 7fd9a89cb700 1 -- start start 2023-10-16T19:40:20.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a89cb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd9a40726d0 0x7fd9a40c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a89cb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd9a406d790 0x7fd9a4071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a89cb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40c2a50 con 0x7fd9a40c3420 2023-10-16T19:40:20.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a89cb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a4071690 con 0x7fd9a40726d0 2023-10-16T19:40:20.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a89cb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a40c1e40 con 0x7fd9a406d790 2023-10-16T19:40:20.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a1d9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd9a40c3420 0x7fd9a40a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:60058/0 (socket says 172.21.15.29:60058) 2023-10-16T19:40:20.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.387+0000 7fd9a1d9b700 1 -- 172.21.15.29:0/1028072474 learned_addr learned my addr 172.21.15.29:0/1028072474 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7fc5064ba700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7fc4e4074590 0x7fc4e40769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7fd9a2d9d700 1 --2- 172.21.15.29:0/1028072474 >> v2:172.21.15.53:3300/0 conn(0x7fd9a406d790 0x7fd9a4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7fd9a259c700 1 --2- 172.21.15.29:0/1028072474 >> v2:172.21.15.29:3300/0 conn(0x7fd9a40726d0 0x7fd9a40c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7fc5064ba700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7fc4e4074590 0x7fc4e40769d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7f6169644700 1 Processor -- start 2023-10-16T19:40:20.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7f6169644700 1 -- start start 2023-10-16T19:40:20.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 0x7f61640a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616408a9c0 0x7f61640b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61640c1200 0x7f61640b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640bcbd0 con 0x7f616406e060 2023-10-16T19:40:20.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640bc0c0 con 0x7f616408a9c0 2023-10-16T19:40:20.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f6169644700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b8af0 con 0x7f61640c1200 2023-10-16T19:40:20.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 0x7f61640a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f615bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616408a9c0 0x7f61640b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 0x7f61640a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51794/0 (socket says 172.21.15.29:51794) 2023-10-16T19:40:20.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 -- 172.21.15.29:0/634980796 learned_addr learned my addr 172.21.15.29:0/634980796 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0132e0 con 0x7ff394003a00 2023-10-16T19:40:20.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 -- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61640c1200 msgr2=0x7f61640b7500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f61640c1200 0x7f61640b7500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 -- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616408a9c0 msgr2=0x7f61640b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616408a9c0 0x7f61640b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7fd9a259c700 1 -- 172.21.15.29:0/1028072474 >> v2:172.21.15.53:3300/0 conn(0x7fd9a406d790 msgr2=0x7fd9a4071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f6162ffd700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009a70 con 0x7f616406e060 2023-10-16T19:40:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7fd9a259c700 1 --2- 172.21.15.29:0/1028072474 >> v2:172.21.15.53:3300/0 conn(0x7fd9a406d790 0x7fd9a4071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7fd9a259c700 1 -- 172.21.15.29:0/1028072474 >> v1:172.21.15.53:6789/0 conn(0x7fd9a40c3420 legacy=0x7fd9a40a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c020070 con 0x7ff394003a00 2023-10-16T19:40:20.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c01c6b0 con 0x7ff394003a00 2023-10-16T19:40:20.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac1eddd0 con 0x7ff394003a00 2023-10-16T19:40:20.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.388+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac1ee390 con 0x7ff394003a00 2023-10-16T19:40:20.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff38c000fc0 con 0x7ff394003a00 2023-10-16T19:40:20.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7fd9a259c700 1 -- 172.21.15.29:0/1028072474 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40c2120 con 0x7fd9a40726d0 2023-10-16T19:40:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7fd9a259c700 1 --2- 172.21.15.29:0/1028072474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a40726d0 0x7fd9a40c2ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9a406e160 tx=0x7fd994009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e6128537ff1b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff39c022030 con 0x7ff394003a00 2023-10-16T19:40:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f6162ffd700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 0x7f61640a6610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f615400c500 tx=0x7f615400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540052d0 con 0x7f616406e060 2023-10-16T19:40:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154005430 con 0x7f616406e060 2023-10-16T19:40:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7ff3937fe700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff39806af50 0x7ff39806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540038c0 con 0x7f616406e060 2023-10-16T19:40:20.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61640b8f80 con 0x7f616406e060 2023-10-16T19:40:20.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640bc610 con 0x7f616406e060 2023-10-16T19:40:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff39c08a290 con 0x7ff394003a00 2023-10-16T19:40:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7ff3937fe700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7ff398074590 0x7ff3980769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3980770a0 con 0x7ff398074590 2023-10-16T19:40:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff39c08c9a0 con 0x7ff394003a00 2023-10-16T19:40:20.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7fd9a159a700 1 -- 172.21.15.29:0/1028072474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994005e30 con 0x7fd9a40726d0 2023-10-16T19:40:20.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7fd9a159a700 1 -- 172.21.15.29:0/1028072474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994006030 con 0x7fd9a40726d0 2023-10-16T19:40:20.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7fd9a159a700 1 -- 172.21.15.29:0/1028072474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940063c0 con 0x7fd9a40726d0 2023-10-16T19:40:20.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.392+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61640c5c10 con 0x7f616406e060 2023-10-16T19:40:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.392+0000 7fd9a89cb700 1 -- 172.21.15.29:0/1028072474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a40726d0 msgr2=0x7fd9a40c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.392+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/1028072474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a40726d0 0x7fd9a40c2ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9a406e160 tx=0x7fd994009b00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.392+0000 7ff3ab7fe700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7ff398074590 0x7ff3980769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.389+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11e800a030 con 0x7f11f41f9ca0 2023-10-16T19:40:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f11db7fe700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f11e006af80 0x7f11e006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11e808b3a0 con 0x7f11f41f9ca0 2023-10-16T19:40:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.390+0000 7f11f27fc700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f11e006af80 0x7f11e006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f11f9331700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f11f40a9070 0x7f11f40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 --> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11f40a5720 con 0x7f11f40a9070 2023-10-16T19:40:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f11f37fe700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f11f40a9070 0x7f11f40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f11f27fc700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f11e006af80 0x7f11e006d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11f40a4ce0 tx=0x7f11e40090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.391+0000 7f11f37fe700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f11f40a9070 0x7f11f40a9450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.392+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== osd.1 v2:172.21.15.29:6816/902088959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f11ec00c6e0 con 0x7f11f40a9070 2023-10-16T19:40:20.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fd9a89cb700 1 -- 172.21.15.29:0/1028072474 shutdown_connections 2023-10-16T19:40:20.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/1028072474 >> v2:172.21.15.53:3300/0 conn(0x7fd9a406d790 0x7fd9a4071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/1028072474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a40726d0 0x7fd9a40c2ee0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fd9a89cb700 1 -- 172.21.15.29:0/1028072474 >> 172.21.15.29:0/1028072474 conn(0x7fd9a40a7c20 msgr2=0x7fd9a40a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7401a9f0 con 0x7fce840c7860 2023-10-16T19:40:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7ff3ab7fe700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7ff398074590 0x7ff3980769d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7401ab50 con 0x7fce840c7860 2023-10-16T19:40:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8406cd90 con 0x7fce840c7860 2023-10-16T19:40:20.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8406ca40 con 0x7fce840c7860 2023-10-16T19:40:20.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.394+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== osd.5 v2:172.21.15.53:6800/1208523159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff3980770a0 con 0x7ff398074590 2023-10-16T19:40:20.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.393+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740223f0 con 0x7fce840c7860 2023-10-16T19:40:20.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.394+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6154003a20 con 0x7f616406e060 2023-10-16T19:40:20.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f615b7fe700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f614406af00 0x7f614406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6154089050 con 0x7f616406e060 2023-10-16T19:40:20.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== osd.3 v2:172.21.15.29:6819/1600164100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc4e40770a0 con 0x7fc4e4074590 2023-10-16T19:40:20.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f615b7fe700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7f61440744c0 0x7f6144076900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6144076fd0 con 0x7f61440744c0 2023-10-16T19:40:20.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61540894a0 con 0x7f616406e060 2023-10-16T19:40:20.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7f61637fe700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7f61440744c0 0x7f6144076900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.395+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce7402b3b0 con 0x7fce840c7860 2023-10-16T19:40:20.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.396+0000 7fce6bfff700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fce7006af50 0x7fce7006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.396+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce7408a650 con 0x7fce840c7860 2023-10-16T19:40:20.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.396+0000 7fce837fe700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fce7006af50 0x7fce7006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.397+0000 7fd9a89cb700 1 -- 172.21.15.29:0/1028072474 shutdown_connections 2023-10-16T19:40:20.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.396+0000 7f61637fe700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7f61440744c0 0x7f6144076900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.397+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== osd.2 v2:172.21.15.29:6808/365921754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6144076fd0 con 0x7f61440744c0 2023-10-16T19:40:20.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.399+0000 7f615bfff700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f614406af00 0x7f614406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.397+0000 7fd9a89cb700 1 -- 172.21.15.29:0/1028072474 wait complete. 2023-10-16T19:40:20.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.399+0000 7fd9a89cb700 1 Processor -- start 2023-10-16T19:40:20.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.399+0000 7fd9a89cb700 1 -- start start 2023-10-16T19:40:20.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 0x7fd9a40b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9a40726d0 0x7fd9a41455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9a40c3420 0x7fd9a4145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40b8d60 con 0x7fd9a406d790 2023-10-16T19:40:20.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40bd7a0 con 0x7fd9a40726d0 2023-10-16T19:40:20.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a89cb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41492a0 con 0x7fd9a40c3420 2023-10-16T19:40:20.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 0x7fd9a40b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 0x7fd9a40b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51814/0 (socket says 172.21.15.29:51814) 2023-10-16T19:40:20.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.400+0000 7fd9a259c700 1 -- 172.21.15.29:0/3231537248 learned_addr learned my addr 172.21.15.29:0/3231537248 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fce837fe700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fce7006af50 0x7fce7006d410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce78000f60 tx=0x7fce78007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 -- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9a40c3420 msgr2=0x7fd9a4145af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a2d9d700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9a40c3420 0x7fd9a4145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd9a40c3420 0x7fd9a4145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 -- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9a40726d0 msgr2=0x7fd9a41455b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:40:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9a40726d0 0x7fd9a41455b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994009430 con 0x7fd9a406d790 2023-10-16T19:40:20.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.401+0000 7fd9a259c700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 0x7fd9a40b8650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd994004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.402+0000 7f615bfff700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f614406af00 0x7f614406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61640c0b40 tx=0x7f614c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.397+0000 7ff3aa7fc700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff39806af50 0x7ff39806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.404+0000 7ff3aa7fc700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff39806af50 0x7ff39806d410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0a69e0 tx=0x7ff3a0008200 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.406+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940068f0 con 0x7fd9a406d790 2023-10-16T19:40:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.406+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994020070 con 0x7fd9a406d790 2023-10-16T19:40:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.406+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994025670 con 0x7fd9a406d790 2023-10-16T19:40:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.407+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a414ed80 con 0x7fd9a406d790 2023-10-16T19:40:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.407+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a41461d0 con 0x7fd9a406d790 2023-10-16T19:40:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.408+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd988000fc0 con 0x7fd9a406d790 2023-10-16T19:40:20.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.408+0000 7fce8a219700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fce640015e0 0x7fce64003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.408+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 --> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce64006bd0 con 0x7fce640015e0 2023-10-16T19:40:20.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.409+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 --> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab7c002d40 con 0x7fab88074570 2023-10-16T19:40:20.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.409+0000 7fce83fff700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fce640015e0 0x7fce64003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.409+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd994022030 con 0x7fd9a406d790 2023-10-16T19:40:20.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fce83fff700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fce640015e0 0x7fce64003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd992ffd700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd98c06b0b0 0x7fd98c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd99408aef0 con 0x7fd9a406d790 2023-10-16T19:40:20.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd9a1d9b700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd98c06b0b0 0x7fd98c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.409+0000 7fab83fff700 1 -- 172.21.15.29:0/737107480 <== osd.4 v2:172.21.15.53:6816/4281980506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab7c002d40 con 0x7fab88074570 2023-10-16T19:40:20.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd992ffd700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7fd98c0746f0 0x7fd98c076b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd98c077200 con 0x7fd98c0746f0 2023-10-16T19:40:20.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd99408d4d0 con 0x7fd9a406d790 2023-10-16T19:40:20.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fd9a2d9d700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7fd98c0746f0 0x7fd98c076b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.410+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== osd.6 v2:172.21.15.53:6808/196702031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fce64006bd0 con 0x7fce640015e0 2023-10-16T19:40:20.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7fd9a1d9b700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd98c06b0b0 0x7fd98c06d570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40be050 tx=0x7fd998007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7fd9a2d9d700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7fd98c0746f0 0x7fd98c076b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7fab88074570 msgr2=0x7fab880769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7fab88074570 0x7fab880769b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fab8806af30 msgr2=0x7fab8806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fab8806af30 0x7fab8806d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab90009ad0 tx=0x7fab90009290 comp rx=0 tx=0).stop 2023-10-16T19:40:20.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fab9c1565b0 msgr2=0x7fab9c136bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.411+0000 7faba1bac700 1 --2- 172.21.15.29:0/737107480 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fab9c1565b0 0x7fab9c136bf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab94014000 tx=0x7fab94004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:20.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.412+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== osd.7 v2:172.21.15.53:6824/2487489897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd98c077200 con 0x7fd98c0746f0 2023-10-16T19:40:20.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.413+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 --> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1df404f400 con 0x7f1df4155da0 2023-10-16T19:40:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.413+0000 7fab9bfff700 1 -- 172.21.15.29:0/737107480 reap_dead start 2023-10-16T19:40:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.413+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 shutdown_connections 2023-10-16T19:40:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.413+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 >> 172.21.15.29:0/737107480 conn(0x7fab9c0c7100 msgr2=0x7fab9c1543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.414+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 shutdown_connections 2023-10-16T19:40:20.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.414+0000 7faba1bac700 1 -- 172.21.15.29:0/737107480 wait complete. 2023-10-16T19:40:20.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.414+0000 7f1de2ffd700 1 -- 172.21.15.29:0/3007516189 <== osd.0 v2:172.21.15.29:6800/1770422682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1df404f400 con 0x7f1df4155da0 2023-10-16T19:40:20.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.414+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f1df4155da0 msgr2=0x7f1df4144340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.414+0000 7f1df8933700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f1df4155da0 0x7f1df4144340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.415+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1dd406af00 msgr2=0x7f1dd406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.415+0000 7f1df8933700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1dd406af00 0x7f1dd406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1df40b9050 tx=0x7f1de8004aa0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.415+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 msgr2=0x7f1df4143e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.415+0000 7f1df8933700 1 --2- 172.21.15.29:0/3007516189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df40aa5f0 0x7f1df4143e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007df0 tx=0x7f1dec00d3b0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.415+0000 7f1df2d9d700 1 -- 172.21.15.29:0/3007516189 reap_dead start 2023-10-16T19:40:20.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 --> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11f41fa790 con 0x7f11f40a9070 2023-10-16T19:40:20.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f11db7fe700 1 -- 172.21.15.29:0/2732089673 <== osd.1 v2:172.21.15.29:6816/902088959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11ec00c850 con 0x7f11f40a9070 2023-10-16T19:40:20.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f11f40a9070 msgr2=0x7f11f40a9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f11f40a9070 0x7f11f40a9450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f11e006af80 msgr2=0x7f11e006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f11e006af80 0x7f11e006d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11f40a4ce0 tx=0x7f11e40090e0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 msgr2=0x7f11f41e96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 --2- 172.21.15.29:0/2732089673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11f41f9ca0 0x7f11f41e96c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11e800d9c0 tx=0x7f11e8001980 comp rx=0 tx=0).stop 2023-10-16T19:40:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f37fe700 1 -- 172.21.15.29:0/2732089673 reap_dead start 2023-10-16T19:40:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 shutdown_connections 2023-10-16T19:40:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.417+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 >> 172.21.15.29:0/2732089673 conn(0x7f11f40a7c20 msgr2=0x7f11f40711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.418+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 shutdown_connections 2023-10-16T19:40:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.418+0000 7f11f9331700 1 -- 172.21.15.29:0/2732089673 wait complete. 2023-10-16T19:40:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 shutdown_connections 2023-10-16T19:40:20.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 >> 172.21.15.29:0/3007516189 conn(0x7f1df40a7c20 msgr2=0x7f1df40717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 shutdown_connections 2023-10-16T19:40:20.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.416+0000 7f1df8933700 1 -- 172.21.15.29:0/3007516189 wait complete. 2023-10-16T19:40:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.419+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 --> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5001516f0 con 0x7fc4e4074590 2023-10-16T19:40:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.423+0000 7fc4f67fc700 1 -- 172.21.15.29:0/346603162 <== osd.3 v2:172.21.15.29:6819/1600164100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4fc004c00 con 0x7fc4e4074590 2023-10-16T19:40:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.429+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 --> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff38c002d40 con 0x7ff398074590 2023-10-16T19:40:20.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.429+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 --> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61640c5930 con 0x7f61440744c0 2023-10-16T19:40:20.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.429+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7fc4e4074590 msgr2=0x7fc4e40769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.429+0000 7fc507f1d700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7fc4e4074590 0x7fc4e40769d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.430+0000 7ff3937fe700 1 -- 172.21.15.29:0/1202640832 <== osd.5 v2:172.21.15.53:6800/1208523159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff38c002d40 con 0x7ff398074590 2023-10-16T19:40:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7ff398074590 msgr2=0x7ff3980769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7ff398074590 0x7ff3980769d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff39806af50 msgr2=0x7ff39806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff39806af50 0x7ff39806d410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0a69e0 tx=0x7ff3a0008200 comp rx=0 tx=0).stop 2023-10-16T19:40:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394003a00 msgr2=0x7ff3ac071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 --2- 172.21.15.29:0/1202640832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff394003a00 0x7ff3ac071a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff39c01b000 tx=0x7ff39c0047c0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3ab7fe700 1 -- 172.21.15.29:0/1202640832 reap_dead start 2023-10-16T19:40:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 shutdown_connections 2023-10-16T19:40:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.431+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 >> 172.21.15.29:0/1202640832 conn(0x7ff3ac0a7c20 msgr2=0x7ff3ac0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7f615b7fe700 1 -- 172.21.15.29:0/634980796 <== osd.2 v2:172.21.15.29:6808/365921754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f615c0098f0 con 0x7f61440744c0 2023-10-16T19:40:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 shutdown_connections 2023-10-16T19:40:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4e406af50 msgr2=0x7fc4e406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7fc507f1d700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4e406af50 0x7fc4e406d410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc5000ac670 tx=0x7fc4f0009210 comp rx=0 tx=0).stop 2023-10-16T19:40:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 msgr2=0x7fc50014d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7fc507f1d700 1 --2- 172.21.15.29:0/346603162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc500071840 0x7fc50014d110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5000c3980 tx=0x7fc4f8004ad0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.433+0000 7ff3b171a700 1 -- 172.21.15.29:0/1202640832 wait complete. 2023-10-16T19:40:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.434+0000 7fc5064ba700 1 -- 172.21.15.29:0/346603162 reap_dead start 2023-10-16T19:40:20.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.434+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 shutdown_connections 2023-10-16T19:40:20.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.434+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 >> 172.21.15.29:0/346603162 conn(0x7fc5000c7110 msgr2=0x7fc5000c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.535 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:20.536 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:40:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.434+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 shutdown_connections 2023-10-16T19:40:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.434+0000 7fc507f1d700 1 -- 172.21.15.29:0/346603162 wait complete. 2023-10-16T19:40:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7f61440744c0 msgr2=0x7f6144076900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7f61440744c0 0x7f6144076900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f614406af00 msgr2=0x7f614406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f614406af00 0x7f614406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61640c0b40 tx=0x7f614c008040 comp rx=0 tx=0).stop 2023-10-16T19:40:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 msgr2=0x7f61640a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f6169644700 1 --2- 172.21.15.29:0/634980796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f616406e060 0x7f61640a6610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f615400c500 tx=0x7f615400c8c0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.435+0000 7f61637fe700 1 -- 172.21.15.29:0/634980796 reap_dead start 2023-10-16T19:40:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.439+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 shutdown_connections 2023-10-16T19:40:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.439+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 >> 172.21.15.29:0/634980796 conn(0x7f61640a7c20 msgr2=0x7f61640705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.540 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:20.540 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:40:20.541 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:20.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:40:20.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.440+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 shutdown_connections 2023-10-16T19:40:20.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.440+0000 7f6169644700 1 -- 172.21.15.29:0/634980796 wait complete. 2023-10-16T19:40:20.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.442+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 --> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce64005cb0 con 0x7fce640015e0 2023-10-16T19:40:20.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.442+0000 7fce6bfff700 1 -- 172.21.15.29:0/2889301172 <== osd.6 v2:172.21.15.53:6808/196702031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce64005cb0 con 0x7fce640015e0 2023-10-16T19:40:20.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fce640015e0 msgr2=0x7fce64003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fce640015e0 0x7fce64003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fce7006af50 msgr2=0x7fce7006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fce7006af50 0x7fce7006d410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce78000f60 tx=0x7fce78007e00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 msgr2=0x7fce840baf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 --2- 172.21.15.29:0/2889301172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce840c7860 0x7fce840baf70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce74000c00 tx=0x7fce74004750 comp rx=0 tx=0).stop 2023-10-16T19:40:20.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce83fff700 1 -- 172.21.15.29:0/2889301172 reap_dead start 2023-10-16T19:40:20.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 shutdown_connections 2023-10-16T19:40:20.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 >> 172.21.15.29:0/2889301172 conn(0x7fce8406ac70 msgr2=0x7fce84156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 shutdown_connections 2023-10-16T19:40:20.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.443+0000 7fce8a219700 1 -- 172.21.15.29:0/2889301172 wait complete. 2023-10-16T19:40:20.547 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2023-10-16T19:40:20.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:40:20.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.455+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 --> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd988002d40 con 0x7fd98c0746f0 2023-10-16T19:40:20.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.456+0000 7fd992ffd700 1 -- 172.21.15.29:0/3231537248 <== osd.7 v2:172.21.15.53:6824/2487489897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd988002d40 con 0x7fd98c0746f0 2023-10-16T19:40:20.549 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.456+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7fd98c0746f0 msgr2=0x7fd98c076b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.456+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7fd98c0746f0 0x7fd98c076b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:40:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.456+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd98c06b0b0 msgr2=0x7fd98c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.456+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd98c06b0b0 0x7fd98c06d570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40be050 tx=0x7fd998007ad0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 msgr2=0x7fd9a40b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 --2- 172.21.15.29:0/3231537248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9a406d790 0x7fd9a40b8650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd994004750 comp rx=0 tx=0).stop 2023-10-16T19:40:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a2d9d700 1 -- 172.21.15.29:0/3231537248 reap_dead start 2023-10-16T19:40:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 shutdown_connections 2023-10-16T19:40:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 >> 172.21.15.29:0/3231537248 conn(0x7fd9a40a7c20 msgr2=0x7fd9a40a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 shutdown_connections 2023-10-16T19:40:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.457+0000 7fd9a89cb700 1 -- 172.21.15.29:0/3231537248 wait complete. 2023-10-16T19:40:20.554 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:20.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:40:20.555 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:20.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:40:20.556 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:20.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:40:20.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.794+0000 7faa10aeb700 1 Processor -- start 2023-10-16T19:40:20.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.794+0000 7faa10aeb700 1 -- start start 2023-10-16T19:40:20.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.795+0000 7faa10aeb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa0c0c4f50 0x7faa0c153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa10aeb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa0c0c7bb0 0x7faa0c070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa10aeb700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0bd0e0 con 0x7faa0c070ac0 2023-10-16T19:40:20.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa10aeb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0c3000 con 0x7faa0c0c4f50 2023-10-16T19:40:20.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa10aeb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0c5330 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa0c0c7bb0 0x7faa0c070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa0c0c7bb0 0x7faa0c070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42112/0 (socket says 172.21.15.29:42112) 2023-10-16T19:40:20.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 -- 172.21.15.29:0/3160736371 learned_addr learned my addr 172.21.15.29:0/3160736371 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 -- 172.21.15.29:0/3160736371 >> v2:172.21.15.29:3300/0 conn(0x7faa0c0c4f50 msgr2=0x7faa0c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 --2- 172.21.15.29:0/3160736371 >> v2:172.21.15.29:3300/0 conn(0x7faa0c0c4f50 0x7faa0c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 -- 172.21.15.29:0/3160736371 >> v1:172.21.15.29:6789/0 conn(0x7faa0c070ac0 legacy=0x7faa0c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.796+0000 7faa09d9b700 1 -- 172.21.15.29:0/3160736371 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0c2a40 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.797+0000 7faa09d9b700 1 --2- 172.21.15.29:0/3160736371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c0c7bb0 0x7faa0c070580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0098f0 tx=0x7fa9fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d196fd58dabd6e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.798+0000 7faa0959a700 1 -- 172.21.15.29:0/3160736371 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004230 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.798+0000 7faa0959a700 1 -- 172.21.15.29:0/3160736371 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc004390 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.798+0000 7faa0959a700 1 -- 172.21.15.29:0/3160736371 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0036a0 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.799+0000 7faa10aeb700 1 -- 172.21.15.29:0/3160736371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c0c7bb0 msgr2=0x7faa0c070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.799+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3160736371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c0c7bb0 0x7faa0c070580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0098f0 tx=0x7fa9fc009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.799+0000 7f54841ed700 1 Processor -- start 2023-10-16T19:40:20.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.799+0000 7f54841ed700 1 -- start start 2023-10-16T19:40:20.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 -- 172.21.15.29:0/3160736371 shutdown_connections 2023-10-16T19:40:20.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3160736371 >> v2:172.21.15.29:3300/0 conn(0x7faa0c0c4f50 0x7faa0c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3160736371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c0c7bb0 0x7faa0c070580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 -- 172.21.15.29:0/3160736371 >> 172.21.15.29:0/3160736371 conn(0x7faa0c0a9cd0 msgr2=0x7faa0c0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 -- 172.21.15.29:0/3160736371 shutdown_connections 2023-10-16T19:40:20.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f54841ed700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 0x7f547c0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f54841ed700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f547c0c3420 0x7f547c0a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f54841ed700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0c2a50 con 0x7f547c06d790 2023-10-16T19:40:20.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f54841ed700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0c1e40 con 0x7f547c0c3420 2023-10-16T19:40:20.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f54841ed700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c2120 con 0x7f547c0726d0 2023-10-16T19:40:20.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f548278a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f547c06d790 0x7f547c070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37276/0 (socket says 172.21.15.29:37276) 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7f548278a700 1 -- 172.21.15.29:0/345558236 learned_addr learned my addr 172.21.15.29:0/345558236 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 --2- 172.21.15.29:0/345558236 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 0x7f547c0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 -- 172.21.15.29:0/345558236 >> v2:172.21.15.53:3300/0 conn(0x7f547c0c3420 msgr2=0x7f547c0a4da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 --2- 172.21.15.29:0/345558236 >> v2:172.21.15.53:3300/0 conn(0x7f547c0c3420 0x7f547c0a4da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 -- 172.21.15.29:0/345558236 >> v1:172.21.15.29:6789/0 conn(0x7f547c06d790 legacy=0x7f547c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 -- 172.21.15.29:0/345558236 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0c2400 con 0x7f547c0726d0 2023-10-16T19:40:20.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.801+0000 7f5481f89700 1 --2- 172.21.15.29:0/345558236 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 0x7f547c0c2ee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f546c009820 tx=0x7f546c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7123eac115845b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.800+0000 7faa10aeb700 1 -- 172.21.15.29:0/3160736371 wait complete. 2023-10-16T19:40:20.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.802+0000 7faa10aeb700 1 Processor -- start 2023-10-16T19:40:20.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.802+0000 7f5480f87700 1 -- 172.21.15.29:0/345558236 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c005e30 con 0x7f547c0726d0 2023-10-16T19:40:20.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.802+0000 7f5480f87700 1 -- 172.21.15.29:0/345558236 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c004030 con 0x7f547c0726d0 2023-10-16T19:40:20.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.802+0000 7f5480f87700 1 -- 172.21.15.29:0/345558236 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0043e0 con 0x7f547c0726d0 2023-10-16T19:40:20.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 -- 172.21.15.29:0/345558236 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 msgr2=0x7f547c0c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 --2- 172.21.15.29:0/345558236 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 0x7f547c0c2ee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f546c009820 tx=0x7f546c009b30 comp rx=0 tx=0).stop 2023-10-16T19:40:20.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 -- 172.21.15.29:0/345558236 shutdown_connections 2023-10-16T19:40:20.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 --2- 172.21.15.29:0/345558236 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c0726d0 0x7f547c0c2ee0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f546c009820 tx=0x7f546c009b30 comp rx=0 tx=0).stop 2023-10-16T19:40:20.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 --2- 172.21.15.29:0/345558236 >> v2:172.21.15.53:3300/0 conn(0x7f547c0c3420 0x7f547c0a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 -- 172.21.15.29:0/345558236 >> 172.21.15.29:0/345558236 conn(0x7f547c0a7c20 msgr2=0x7f547c0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f63d35ee700 1 Processor -- start 2023-10-16T19:40:20.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.802+0000 7faa10aeb700 1 -- start start 2023-10-16T19:40:20.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 -- 172.21.15.29:0/345558236 shutdown_connections 2023-10-16T19:40:20.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7fcb84f90700 1 Processor -- start 2023-10-16T19:40:20.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f54841ed700 1 -- 172.21.15.29:0/345558236 wait complete. 2023-10-16T19:40:20.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7f63d35ee700 1 -- start start 2023-10-16T19:40:20.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7fcb84f90700 1 -- start start 2023-10-16T19:40:20.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 0x7faa0c14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faa0c0c7bb0 0x7faa0c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c148f80 con 0x7faa0c0c4f50 2023-10-16T19:40:20.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1e8740 con 0x7faa0c070ac0 2023-10-16T19:40:20.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.803+0000 7faa10aeb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c154320 con 0x7faa0c0c7bb0 2023-10-16T19:40:20.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa0a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 0x7faa0c14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51838/0 (socket says 172.21.15.29:51838) 2023-10-16T19:40:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa0a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 0x7faa0c14d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42122/0 (socket says 172.21.15.29:42122) 2023-10-16T19:40:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 -- 172.21.15.29:0/3064377252 learned_addr learned my addr 172.21.15.29:0/3064377252 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa0ad9d700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faa0c0c7bb0 0x7faa0c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 -- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faa0c0c7bb0 msgr2=0x7faa0c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faa0c0c7bb0 0x7faa0c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 -- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 msgr2=0x7faa0c14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 0x7faa0c14d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7faa09d9b700 1 -- 172.21.15.29:0/3064377252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc009550 con 0x7faa0c0c4f50 2023-10-16T19:40:20.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7f63d35ee700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63cc0c3010 0x7f63cc0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7f63d35ee700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc0c1370 0x7f63cc1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7f63d35ee700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63cc0c0ee0 con 0x7f63cc0b95b0 2023-10-16T19:40:20.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7f63d35ee700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63cc06e270 con 0x7f63cc0c3010 2023-10-16T19:40:20.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7f63d35ee700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc0c5900 con 0x7f63cc0c1370 2023-10-16T19:40:20.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7efd50320700 1 Processor -- start 2023-10-16T19:40:20.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.804+0000 7efd50320700 1 -- start start 2023-10-16T19:40:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7faa09d9b700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b0e0 tx=0x7fa9fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7f54841ed700 1 Processor -- start 2023-10-16T19:40:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb84f90700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800c67f0 0x7fcb800a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb84f90700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb800c0b00 0x7fcb800a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb84f90700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800c10f0 con 0x7fcb800c4130 2023-10-16T19:40:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb84f90700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800c5d10 con 0x7fcb800c0b00 2023-10-16T19:40:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb84f90700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800c56c0 con 0x7fcb800c67f0 2023-10-16T19:40:20.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7f63d0b89700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f63cc0b95b0 0x7f63cc070390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37290/0 (socket says 172.21.15.29:37290) 2023-10-16T19:40:20.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7f63d0b89700 1 -- 172.21.15.29:0/3549828627 learned_addr learned my addr 172.21.15.29:0/3549828627 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7f54841ed700 1 -- start start 2023-10-16T19:40:20.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb7dd9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb800c0b00 0x7fcb800a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb7dd9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb800c0b00 0x7fcb800a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51850/0 (socket says 172.21.15.29:51850) 2023-10-16T19:40:20.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.805+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2467330697 learned_addr learned my addr 172.21.15.29:0/2467330697 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220206946 0 0) 0x7f63cc0c0ee0 con 0x7f63cc0b95b0 2023-10-16T19:40:20.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b80035b0 con 0x7f63cc0b95b0 2023-10-16T19:40:20.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd50320700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd480726d0 0x7efd480c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd50320700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd480c3420 0x7efd480a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd50320700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd480c2a50 con 0x7efd4806d790 2023-10-16T19:40:20.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd50320700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480c1e40 con 0x7efd480726d0 2023-10-16T19:40:20.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd50320700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480c2120 con 0x7efd480c3420 2023-10-16T19:40:20.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd4e8bd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efd4806d790 0x7efd48070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37298/0 (socket says 172.21.15.29:37298) 2023-10-16T19:40:20.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd4e8bd700 1 -- 172.21.15.29:0/152280756 learned_addr learned my addr 172.21.15.29:0/152280756 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2467330697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800c67f0 msgr2=0x7fcb800a4f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:20.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fcb7dd9b700 1 --2- 172.21.15.29:0/2467330697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800c67f0 0x7fcb800a4f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2467330697 >> v1:172.21.15.29:6789/0 conn(0x7fcb800c4130 legacy=0x7fcb800c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2467330697 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800c59a0 con 0x7fcb800c0b00 2023-10-16T19:40:20.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/152280756 >> v2:172.21.15.29:3300/0 conn(0x7efd480726d0 0x7efd480c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f547c0c3420 0x7f547c1efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 0x7f547c1f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0bf290 con 0x7f547c0b99a0 2023-10-16T19:40:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0be9a0 con 0x7f547c0c3420 2023-10-16T19:40:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f54841ed700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0b9e30 con 0x7f547c06d790 2023-10-16T19:40:20.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fcb7dd9b700 1 --2- 172.21.15.29:0/2467330697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb800c0b00 0x7fcb800a5470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb740098f0 tx=0x7fcb74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f8fe381c117ede server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440105908 0 0) 0x7f63b80035b0 con 0x7f63cc0b95b0 2023-10-16T19:40:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc0c1370 msgr2=0x7f63cc1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc0c1370 0x7f63cc1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 >> v2:172.21.15.53:3300/0 conn(0x7f63cc0c3010 msgr2=0x7f63cc0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 --2- 172.21.15.29:0/3549828627 >> v2:172.21.15.53:3300/0 conn(0x7f63cc0c3010 0x7f63cc0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0c5be0 con 0x7f63cc0b95b0 2023-10-16T19:40:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f63c8001670 con 0x7f63cc0b95b0 2023-10-16T19:40:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 >> v1:172.21.15.29:6789/0 conn(0x7f63cc0b95b0 legacy=0x7f63cc070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63b8003a00 0x7f63b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b8004850 0x7f63b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7f63bffff700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8005260 0x7f63b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc06e270 con 0x7f63b8004850 2023-10-16T19:40:20.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc0c5900 con 0x7f63b8005260 2023-10-16T19:40:20.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b800c210 con 0x7f63b8003a00 2023-10-16T19:40:20.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f63d0b89700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b8004850 0x7f63b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f5481788700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f547c0c3420 0x7f547c1efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f5481f89700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f5481f89700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44316/0 (socket says 172.21.15.29:44316) 2023-10-16T19:40:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f5481f89700 1 -- 172.21.15.29:0/4210549887 learned_addr learned my addr 172.21.15.29:0/4210549887 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7f548278a700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 0x7f547c1f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 -- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f547c0c3420 msgr2=0x7f547c1efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f547c0c3420 0x7f547c1efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 -- 172.21.15.29:0/4210549887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 msgr2=0x7f547c1f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 0x7f547c1f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 -- 172.21.15.29:0/4210549887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009430 con 0x7f547c06d790 2023-10-16T19:40:20.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f548278a700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 0x7f547c1f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4d8bb700 1 --2- 172.21.15.29:0/152280756 >> v2:172.21.15.53:3300/0 conn(0x7efd480c3420 0x7efd480a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4e0bc700 1 -- 172.21.15.29:0/152280756 >> v2:172.21.15.53:3300/0 conn(0x7efd480c3420 msgr2=0x7efd480a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/152280756 >> v2:172.21.15.53:3300/0 conn(0x7efd480c3420 0x7efd480a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4e0bc700 1 -- 172.21.15.29:0/152280756 >> v1:172.21.15.29:6789/0 conn(0x7efd4806d790 legacy=0x7efd48070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4e0bc700 1 -- 172.21.15.29:0/152280756 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480c2400 con 0x7efd480726d0 2023-10-16T19:40:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/152280756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd480c2ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd480c0450 tx=0x7efd38009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f959ddf310a69c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 -- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63b8003a00 msgr2=0x7f63b8003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63b8003a00 0x7f63b8003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 -- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8005260 msgr2=0x7f63b800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8005260 0x7f63b800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 -- 172.21.15.29:0/3549828627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0c5be0 con 0x7f63b8004850 2023-10-16T19:40:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f63d0b89700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b8004850 0x7f63b8004cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63c800c3c0 tx=0x7f63b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c516a4839c283 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc011630 con 0x7faa0c0c4f50 2023-10-16T19:40:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc011790 con 0x7faa0c0c4f50 2023-10-16T19:40:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.806+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc011b20 con 0x7faa0c0c4f50 2023-10-16T19:40:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0aada0 con 0x7faa0c0c4f50 2023-10-16T19:40:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c154040 con 0x7faa0c0c4f50 2023-10-16T19:40:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7fcb7d59a700 1 -- 172.21.15.29:0/2467330697 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74004230 con 0x7fcb800c0b00 2023-10-16T19:40:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7fcb7d59a700 1 -- 172.21.15.29:0/2467330697 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74004390 con 0x7fcb800c0b00 2023-10-16T19:40:20.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.807+0000 7fcb7d59a700 1 -- 172.21.15.29:0/2467330697 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740036a0 con 0x7fcb800c0b00 2023-10-16T19:40:20.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 -- 172.21.15.29:0/2467330697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb800c0b00 msgr2=0x7fcb800a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2467330697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb800c0b00 0x7fcb800a5470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb740098f0 tx=0x7fcb74009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 -- 172.21.15.29:0/2467330697 shutdown_connections 2023-10-16T19:40:20.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2467330697 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800c67f0 0x7fcb800a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2467330697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb800c0b00 0x7fcb800a5470 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb740098f0 tx=0x7fcb74009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7fcb84f90700 1 -- 172.21.15.29:0/2467330697 >> 172.21.15.29:0/2467330697 conn(0x7fcb800a8070 msgr2=0x7fcb800c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f5481f89700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f546c009b70 tx=0x7f546c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c04f400 con 0x7faa0c0c4f50 2023-10-16T19:40:20.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c003de0 con 0x7f547c06d790 2023-10-16T19:40:20.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c011420 con 0x7f547c06d790 2023-10-16T19:40:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0117d0 con 0x7f547c06d790 2023-10-16T19:40:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0bec40 con 0x7f547c06d790 2023-10-16T19:40:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.808+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0a51c0 con 0x7f547c06d790 2023-10-16T19:40:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.809+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8005960 con 0x7f63b8004850 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.809+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c8005ac0 con 0x7f63b8004850 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.809+0000 7f63bffff700 1 -- 172.21.15.29:0/3549828627 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8005e30 con 0x7f63b8004850 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f63d35ee700 1 -- 172.21.15.29:0/3549828627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b8004850 msgr2=0x7f63b8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f63d35ee700 1 --2- 172.21.15.29:0/3549828627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b8004850 0x7f63b8004cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63c800c3c0 tx=0x7f63b8005880 comp rx=0 tx=0).stop 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f63d1b8b700 1 -- 172.21.15.29:0/3549828627 reap_dead start 2023-10-16T19:40:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f63d35ee700 1 -- 172.21.15.29:0/3549828627 shutdown_connections 2023-10-16T19:40:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f63d35ee700 1 -- 172.21.15.29:0/3549828627 >> 172.21.15.29:0/3549828627 conn(0x7f63cc0a7c20 msgr2=0x7f63cc0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7f63d35ee700 1 -- 172.21.15.29:0/3549828627 shutdown_connections 2023-10-16T19:40:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7fcb84f90700 1 -- 172.21.15.29:0/2467330697 shutdown_connections 2023-10-16T19:40:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f546c011930 con 0x7f547c06d790 2023-10-16T19:40:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7f54727fc700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 0x7f546006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f546c08af50 con 0x7f547c06d790 2023-10-16T19:40:20.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa9fc021070 con 0x7faa0c0c4f50 2023-10-16T19:40:20.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7fa9faffd700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 0x7fa9ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9fc08b3d0 con 0x7faa0c0c4f50 2023-10-16T19:40:20.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.811+0000 7faa0a59c700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 0x7fa9ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.810+0000 7fcb84f90700 1 -- 172.21.15.29:0/2467330697 wait complete. 2023-10-16T19:40:20.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7f5481788700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 0x7f546006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c04f400 con 0x7f547c06d790 2023-10-16T19:40:20.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7faa0a59c700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 0x7fa9ec06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa00006fd0 tx=0x7faa00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7f5481788700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 0x7f546006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f547c0a58e0 tx=0x7f54780090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7fcb84f90700 1 Processor -- start 2023-10-16T19:40:20.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7f38c989f700 1 Processor -- start 2023-10-16T19:40:20.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.812+0000 7f38c989f700 1 -- start start 2023-10-16T19:40:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f63d35ee700 1 -- 172.21.15.29:0/3549828627 wait complete. 2023-10-16T19:40:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c989f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c40c49a0 0x7f38c40c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c989f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c40c4e30 con 0x7f38c40c2f30 2023-10-16T19:40:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c989f700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c408ac80 con 0x7f38c40c1200 2023-10-16T19:40:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c989f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40c55b0 con 0x7f38c40c49a0 2023-10-16T19:40:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c40c49a0 0x7f38c40c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c40c49a0 0x7f38c40c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51874/0 (socket says 172.21.15.29:51874) 2023-10-16T19:40:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7f38c27fc700 1 -- 172.21.15.29:0/1416224879 learned_addr learned my addr 172.21.15.29:0/1416224879 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.813+0000 7fcb84f90700 1 -- start start 2023-10-16T19:40:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb800c4130 0x7fcb801e2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800a8b00 0x7fcb800bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801eea90 con 0x7fcb801e3290 2023-10-16T19:40:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801e27b0 con 0x7fcb800c4130 2023-10-16T19:40:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb84f90700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801ee7b0 con 0x7fcb800a8b00 2023-10-16T19:40:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f38c27fc700 1 -- 172.21.15.29:0/1416224879 >> v1:172.21.15.53:6789/0 conn(0x7f38c40c1200 legacy=0x7f38c40c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f38c27fc700 1 -- 172.21.15.29:0/1416224879 >> v1:172.21.15.29:6789/0 conn(0x7f38c40c2f30 legacy=0x7f38c41695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7efd4d0ba700 1 -- 172.21.15.29:0/152280756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38005e30 con 0x7efd480726d0 2023-10-16T19:40:20.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7efd4d0ba700 1 -- 172.21.15.29:0/152280756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38006030 con 0x7efd480726d0 2023-10-16T19:40:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7efd4d0ba700 1 -- 172.21.15.29:0/152280756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380063c0 con 0x7efd480726d0 2023-10-16T19:40:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb7dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb7dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51880/0 (socket says 172.21.15.29:51880) 2023-10-16T19:40:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2006396279 learned_addr learned my addr 172.21.15.29:0/2006396279 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f63d35ee700 1 Processor -- start 2023-10-16T19:40:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f38c27fc700 1 -- 172.21.15.29:0/1416224879 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40c5890 con 0x7f38c40c49a0 2023-10-16T19:40:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f38c27fc700 1 --2- 172.21.15.29:0/1416224879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c49a0 0x7f38c40c29f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b80131e0 tx=0x7f38b80134f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14237033f4a96157 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7fcb7e59c700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb800c4130 0x7fcb801e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800a8b00 msgr2=0x7fcb800bdd10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800a8b00 0x7fcb800bdd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb800c4130 msgr2=0x7fcb801e2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb800c4130 0x7fcb801e2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 -- 172.21.15.29:0/2006396279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009550 con 0x7fcb801e3290 2023-10-16T19:40:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7fcb7dd9b700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009c40 tx=0x7fcb74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 -- 172.21.15.29:0/152280756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 msgr2=0x7efd480c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 --2- 172.21.15.29:0/152280756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd480c2ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd480c0450 tx=0x7efd38009b00 comp rx=0 tx=0).stop 2023-10-16T19:40:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 -- 172.21.15.29:0/152280756 shutdown_connections 2023-10-16T19:40:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 --2- 172.21.15.29:0/152280756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd480c2ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 --2- 172.21.15.29:0/152280756 >> v2:172.21.15.53:3300/0 conn(0x7efd480c3420 0x7efd480a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 -- 172.21.15.29:0/152280756 >> 172.21.15.29:0/152280756 conn(0x7efd480a7c20 msgr2=0x7efd480a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 -- 172.21.15.29:0/152280756 shutdown_connections 2023-10-16T19:40:20.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7efd50320700 1 -- 172.21.15.29:0/152280756 wait complete. 2023-10-16T19:40:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.814+0000 7f63d35ee700 1 -- start start 2023-10-16T19:40:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 0x7f63cc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 0x7f63cc1f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc0bb140 con 0x7f63cc1679a0 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc168360 con 0x7f63b8004850 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.815+0000 7f63d35ee700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc0c4820 con 0x7f63cc1f7660 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d0b89700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 0x7f63cc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d0b89700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51886/0 (socket says 172.21.15.29:51886) 2023-10-16T19:40:20.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d0b89700 1 -- 172.21.15.29:0/2426289065 learned_addr learned my addr 172.21.15.29:0/2426289065 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d1b8b700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 0x7f63cc1f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 -- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 msgr2=0x7f63cc1f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 0x7f63cc1f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 -- 172.21.15.29:0/2426289065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 msgr2=0x7f63cc167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 -- 172.21.15.29:0/2426289065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0bae60 con 0x7f63b8004850 2023-10-16T19:40:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d0b89700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d1b8b700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 0x7f63cc1f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.816+0000 7f63d138a700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 0x7f63cc156330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b480 tx=0x7f63c000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000be50 con 0x7f63b8004850 2023-10-16T19:40:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0005b10 con 0x7f63b8004850 2023-10-16T19:40:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc0bbe80 con 0x7f63b8004850 2023-10-16T19:40:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011630 con 0x7f63b8004850 2023-10-16T19:40:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7efd50320700 1 Processor -- start 2023-10-16T19:40:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f38c1ffb700 1 -- 172.21.15.29:0/1416224879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8016070 con 0x7f38c40c49a0 2023-10-16T19:40:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc0bc440 con 0x7f63b8004850 2023-10-16T19:40:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7fe1ea3e9700 1 Processor -- start 2023-10-16T19:40:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9fc056200 con 0x7faa0c0c4f50 2023-10-16T19:40:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac0052f0 con 0x7f63b8004850 2023-10-16T19:40:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f38c1ffb700 1 -- 172.21.15.29:0/1416224879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8013d30 con 0x7f38c40c49a0 2023-10-16T19:40:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7f38c1ffb700 1 -- 172.21.15.29:0/1416224879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004250 con 0x7f38c40c49a0 2023-10-16T19:40:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f38c989f700 1 -- 172.21.15.29:0/1416224879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c49a0 msgr2=0x7f38c40c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f38c989f700 1 --2- 172.21.15.29:0/1416224879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c49a0 0x7f38c40c29f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b80131e0 tx=0x7f38b80134f0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f546c02c080 con 0x7f547c06d790 2023-10-16T19:40:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.817+0000 7efd50320700 1 -- start start 2023-10-16T19:40:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd4815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efd480c3420 0x7efd481ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48071540 con 0x7efd480726d0 2023-10-16T19:40:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48070dd0 con 0x7efd4806d790 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd50320700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481ee260 con 0x7efd480c3420 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd4e0bc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd4e0bc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42176/0 (socket says 172.21.15.29:42176) 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.818+0000 7efd4e0bc700 1 -- 172.21.15.29:0/1983108010 learned_addr learned my addr 172.21.15.29:0/1983108010 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e8bd700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efd480c3420 0x7efd481ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 -- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efd480c3420 msgr2=0x7efd481ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efd480c3420 0x7efd481ee6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 -- 172.21.15.29:0/1983108010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 msgr2=0x7efd4815c7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:40:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd4815c7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 -- 172.21.15.29:0/1983108010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38009430 con 0x7efd4806d790 2023-10-16T19:40:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f38c989f700 1 -- 172.21.15.29:0/1416224879 shutdown_connections 2023-10-16T19:40:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f38c989f700 1 --2- 172.21.15.29:0/1416224879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c49a0 0x7f38c40c29f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7f38c989f700 1 -- 172.21.15.29:0/1416224879 >> 172.21.15.29:0/1416224879 conn(0x7f38c40a7c20 msgr2=0x7f38c40a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740045e0 con 0x7fcb801e3290 2023-10-16T19:40:20.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fe1ea3e9700 1 -- start start 2023-10-16T19:40:20.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1e40c55d0 0x7fe1e4156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40b9520 0x7fe1e41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c2830 0x7fe1e40aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c13f0 con 0x7fe1e40c55d0 2023-10-16T19:40:20.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c30f0 con 0x7fe1e40b9520 2023-10-16T19:40:20.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1ea3e9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4150760 con 0x7fe1e40c2830 2023-10-16T19:40:20.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7efd4e0bc700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd38009b40 tx=0x7efd38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.820+0000 7fe1e37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40b9520 0x7fe1e41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40b9520 0x7fe1e41568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42182/0 (socket says 172.21.15.29:42182) 2023-10-16T19:40:20.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 -- 172.21.15.29:0/219813925 learned_addr learned my addr 172.21.15.29:0/219813925 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e8986700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c2830 0x7fe1e40aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63c0011790 con 0x7f63b8004850 2023-10-16T19:40:20.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 -- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c2830 msgr2=0x7fe1e40aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c2830 0x7fe1e40aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 -- 172.21.15.29:0/219813925 >> v2:172.21.15.29:3300/0 conn(0x7fe1e40c55d0 msgr2=0x7fe1e4156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:20.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 --2- 172.21.15.29:0/219813925 >> v2:172.21.15.29:3300/0 conn(0x7fe1e40c55d0 0x7fe1e4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 -- 172.21.15.29:0/219813925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40abe40 con 0x7fe1e40b9520 2023-10-16T19:40:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7f38c989f700 1 -- 172.21.15.29:0/1416224879 shutdown_connections 2023-10-16T19:40:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7400b660 con 0x7fcb801e3290 2023-10-16T19:40:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400b9d0 con 0x7fcb801e3290 2023-10-16T19:40:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb801e1790 con 0x7fcb801e3290 2023-10-16T19:40:20.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.819+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb801e1d50 con 0x7fcb801e3290 2023-10-16T19:40:20.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcb74022070 con 0x7fcb801e3290 2023-10-16T19:40:20.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fe1e37fe700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40b9520 0x7fe1e41568c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009920 tx=0x7fe1d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be5c222c2c2176d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7f63bdffb700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 0x7f63b806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7f38c989f700 1 -- 172.21.15.29:0/1416224879 wait complete. 2023-10-16T19:40:20.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.821+0000 7fcb6effd700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 0x7fcb6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.822+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb7408b270 con 0x7fcb801e3290 2023-10-16T19:40:20.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.822+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63c0089300 con 0x7f63b8004850 2023-10-16T19:40:20.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.822+0000 7f63d0b89700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 0x7f63b806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.822+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb640052f0 con 0x7fcb801e3290 2023-10-16T19:40:20.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.822+0000 7fcb7e59c700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 0x7fcb6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.823+0000 7f63d0b89700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 0x7f63b806ee20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000c00 tx=0x7f63c800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.823+0000 7fcb7e59c700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 0x7fcb6006d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb800a8ad0 tx=0x7fcb70009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.823+0000 7f38c989f700 1 Processor -- start 2023-10-16T19:40:20.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.823+0000 7f38c989f700 1 -- start start 2023-10-16T19:40:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c2f30 0x7f38c41fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c40c49a0 0x7f38c41faac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41f9fa0 con 0x7f38c40c2f30 2023-10-16T19:40:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41fa240 con 0x7f38c40c49a0 2023-10-16T19:40:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c989f700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41f6b40 con 0x7f38c40c1200 2023-10-16T19:40:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c2ffd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c40c49a0 0x7f38c41faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c2ffd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44358/0 (socket says 172.21.15.29:44358) 2023-10-16T19:40:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7f38c2ffd700 1 -- 172.21.15.29:0/3191603734 learned_addr learned my addr 172.21.15.29:0/3191603734 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7fe1e2ffd700 1 -- 172.21.15.29:0/219813925 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400b9e0 con 0x7fe1e40b9520 2023-10-16T19:40:20.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7fe1e2ffd700 1 -- 172.21.15.29:0/219813925 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d400bb40 con 0x7fe1e40b9520 2023-10-16T19:40:20.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.824+0000 7fe1e2ffd700 1 -- 172.21.15.29:0/219813925 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4009e70 con 0x7fe1e40b9520 2023-10-16T19:40:20.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 -- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c40c49a0 msgr2=0x7f38c41faac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c40c49a0 0x7f38c41faac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 -- 172.21.15.29:0/3191603734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c2f30 msgr2=0x7f38c41fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c2f30 0x7f38c41fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 -- 172.21.15.29:0/3191603734 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8011df0 con 0x7f38c40c1200 2023-10-16T19:40:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c2ffd700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38bc002050 tx=0x7f38bc00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc003e80 con 0x7f38c40c1200 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00a930 con 0x7f38c40c1200 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00ace0 con 0x7f38c40c1200 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c41f6e20 con 0x7f38c40c1200 2023-10-16T19:40:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c41f73e0 con 0x7f38c40c1200 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40b9520 msgr2=0x7fe1e41568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40b9520 0x7fe1e41568c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009920 tx=0x7fe1d4009c30 comp rx=0 tx=0).stop 2023-10-16T19:40:20.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.825+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63c00540b0 con 0x7f63b8004850 2023-10-16T19:40:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/219813925 shutdown_connections 2023-10-16T19:40:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/219813925 >> v2:172.21.15.29:3300/0 conn(0x7fe1e40c55d0 0x7fe1e4156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c2830 0x7fe1e40aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/219813925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40b9520 0x7fe1e41568c0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009920 tx=0x7fe1d4009c30 comp rx=0 tx=0).stop 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/219813925 >> 172.21.15.29:0/219813925 conn(0x7fe1e40a7c20 msgr2=0x7fe1e40a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/219813925 shutdown_connections 2023-10-16T19:40:20.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/219813925 wait complete. 2023-10-16T19:40:20.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.827+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38bc005070 con 0x7f38c40c1200 2023-10-16T19:40:20.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380063a0 con 0x7efd4806d790 2023-10-16T19:40:20.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38020070 con 0x7efd4806d790 2023-10-16T19:40:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38006700 con 0x7efd4806d790 2023-10-16T19:40:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481f24a0 con 0x7efd4806d790 2023-10-16T19:40:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.826+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd48070530 con 0x7efd4806d790 2023-10-16T19:40:20.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7f38abfff700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 0x7f38b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38bc089a50 con 0x7f38c40c1200 2023-10-16T19:40:20.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7fe1ea3e9700 1 Processor -- start 2023-10-16T19:40:20.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7f38c27fc700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 0x7f38b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40052f0 con 0x7f38c40c1200 2023-10-16T19:40:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.828+0000 7fe1ea3e9700 1 -- start start 2023-10-16T19:40:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c2830 0x7fe1e41eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 0x7fe1e40aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ab740 con 0x7fe1e414e3c0 2023-10-16T19:40:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40a9fd0 con 0x7fe1e40c2830 2023-10-16T19:40:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1ea3e9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4147a70 con 0x7fe1e40c55d0 2023-10-16T19:40:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1e37fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1e37fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44368/0 (socket says 172.21.15.29:44368) 2023-10-16T19:40:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1e37fe700 1 -- 172.21.15.29:0/2242199194 learned_addr learned my addr 172.21.15.29:0/2242199194 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1e3fff700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c2830 0x7fe1e41eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd38022030 con 0x7efd4806d790 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7efd3effd700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 0x7efd2c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd3808aed0 con 0x7efd4806d790 2023-10-16T19:40:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7fe1e8986700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 0x7fe1e40aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7efd4d8bb700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 0x7efd2c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 -- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 msgr2=0x7fe1e40aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 -- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c2830 msgr2=0x7fe1e41eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c2830 0x7fe1e41eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 -- 172.21.15.29:0/2242199194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009550 con 0x7fe1e414e3c0 2023-10-16T19:40:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e37fe700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb740562a0 con 0x7fcb801e3290 2023-10-16T19:40:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7efd4d8bb700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 0x7efd2c06d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd40007d40 tx=0x7efd40007270 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7fe1e8986700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 0x7fe1e40aa9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800e7e0 tx=0x7fe1d800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.832+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800c070 con 0x7fe1e414e3c0 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.832+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8013610 con 0x7fe1e414e3c0 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.832+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80139a0 con 0x7fe1e414e3c0 2023-10-16T19:40:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.832+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40a9000 con 0x7fe1e414e3c0 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.833+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e41ebf00 con 0x7fe1e414e3c0 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.833+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40aa190 con 0x7fe1e414e3c0 2023-10-16T19:40:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.834+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38bc0548a0 con 0x7f38c40c1200 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.835+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1d8013b00 con 0x7fe1e414e3c0 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.835+0000 7fe1e0ff9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 0x7fe1cc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.835+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1d8089b40 con 0x7fe1e414e3c0 2023-10-16T19:40:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.835+0000 7fe1e3fff700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 0x7fe1cc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.836+0000 7fe1e3fff700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 0x7fe1cc06d540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a400 tx=0x7fe1dc00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.829+0000 7f372a75a700 1 Processor -- start 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.829+0000 7f372a75a700 1 -- start start 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f372a75a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37240a4f20 0x7f37240c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f372a75a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372408a9a0 con 0x7f37240c1200 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f372a75a700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372408ac80 con 0x7f37240c2c60 2023-10-16T19:40:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f372a75a700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240c4ee0 con 0x7f37240a4f20 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f371b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f37240c1200 0x7f37241695c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37362/0 (socket says 172.21.15.29:37362) 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f371b7fe700 1 -- 172.21.15.29:0/191151569 learned_addr learned my addr 172.21.15.29:0/191151569 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.830+0000 7f3728cf7700 1 --2- 172.21.15.29:0/191151569 >> v2:172.21.15.53:3300/0 conn(0x7f37240a4f20 0x7f37240c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1d8054a40 con 0x7fe1e414e3c0 2023-10-16T19:40:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300052f0 con 0x7efd4806d790 2023-10-16T19:40:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7f3728cf7700 1 -- 172.21.15.29:0/191151569 >> v1:172.21.15.53:6789/0 conn(0x7f37240c2c60 legacy=0x7f37240c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7f3728cf7700 1 -- 172.21.15.29:0/191151569 >> v1:172.21.15.29:6789/0 conn(0x7f37240c1200 legacy=0x7f37241695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7f3728cf7700 1 -- 172.21.15.29:0/191151569 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240c55b0 con 0x7f37240a4f20 2023-10-16T19:40:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.839+0000 7f3728cf7700 1 --2- 172.21.15.29:0/191151569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240a4f20 0x7f37240c49a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f371c009760 tx=0x7f371c009a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec4c8aad792461d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.843+0000 7f38c27fc700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 0x7f38b006d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f38c40c69d0 tx=0x7f38b8018000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.844+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd38055d00 con 0x7efd4806d790 2023-10-16T19:40:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.831+0000 7f37237fe700 1 -- 172.21.15.29:0/191151569 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028488109 0 0) 0x7f372408ac80 con 0x7f37240c2c60 2023-10-16T19:40:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.854+0000 7f37237fe700 1 -- 172.21.15.29:0/191151569 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c004230 con 0x7f37240a4f20 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.854+0000 7f37237fe700 1 -- 172.21.15.29:0/191151569 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c004390 con 0x7f37240a4f20 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.854+0000 7f37237fe700 1 -- 172.21.15.29:0/191151569 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0092e0 con 0x7f37240a4f20 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.855+0000 7f372a75a700 1 -- 172.21.15.29:0/191151569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240a4f20 msgr2=0x7f37240c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.855+0000 7f372a75a700 1 --2- 172.21.15.29:0/191151569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240a4f20 0x7f37240c49a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f371c009760 tx=0x7f371c009a70 comp rx=0 tx=0).stop 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.855+0000 7f372a75a700 1 -- 172.21.15.29:0/191151569 shutdown_connections 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.855+0000 7f372a75a700 1 --2- 172.21.15.29:0/191151569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240a4f20 0x7f37240c49a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.855+0000 7f372a75a700 1 -- 172.21.15.29:0/191151569 >> 172.21.15.29:0/191151569 conn(0x7f37240a7c20 msgr2=0x7f37240a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.856+0000 7f372a75a700 1 -- 172.21.15.29:0/191151569 shutdown_connections 2023-10-16T19:40:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.857+0000 7f372a75a700 1 -- 172.21.15.29:0/191151569 wait complete. 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.858+0000 7f372a75a700 1 Processor -- start 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.859+0000 7f372a75a700 1 -- start start 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f37240a4f20 0x7f37240820b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37240c2c60 0x7f37240ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240b9950 con 0x7f37240c2c60 2023-10-16T19:40:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37241f5780 con 0x7f37240c1200 2023-10-16T19:40:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.860+0000 7f372a75a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240aade0 con 0x7f37240a4f20 2023-10-16T19:40:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42216/0 (socket says 172.21.15.29:42216) 2023-10-16T19:40:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 -- 172.21.15.29:0/127693538 learned_addr learned my addr 172.21.15.29:0/127693538 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f3723fff700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f37240a4f20 0x7f37240820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 -- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f37240a4f20 msgr2=0x7f37240820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f37240a4f20 0x7f37240820b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 -- 172.21.15.29:0/127693538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37240c2c60 msgr2=0x7f37240ba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37240c2c60 0x7f37240ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.861+0000 7f371b7fe700 1 -- 172.21.15.29:0/127693538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c00d040 con 0x7f37240c1200 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f371b7fe700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c750 tx=0x7f370c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c004c80 con 0x7f37240c1200 2023-10-16T19:40:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c004de0 con 0x7f37240c1200 2023-10-16T19:40:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c007310 con 0x7f37240c1200 2023-10-16T19:40:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240ab0c0 con 0x7f37240c1200 2023-10-16T19:40:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.862+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240ab680 con 0x7f37240c1200 2023-10-16T19:40:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.865+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f370c007470 con 0x7f37240c1200 2023-10-16T19:40:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.865+0000 7f37217fa700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 0x7f371006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.865+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f370c089560 con 0x7f37240c1200 2023-10-16T19:40:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.866+0000 7f3723fff700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 0x7f371006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.866+0000 7f3723fff700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 0x7f371006d600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3714001f10 tx=0x7f3714009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.881+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37080052f0 con 0x7f37240c1200 2023-10-16T19:40:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:20.886+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f370c054390 con 0x7f37240c1200 2023-10-16T19:40:21.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.223+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f547c06d500 con 0x7f547c06d790 2023-10-16T19:40:21.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.224+0000 7f54727fc700 1 -- 172.21.15.29:0/4210549887 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f546c016090 con 0x7f547c06d790 2023-10-16T19:40:21.228 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2023-10-16T19:40:21.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 msgr2=0x7f546006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 0x7f546006d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f547c0a58e0 tx=0x7f54780090e0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 msgr2=0x7f547c1ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f546c009b70 tx=0x7f546c004750 comp rx=0 tx=0).stop 2023-10-16T19:40:21.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 shutdown_connections 2023-10-16T19:40:21.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f546006af00 0x7f546006d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f547c0b99a0 0x7f547c1f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f547c06d790 0x7f547c1ef6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 --2- 172.21.15.29:0/4210549887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f547c0c3420 0x7f547c1efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.227+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 >> 172.21.15.29:0/4210549887 conn(0x7f547c0a7c20 msgr2=0x7f547c0c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.228+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 shutdown_connections 2023-10-16T19:40:21.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.228+0000 7f54841ed700 1 -- 172.21.15.29:0/4210549887 wait complete. 2023-10-16T19:40:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.244+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa0c0c7990 con 0x7faa0c0c4f50 2023-10-16T19:40:21.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.245+0000 7fa9faffd700 1 -- 172.21.15.29:0/3064377252 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9fc029020 con 0x7faa0c0c4f50 2023-10-16T19:40:21.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-10-16T19:40:21.248 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2023-10-16T19:40:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 msgr2=0x7fa9ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 0x7fa9ec06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa00006fd0 tx=0x7faa00008040 comp rx=0 tx=0).stop 2023-10-16T19:40:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 msgr2=0x7faa0c148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b0e0 tx=0x7fa9fc004750 comp rx=0 tx=0).stop 2023-10-16T19:40:21.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 shutdown_connections 2023-10-16T19:40:21.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ec06af00 0x7fa9ec06d3c0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa00006fd0 tx=0x7faa00008040 comp rx=0 tx=0).stop 2023-10-16T19:40:21.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faa0c0c7bb0 0x7faa0c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa0c070ac0 0x7faa0c14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 --2- 172.21.15.29:0/3064377252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa0c0c4f50 0x7faa0c148500 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 >> 172.21.15.29:0/3064377252 conn(0x7faa0c0a9cd0 msgr2=0x7faa0c14e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.249+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 shutdown_connections 2023-10-16T19:40:21.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.250+0000 7faa10aeb700 1 -- 172.21.15.29:0/3064377252 wait complete. 2023-10-16T19:40:21.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.252+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efd300055a0 con 0x7efd4806d790 2023-10-16T19:40:21.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.256+0000 7efd3effd700 1 -- 172.21.15.29:0/1983108010 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd38059320 con 0x7efd4806d790 2023-10-16T19:40:21.258 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:21.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.256+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63ac0055a0 con 0x7f63b8004850 2023-10-16T19:40:21.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.260+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 msgr2=0x7efd2c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.260+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 0x7efd2c06d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd40007d40 tx=0x7efd40007270 comp rx=0 tx=0).stop 2023-10-16T19:40:21.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.260+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 msgr2=0x7efd481f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.260+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd38009b40 tx=0x7efd38004750 comp rx=0 tx=0).stop 2023-10-16T19:40:21.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.260+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb64005870 con 0x7fcb801e3290 2023-10-16T19:40:21.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 shutdown_connections 2023-10-16T19:40:21.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd2c06afd0 0x7efd2c06d490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efd480c3420 0x7efd481ee6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd4806d790 0x7efd481f1f60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 --2- 172.21.15.29:0/1983108010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd480726d0 0x7efd4815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 >> 172.21.15.29:0/1983108010 conn(0x7efd480a7c20 msgr2=0x7efd480a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7fcb6effd700 1 -- 172.21.15.29:0/2006396279 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb7402a020 con 0x7fcb801e3290 2023-10-16T19:40:21.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 shutdown_connections 2023-10-16T19:40:21.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.261+0000 7efd50320700 1 -- 172.21.15.29:0/1983108010 wait complete. 2023-10-16T19:40:21.269 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe1e404f400 con 0x7fe1e414e3c0 2023-10-16T19:40:21.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 msgr2=0x7fcb6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 0x7fcb6006d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb800a8ad0 tx=0x7fcb70009190 comp rx=0 tx=0).stop 2023-10-16T19:40:21.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 msgr2=0x7fcb800a66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009c40 tx=0x7fcb74004750 comp rx=0 tx=0).stop 2023-10-16T19:40:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.264+0000 7fe1e0ff9700 1 -- 172.21.15.29:0/2242199194 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1d8017090 con 0x7fe1e414e3c0 2023-10-16T19:40:21.272 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2023-10-16T19:40:21.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.265+0000 7f63bdffb700 1 -- 172.21.15.29:0/2426289065 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63c00576d0 con 0x7f63b8004850 2023-10-16T19:40:21.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 shutdown_connections 2023-10-16T19:40:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb6006af00 0x7fcb6006d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb800a8b00 0x7fcb800bdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb800c4130 0x7fcb801e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 --2- 172.21.15.29:0/2006396279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb801e3290 0x7fcb800a66f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.266+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 >> 172.21.15.29:0/2006396279 conn(0x7fcb800a8070 msgr2=0x7fcb801e4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.267+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 shutdown_connections 2023-10-16T19:40:21.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.267+0000 7fcb84f90700 1 -- 172.21.15.29:0/2006396279 wait complete. 2023-10-16T19:40:21.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-10-16T19:40:21.276 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2023-10-16T19:40:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f38a4005870 con 0x7f38c40c1200 2023-10-16T19:40:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7f38abfff700 1 -- 172.21.15.29:0/3191603734 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38bc057ec0 con 0x7f38c40c1200 2023-10-16T19:40:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 msgr2=0x7fe1cc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 0x7fe1cc06d540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00a400 tx=0x7fe1dc00d040 comp rx=0 tx=0).stop 2023-10-16T19:40:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 msgr2=0x7fe1e40aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 0x7fe1e40aa9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800e7e0 tx=0x7fe1d800eaf0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 shutdown_connections 2023-10-16T19:40:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1cc06b080 0x7fe1cc06d540 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e414e3c0 0x7fe1e40aa9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c2830 0x7fe1e41eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 --2- 172.21.15.29:0/2242199194 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1e40c55d0 0x7fe1e40aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.268+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 >> 172.21.15.29:0/2242199194 conn(0x7fe1e40a7c20 msgr2=0x7fe1e414ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.270+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 shutdown_connections 2023-10-16T19:40:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.270+0000 7fe1ea3e9700 1 -- 172.21.15.29:0/2242199194 wait complete. 2023-10-16T19:40:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 msgr2=0x7f63b806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 0x7f63b806ee20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000c00 tx=0x7f63c800a000 comp rx=0 tx=0).stop 2023-10-16T19:40:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 msgr2=0x7f63cc156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 0x7f63cc156330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b480 tx=0x7f63c000b790 comp rx=0 tx=0).stop 2023-10-16T19:40:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 shutdown_connections 2023-10-16T19:40:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f63b806c960 0x7f63b806ee20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63cc1f7660 0x7f63cc1f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b8004850 0x7f63cc156330 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b480 tx=0x7f63c000b790 comp rx=0 tx=0).stop 2023-10-16T19:40:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 --2- 172.21.15.29:0/2426289065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63cc1679a0 0x7f63cc167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.271+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 >> 172.21.15.29:0/2426289065 conn(0x7f63cc0a7c20 msgr2=0x7f63cc071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.272+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 shutdown_connections 2023-10-16T19:40:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.272+0000 7f63d35ee700 1 -- 172.21.15.29:0/2426289065 wait complete. 2023-10-16T19:40:21.283 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2023-10-16T19:40:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.276+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 msgr2=0x7f38b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.276+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 0x7f38b006d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f38c40c69d0 tx=0x7f38b8018000 comp rx=0 tx=0).stop 2023-10-16T19:40:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.276+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 msgr2=0x7f38c40875e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.276+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f38bc002050 tx=0x7f38bc00a340 comp rx=0 tx=0).stop 2023-10-16T19:40:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 shutdown_connections 2023-10-16T19:40:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f38b006af00 0x7f38b006d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c40c49a0 0x7f38c41faac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38c40c1200 0x7f38c40875e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 --2- 172.21.15.29:0/3191603734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c40c2f30 0x7f38c41fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.279+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 >> 172.21.15.29:0/3191603734 conn(0x7f38c40a7c20 msgr2=0x7f38c40c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-10-16T19:40:21.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.280+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 shutdown_connections 2023-10-16T19:40:21.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.280+0000 7f38c989f700 1 -- 172.21.15.29:0/3191603734 wait complete. 2023-10-16T19:40:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.281+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f37080055a0 con 0x7f37240c1200 2023-10-16T19:40:21.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.281+0000 7f37217fa700 1 -- 172.21.15.29:0/127693538 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f370c007720 con 0x7f37240c1200 2023-10-16T19:40:21.289 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2023-10-16T19:40:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.284+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 msgr2=0x7f371006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.284+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 0x7f371006d600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3714001f10 tx=0x7f3714009040 comp rx=0 tx=0).stop 2023-10-16T19:40:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.284+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 msgr2=0x7f37240b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.284+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c750 tx=0x7f370c00ca60 comp rx=0 tx=0).stop 2023-10-16T19:40:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 shutdown_connections 2023-10-16T19:40:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f371006b140 0x7f371006d600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37240c2c60 0x7f37240ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f37240a4f20 0x7f37240820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 --2- 172.21.15.29:0/127693538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37240c1200 0x7f37240b9da0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 >> 172.21.15.29:0/127693538 conn(0x7f37240a7c20 msgr2=0x7f37240a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 shutdown_connections 2023-10-16T19:40:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:21.285+0000 7f372a75a700 1 -- 172.21.15.29:0/127693538 wait complete. 2023-10-16T19:40:21.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-10-16T19:40:21.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-10-16T19:40:21.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-10-16T19:40:21.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-10-16T19:40:21.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-10-16T19:40:22.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:40:22.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:40:22.289 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:40:22.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:40:22.297 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:40:22.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:40:22.300 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:40:22.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:40:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.458+0000 7fa5b344c700 1 Processor -- start 2023-10-16T19:40:22.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.458+0000 7fa5b344c700 1 -- start start 2023-10-16T19:40:22.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.459+0000 7fa5b344c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa5ac0c30b0 0x7fa5ac0c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.459+0000 7fa5b344c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac070e10 0x7fa5ac1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.459+0000 7fa5b344c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c1190 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.459+0000 7fa5b344c700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c2000 con 0x7fa5ac0c30b0 2023-10-16T19:40:22.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.460+0000 7fa5b344c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c4c40 con 0x7fa5ac070e10 2023-10-16T19:40:22.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5b09e7700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa5ac0c07f0 0x7fa5ac070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37380/0 (socket says 172.21.15.29:37380) 2023-10-16T19:40:22.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2963793861 learned_addr learned my addr 172.21.15.29:0/2963793861 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5b19e9700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac070e10 0x7fa5ac1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5b11e8700 1 --2- 172.21.15.29:0/2963793861 >> v2:172.21.15.53:3300/0 conn(0x7fa5ac0c30b0 0x7fa5ac0c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251862577 0 0) 0x7fa5ac0c1190 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.462+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5980035b0 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172282104 0 0) 0x7fa5980035b0 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac070e10 msgr2=0x7fa5ac1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac070e10 0x7fa5ac1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 >> v2:172.21.15.53:3300/0 conn(0x7fa5ac0c30b0 msgr2=0x7fa5ac0c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 --2- 172.21.15.29:0/2963793861 >> v2:172.21.15.53:3300/0 conn(0x7fa5ac0c30b0 0x7fa5ac0c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c4f20 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fa5a4001250 con 0x7fa5ac0c07f0 2023-10-16T19:40:22.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 >> v1:172.21.15.29:6789/0 conn(0x7fa5ac0c07f0 legacy=0x7fa5ac070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa598003a00 0x7fa598003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa598004850 0x7fa598004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa598005210 0x7fa59800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c4c40 con 0x7fa598004850 2023-10-16T19:40:22.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa598014870 con 0x7fa598005210 2023-10-16T19:40:22.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.463+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa598014a30 con 0x7fa598003a00 2023-10-16T19:40:22.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa598004850 0x7fa598004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa598003a00 msgr2=0x7fa598003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:22.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa598003a00 0x7fa598003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa598005210 msgr2=0x7fa59800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:40:22.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa598005210 0x7fa59800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.464+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2963793861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c4f20 con 0x7fa598004850 2023-10-16T19:40:22.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.465+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa598004850 0x7fa598004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06ff20 tx=0x7fa598005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b2469d69aec0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.465+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4008310 con 0x7fa598004850 2023-10-16T19:40:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.465+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4008e30 con 0x7fa598004850 2023-10-16T19:40:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.465+0000 7fa5a3fff700 1 -- 172.21.15.29:0/2963793861 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4008470 con 0x7fa598004850 2023-10-16T19:40:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.466+0000 7fa5b344c700 1 -- 172.21.15.29:0/2963793861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa598004850 msgr2=0x7fa598004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.466+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2963793861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa598004850 0x7fa598004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06ff20 tx=0x7fa598005880 comp rx=0 tx=0).stop 2023-10-16T19:40:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.467+0000 7fa5b19e9700 1 -- 172.21.15.29:0/2963793861 reap_dead start 2023-10-16T19:40:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.467+0000 7fa5b344c700 1 -- 172.21.15.29:0/2963793861 shutdown_connections 2023-10-16T19:40:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.467+0000 7fa5b344c700 1 -- 172.21.15.29:0/2963793861 >> 172.21.15.29:0/2963793861 conn(0x7fa5ac0a7c20 msgr2=0x7fa5ac0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.467+0000 7fa5b344c700 1 -- 172.21.15.29:0/2963793861 shutdown_connections 2023-10-16T19:40:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.467+0000 7fa5b344c700 1 -- 172.21.15.29:0/2963793861 wait complete. 2023-10-16T19:40:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.469+0000 7fa5b344c700 1 Processor -- start 2023-10-16T19:40:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.469+0000 7fa5b344c700 1 -- start start 2023-10-16T19:40:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5ac0bb420 0x7fa5ac150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac151430 0x7fa5ac0b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1dc9b0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1dcc90 con 0x7fa5ac0bb420 2023-10-16T19:40:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.470+0000 7fa5b344c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1dcf70 con 0x7fa5ac151430 2023-10-16T19:40:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51944/0 (socket says 172.21.15.29:51944) 2023-10-16T19:40:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2514448597 learned_addr learned my addr 172.21.15.29:0/2514448597 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac151430 msgr2=0x7fa5ac0b9dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac151430 0x7fa5ac0b9dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5ac0bb420 msgr2=0x7fa5ac150220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.471+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5ac0bb420 0x7fa5ac150220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.472+0000 7fa5b09e7700 1 -- 172.21.15.29:0/2514448597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac150ca0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.472+0000 7fa5b09e7700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000f80 tx=0x7fa5a4005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.473+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4005950 con 0x7fa5ac0bb800 2023-10-16T19:40:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.473+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4005ad0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.473+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4005e80 con 0x7fa5ac0bb800 2023-10-16T19:40:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.473+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0a76b0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.473+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac0ba310 con 0x7fa5ac0bb800 2023-10-16T19:40:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.476+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5a4015420 con 0x7fa5ac0bb800 2023-10-16T19:40:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.476+0000 7fa5a1ffb700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 0x7fa59006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.476+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5a408af80 con 0x7fa5ac0bb800 2023-10-16T19:40:22.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.477+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c0052f0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.481+0000 7fa5b11e8700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 0x7fa59006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.486+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5a4026080 con 0x7fa5ac0bb800 2023-10-16T19:40:22.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.491+0000 7fa5b11e8700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 0x7fa59006d490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0a7340 tx=0x7fa5a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.492+0000 7f76d0a21700 1 Processor -- start 2023-10-16T19:40:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.492+0000 7f76d0a21700 1 -- start start 2023-10-16T19:40:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76d0a21700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 0x7f76cc071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76d0a21700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76cc0c3d70 0x7f76cc0a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76d0a21700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0c2a50 con 0x7f76cc0726d0 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76d0a21700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc071690 con 0x7f76cc0c3d70 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76d0a21700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c1e40 con 0x7f76cc06d790 2023-10-16T19:40:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76ca59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f76cc0726d0 0x7f76cc0c2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37400/0 (socket says 172.21.15.29:37400) 2023-10-16T19:40:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.493+0000 7f76ca59c700 1 -- 172.21.15.29:0/3110344905 learned_addr learned my addr 172.21.15.29:0/3110344905 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.494+0000 7f76cad9d700 1 --2- 172.21.15.29:0/3110344905 >> v2:172.21.15.53:3300/0 conn(0x7f76cc0c3d70 0x7f76cc0a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.494+0000 7f76c9d9b700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 0x7f76cc071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669326573 0 0) 0x7f76cc0c2a50 con 0x7f76cc0726d0 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b40035b0 con 0x7f76cc0726d0 2023-10-16T19:40:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350938270 0 0) 0x7f76b40035b0 con 0x7f76cc0726d0 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76cad9d700 1 -- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 msgr2=0x7f76cc071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76cad9d700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 0x7f76cc071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76cad9d700 1 -- 172.21.15.29:0/3110344905 >> v1:172.21.15.29:6789/0 conn(0x7f76cc0726d0 legacy=0x7f76cc0c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76cad9d700 1 -- 172.21.15.29:0/3110344905 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0c2120 con 0x7f76cc0c3d70 2023-10-16T19:40:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.495+0000 7f76c9d9b700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 0x7f76cc071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.496+0000 7ff366695700 1 Processor -- start 2023-10-16T19:40:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.496+0000 7ff366695700 1 -- start start 2023-10-16T19:40:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7f76cad9d700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc0c3d70 0x7f76cc0a4da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d9ddff63988d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400e070 con 0x7f76cc0c3d70 2023-10-16T19:40:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4003a20 con 0x7f76cc0c3d70 2023-10-16T19:40:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7f76c959a700 1 -- 172.21.15.29:0/3110344905 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0016c0 con 0x7f76cc0c3d70 2023-10-16T19:40:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff366695700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3600726d0 0x7ff3600c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff366695700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3600c3420 0x7ff3600a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff366695700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600c2a50 con 0x7ff36006d790 2023-10-16T19:40:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff366695700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600c1e40 con 0x7ff3600c3420 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff366695700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600c2120 con 0x7ff3600726d0 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff364c32700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff36006d790 0x7ff360070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37404/0 (socket says 172.21.15.29:37404) 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.497+0000 7ff364c32700 1 -- 172.21.15.29:0/2734157125 learned_addr learned my addr 172.21.15.29:0/2734157125 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960079833 0 0) 0x7ff3600c2a50 con 0x7ff36006d790 2023-10-16T19:40:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3480035b0 con 0x7ff36006d790 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 -- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc0c3d70 msgr2=0x7f76cc0a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc0c3d70 0x7f76cc0a4da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c400b330 comp rx=0 tx=0).stop 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 -- 172.21.15.29:0/3110344905 shutdown_connections 2023-10-16T19:40:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc0c3d70 0x7f76cc0a4da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 --2- 172.21.15.29:0/3110344905 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc06d790 0x7f76cc071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.498+0000 7f76d0a21700 1 -- 172.21.15.29:0/3110344905 >> 172.21.15.29:0/3110344905 conn(0x7f76cc0a7c20 msgr2=0x7f76cc0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378346291 0 0) 0x7ff3480035b0 con 0x7ff36006d790 2023-10-16T19:40:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 >> v2:172.21.15.53:3300/0 conn(0x7ff3600726d0 msgr2=0x7ff3600c2ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 --2- 172.21.15.29:0/2734157125 >> v2:172.21.15.53:3300/0 conn(0x7ff3600726d0 0x7ff3600c2ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 >> v2:172.21.15.29:3300/0 conn(0x7ff3600c3420 msgr2=0x7ff3600a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/2734157125 >> v2:172.21.15.29:3300/0 conn(0x7ff3600c3420 0x7ff3600a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7f76d0a21700 1 -- 172.21.15.29:0/3110344905 shutdown_connections 2023-10-16T19:40:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7f76d0a21700 1 -- 172.21.15.29:0/3110344905 wait complete. 2023-10-16T19:40:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 --2- 172.21.15.29:0/2734157125 >> v2:172.21.15.29:3300/0 conn(0x7ff3600c3420 0x7ff3600a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600c2400 con 0x7ff36006d790 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7ff3580019f0 con 0x7ff36006d790 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 >> v1:172.21.15.29:6789/0 conn(0x7ff36006d790 legacy=0x7ff360070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff348003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff348004850 0x7ff348004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff348005330 0x7ff34800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600c1e40 con 0x7ff348003a00 2023-10-16T19:40:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600c2120 con 0x7ff348005330 2023-10-16T19:40:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34800c2b0 con 0x7ff348004850 2023-10-16T19:40:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/2734157125 >> v2:172.21.15.29:3300/0 conn(0x7ff3600c3420 0x7ff3600a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.499+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff348004850 0x7ff348004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.500+0000 7ff364c32700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff348005330 0x7ff34800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff348003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7f76d0a21700 1 Processor -- start 2023-10-16T19:40:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 -- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff348004850 msgr2=0x7ff348004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff348004850 0x7ff348004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 -- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff348005330 msgr2=0x7ff34800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff348005330 0x7ff34800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7ff35ffff700 1 -- 172.21.15.29:0/2734157125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600c2400 con 0x7ff348003a00 2023-10-16T19:40:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7ff364c32700 1 -- 172.21.15.29:0/2734157125 reap_dead start 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7ff35ffff700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff348003e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff348005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c8e34a6e644e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350015070 con 0x7ff348003a00 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff350005a70 con 0x7ff348003a00 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7ff35effd700 1 -- 172.21.15.29:0/2734157125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350005e00 con 0x7ff348003a00 2023-10-16T19:40:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.503+0000 7ff366695700 1 -- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 msgr2=0x7ff348003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.503+0000 7ff366695700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff348003e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff348005880 comp rx=0 tx=0).stop 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.501+0000 7f76d0a21700 1 -- start start 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76cc0726d0 0x7f76cc15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc0c3d70 0x7f76cc0beca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0b8ff0 con 0x7f76cc0726d0 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0b6200 con 0x7f76cc06d790 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.502+0000 7f76d0a21700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0b5f20 con 0x7f76cc0c3d70 2023-10-16T19:40:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.503+0000 7f76ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.503+0000 7f76ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42256/0 (socket says 172.21.15.29:42256) 2023-10-16T19:40:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.503+0000 7f76ca59c700 1 -- 172.21.15.29:0/1650440983 learned_addr learned my addr 172.21.15.29:0/1650440983 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.504+0000 7ff366695700 1 -- 172.21.15.29:0/2734157125 shutdown_connections 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.504+0000 7ff366695700 1 --2- 172.21.15.29:0/2734157125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff348003e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.504+0000 7ff366695700 1 -- 172.21.15.29:0/2734157125 >> 172.21.15.29:0/2734157125 conn(0x7ff3600a7c20 msgr2=0x7ff3600a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.504+0000 7ff366695700 1 -- 172.21.15.29:0/2734157125 shutdown_connections 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.504+0000 7ff366695700 1 -- 172.21.15.29:0/2734157125 wait complete. 2023-10-16T19:40:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.506+0000 7ff366695700 1 Processor -- start 2023-10-16T19:40:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76cad9d700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc0c3d70 0x7f76cc0beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76ca59c700 1 -- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc0c3d70 msgr2=0x7f76cc0beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76ca59c700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc0c3d70 0x7f76cc0beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76ca59c700 1 -- 172.21.15.29:0/1650440983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76cc0726d0 msgr2=0x7f76cc15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76ca59c700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76cc0726d0 0x7f76cc15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.505+0000 7f76ca59c700 1 -- 172.21.15.29:0/1650440983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009a70 con 0x7f76cc06d790 2023-10-16T19:40:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.506+0000 7f76ca59c700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c520 tx=0x7f76bc00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.506+0000 7ff366695700 1 -- start start 2023-10-16T19:40:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.507+0000 7ff366695700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff3601f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7ff366695700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7ff366695700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff360157160 0x7ff3601575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7ff366695700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600ab6c0 con 0x7ff348003a00 2023-10-16T19:40:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7ff366695700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360157b20 con 0x7ff360157160 2023-10-16T19:40:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7ff366695700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360159790 con 0x7ff3601ef250 2023-10-16T19:40:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc004c80 con 0x7f76cc06d790 2023-10-16T19:40:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc004e00 con 0x7f76cc06d790 2023-10-16T19:40:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc007310 con 0x7f76cc06d790 2023-10-16T19:40:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc0b8c80 con 0x7f76cc06d790 2023-10-16T19:40:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.508+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc15ccc0 con 0x7f76cc06d790 2023-10-16T19:40:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44432/0 (socket says 172.21.15.29:44432) 2023-10-16T19:40:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 -- 172.21.15.29:0/3841840154 learned_addr learned my addr 172.21.15.29:0/3841840154 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff364c32700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff360157160 0x7ff3601575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35ffff700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff3601f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 -- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff360157160 msgr2=0x7ff3601575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff360157160 0x7ff3601575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 -- 172.21.15.29:0/3841840154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 msgr2=0x7ff3601f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff3601f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.509+0000 7ff35f7fe700 1 -- 172.21.15.29:0/3841840154 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36015a310 con 0x7ff3601ef250 2023-10-16T19:40:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff35f7fe700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff35400f4c0 tx=0x7ff35400f880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc04f400 con 0x7f76cc06d790 2023-10-16T19:40:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354014890 con 0x7ff3601ef250 2023-10-16T19:40:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35400c030 con 0x7ff3601ef250 2023-10-16T19:40:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354014c30 con 0x7ff3601ef250 2023-10-16T19:40:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3601ef6d0 con 0x7ff3601ef250 2023-10-16T19:40:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.510+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3601599e0 con 0x7ff3601ef250 2023-10-16T19:40:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.511+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f76bc007470 con 0x7f76cc06d790 2023-10-16T19:40:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.511+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c0052f0 con 0x7ff3601ef250 2023-10-16T19:40:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.512+0000 7f76baffd700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 0x7f76ac06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.512+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76bc0896c0 con 0x7f76cc06d790 2023-10-16T19:40:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.513+0000 7f76c9d9b700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 0x7f76ac06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.513+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3540133e0 con 0x7ff3601ef250 2023-10-16T19:40:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.513+0000 7ff35cff9700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 0x7ff34406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.513+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff354091350 con 0x7ff3601ef250 2023-10-16T19:40:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.514+0000 7ff35ffff700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 0x7ff34406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.514+0000 7f76c9d9b700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 0x7f76ac06d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76c0006fd0 tx=0x7f76c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.514+0000 7ff35ffff700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 0x7ff34406d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff350013040 tx=0x7ff350010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.518+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76bc0544f0 con 0x7f76cc06d790 2023-10-16T19:40:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.518+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff35408e060 con 0x7ff3601ef250 2023-10-16T19:40:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.556+0000 7f397ea59700 1 Processor -- start 2023-10-16T19:40:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.556+0000 7f397ea59700 1 -- start start 2023-10-16T19:40:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.557+0000 7f397ea59700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f39780c5660 0x7f397806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.557+0000 7f397ea59700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.557+0000 7f397ea59700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39780c3d70 con 0x7f39780ab9a0 2023-10-16T19:40:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.557+0000 7f397ea59700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3978156230 con 0x7f39780c5660 2023-10-16T19:40:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.557+0000 7f397ea59700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3978156510 con 0x7f3978155da0 2023-10-16T19:40:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44440/0 (socket says 172.21.15.29:44440) 2023-10-16T19:40:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 -- 172.21.15.29:0/2975296890 learned_addr learned my addr 172.21.15.29:0/2975296890 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f3977fff700 1 --2- 172.21.15.29:0/2975296890 >> v2:172.21.15.29:3300/0 conn(0x7f39780c5660 0x7f397806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 -- 172.21.15.29:0/2975296890 >> v2:172.21.15.29:3300/0 conn(0x7f39780c5660 msgr2=0x7f397806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 --2- 172.21.15.29:0/2975296890 >> v2:172.21.15.29:3300/0 conn(0x7f39780c5660 0x7f397806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 -- 172.21.15.29:0/2975296890 >> v1:172.21.15.29:6789/0 conn(0x7f39780ab9a0 legacy=0x7f39780c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 -- 172.21.15.29:0/2975296890 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39781567f0 con 0x7f3978155da0 2023-10-16T19:40:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.558+0000 7f397cff6700 1 --2- 172.21.15.29:0/2975296890 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fc44de662c1ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.559+0000 7f3976ffd700 1 -- 172.21.15.29:0/2975296890 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000e070 con 0x7f3978155da0 2023-10-16T19:40:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.559+0000 7f3976ffd700 1 -- 172.21.15.29:0/2975296890 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000b910 con 0x7f3978155da0 2023-10-16T19:40:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.559+0000 7f3976ffd700 1 -- 172.21.15.29:0/2975296890 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000bcc0 con 0x7f3978155da0 2023-10-16T19:40:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 -- 172.21.15.29:0/2975296890 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 msgr2=0x7f397806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 --2- 172.21.15.29:0/2975296890 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).stop 2023-10-16T19:40:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 -- 172.21.15.29:0/2975296890 shutdown_connections 2023-10-16T19:40:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 --2- 172.21.15.29:0/2975296890 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3978155da0 0x7f397806c820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 --2- 172.21.15.29:0/2975296890 >> v2:172.21.15.29:3300/0 conn(0x7f39780c5660 0x7f397806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.560+0000 7f397ea59700 1 -- 172.21.15.29:0/2975296890 >> 172.21.15.29:0/2975296890 conn(0x7f39780a7c20 msgr2=0x7f39780a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.563+0000 7f397ea59700 1 -- 172.21.15.29:0/2975296890 shutdown_connections 2023-10-16T19:40:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.564+0000 7f397ea59700 1 -- 172.21.15.29:0/2975296890 wait complete. 2023-10-16T19:40:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.565+0000 7f397ea59700 1 Processor -- start 2023-10-16T19:40:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.567+0000 7f397ea59700 1 -- start start 2023-10-16T19:40:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39780c5660 0x7f397814cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f39780bcf40 0x7f397814d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780bc7d0 con 0x7f39780ab9a0 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39781eb6c0 con 0x7f39780c5660 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f397ea59700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39781eadd0 con 0x7f39780bcf40 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f3977fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f3977fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51992/0 (socket says 172.21.15.29:51992) 2023-10-16T19:40:22.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.568+0000 7f3977fff700 1 -- 172.21.15.29:0/4139305588 learned_addr learned my addr 172.21.15.29:0/4139305588 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 -- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f39780bcf40 msgr2=0x7f397814d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f39780bcf40 0x7f397814d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 -- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39780c5660 msgr2=0x7f397814cd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:40:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39780c5660 0x7f397814cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 -- 172.21.15.29:0/4139305588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970009b30 con 0x7f39780ab9a0 2023-10-16T19:40:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.569+0000 7f3977fff700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e9c0 tx=0x7f396c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.570+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00c7f0 con 0x7f39780ab9a0 2023-10-16T19:40:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.570+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c00c950 con 0x7f39780ab9a0 2023-10-16T19:40:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.570+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00ccc0 con 0x7f39780ab9a0 2023-10-16T19:40:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.570+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39781e86a0 con 0x7f39780ab9a0 2023-10-16T19:40:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.570+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39781eb350 con 0x7f39780ab9a0 2023-10-16T19:40:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.571+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397804f400 con 0x7f39780ab9a0 2023-10-16T19:40:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.573+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f396c013470 con 0x7f39780ab9a0 2023-10-16T19:40:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.573+0000 7f3974ff9700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 0x7f396406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.573+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f396c089ce0 con 0x7f39780ab9a0 2023-10-16T19:40:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.574+0000 7f39777fe700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 0x7f396406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.574+0000 7f92b0189700 1 Processor -- start 2023-10-16T19:40:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.574+0000 7f9a3a421700 1 Processor -- start 2023-10-16T19:40:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.574+0000 7f92b0189700 1 -- start start 2023-10-16T19:40:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.575+0000 7f9a3a421700 1 -- start start 2023-10-16T19:40:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f6c4d4f9700 1 Processor -- start 2023-10-16T19:40:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.575+0000 7f92b0189700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92a80c30b0 0x7f92a80c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.575+0000 7f92b0189700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a80c07f0 0x7f92a8070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92b0189700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a80c1190 con 0x7f92a8070c40 2023-10-16T19:40:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92b0189700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a80c2000 con 0x7f92a80c30b0 2023-10-16T19:40:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92b0189700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80c4c40 con 0x7f92a80c07f0 2023-10-16T19:40:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92ad724700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a80c07f0 0x7f92a8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92ae726700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f92a8070c40 0x7f92a806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37446/0 (socket says 172.21.15.29:37446) 2023-10-16T19:40:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92ae726700 1 -- 172.21.15.29:0/4108037765 learned_addr learned my addr 172.21.15.29:0/4108037765 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f9a3a421700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a34156320 0x7f9a34159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f9a3a421700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340c8130 0x7f9a340ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f9a3a421700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a340c4bb0 con 0x7f9a340caa30 2023-10-16T19:40:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f9a3a421700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340c4e90 con 0x7f9a340c8130 2023-10-16T19:40:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f9a3a421700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340c5170 con 0x7f9a34156320 2023-10-16T19:40:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f6c4d4f9700 1 -- start start 2023-10-16T19:40:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.576+0000 7f92adf25700 1 --2- 172.21.15.29:0/4108037765 >> v2:172.21.15.53:3300/0 conn(0x7f92a80c30b0 0x7f92a80c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f9a337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340c8130 0x7f9a340ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f9a337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340c8130 0x7f9a340ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42292/0 (socket says 172.21.15.29:42292) 2023-10-16T19:40:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f9a337fe700 1 -- 172.21.15.29:0/282279623 learned_addr learned my addr 172.21.15.29:0/282279623 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92adf25700 1 -- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a80c07f0 msgr2=0x7f92a8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92adf25700 1 --2- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a80c07f0 0x7f92a8070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92adf25700 1 -- 172.21.15.29:0/4108037765 >> v1:172.21.15.29:6789/0 conn(0x7f92a8070c40 legacy=0x7f92a806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92adf25700 1 -- 172.21.15.29:0/4108037765 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80c4f20 con 0x7f92a80c30b0 2023-10-16T19:40:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f39777fe700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 0x7f396406d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3968000f60 tx=0x7f3968007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92adf25700 1 --2- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a80c53b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009820 tx=0x7f92a4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9fdcfb944ad1628 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f6c4d4f9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 0x7f6c480c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f6c4d4f9700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c480c07f0 0x7f6c48070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f6c4d4f9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480c1190 con 0x7f6c48070c40 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f6c4d4f9700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480c2000 con 0x7f6c480c07f0 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f6c4d4f9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480c4c40 con 0x7f6c480c30b0 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 0x7f6c480c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c477fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6c48070c40 0x7f6c4806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37456/0 (socket says 172.21.15.29:37456) 2023-10-16T19:40:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c477fe700 1 -- 172.21.15.29:0/3823400982 learned_addr learned my addr 172.21.15.29:0/3823400982 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.577+0000 7f92acf23700 1 -- 172.21.15.29:0/4108037765 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4005e30 con 0x7f92a80c30b0 2023-10-16T19:40:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f92acf23700 1 -- 172.21.15.29:0/4108037765 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4006030 con 0x7f92a80c30b0 2023-10-16T19:40:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f92acf23700 1 -- 172.21.15.29:0/4108037765 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40063c0 con 0x7f92a80c30b0 2023-10-16T19:40:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f9a33fff700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a34156320 0x7f9a34159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c467fc700 1 --2- 172.21.15.29:0/3823400982 >> v2:172.21.15.53:3300/0 conn(0x7f6c480c07f0 0x7f6c48070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 -- 172.21.15.29:0/3823400982 >> v2:172.21.15.53:3300/0 conn(0x7f6c480c07f0 msgr2=0x7f6c48070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 --2- 172.21.15.29:0/3823400982 >> v2:172.21.15.53:3300/0 conn(0x7f6c480c07f0 0x7f6c48070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 -- 172.21.15.29:0/3823400982 >> v1:172.21.15.29:6789/0 conn(0x7f6c48070c40 legacy=0x7f6c4806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 -- 172.21.15.29:0/3823400982 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480c4f20 con 0x7f6c480c30b0 2023-10-16T19:40:22.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c46ffd700 1 --2- 172.21.15.29:0/3823400982 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 0x7f6c480c53b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009820 tx=0x7f6c38009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cdb4899cdb4175 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c45ffb700 1 -- 172.21.15.29:0/3823400982 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38005e30 con 0x7f6c480c30b0 2023-10-16T19:40:22.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c45ffb700 1 -- 172.21.15.29:0/3823400982 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38006030 con 0x7f6c480c30b0 2023-10-16T19:40:22.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.578+0000 7f6c45ffb700 1 -- 172.21.15.29:0/3823400982 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380063e0 con 0x7f6c480c30b0 2023-10-16T19:40:22.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 -- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 msgr2=0x7f92a80c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 --2- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a80c53b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009820 tx=0x7f92a4009b30 comp rx=0 tx=0).stop 2023-10-16T19:40:22.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 -- 172.21.15.29:0/4108037765 shutdown_connections 2023-10-16T19:40:22.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 --2- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a80c53b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 --2- 172.21.15.29:0/4108037765 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a80c07f0 0x7f92a8070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 -- 172.21.15.29:0/4108037765 >> 172.21.15.29:0/4108037765 conn(0x7f92a80a7c20 msgr2=0x7f92a80a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f36dcdcb700 1 Processor -- start 2023-10-16T19:40:22.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 -- 172.21.15.29:0/4108037765 shutdown_connections 2023-10-16T19:40:22.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f92b0189700 1 -- 172.21.15.29:0/4108037765 wait complete. 2023-10-16T19:40:22.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/3823400982 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 msgr2=0x7f6c480c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/3823400982 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 0x7f6c480c53b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009820 tx=0x7f6c38009b30 comp rx=0 tx=0).stop 2023-10-16T19:40:22.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/3823400982 shutdown_connections 2023-10-16T19:40:22.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/3823400982 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c30b0 0x7f6c480c53b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/3823400982 >> v2:172.21.15.53:3300/0 conn(0x7f6c480c07f0 0x7f6c48070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/3823400982 >> 172.21.15.29:0/3823400982 conn(0x7f6c480a7c20 msgr2=0x7f6c480a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/3823400982 shutdown_connections 2023-10-16T19:40:22.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.579+0000 7f36dcdcb700 1 -- start start 2023-10-16T19:40:22.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f36dcdcb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c30b0 0x7f36d80c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f36dcdcb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36d80c07f0 0x7f36d8070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f36dcdcb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d80c1190 con 0x7f36d8070c40 2023-10-16T19:40:22.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f36dcdcb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80c2000 con 0x7f36d80c07f0 2023-10-16T19:40:22.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f36dcdcb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80c4c40 con 0x7f36d80c30b0 2023-10-16T19:40:22.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d6d9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36d8070c40 0x7f36d806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:60288/0 (socket says 172.21.15.29:60288) 2023-10-16T19:40:22.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d6d9d700 1 -- 172.21.15.29:0/2578752435 learned_addr learned my addr 172.21.15.29:0/2578752435 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:22.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f92b0189700 1 Processor -- start 2023-10-16T19:40:22.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d5d9b700 1 --2- 172.21.15.29:0/2578752435 >> v2:172.21.15.53:3300/0 conn(0x7f36d80c07f0 0x7f36d8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f92b0189700 1 -- start start 2023-10-16T19:40:22.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.580+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/3823400982 wait complete. 2023-10-16T19:40:22.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f6c4d4f9700 1 Processor -- start 2023-10-16T19:40:22.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d5d9b700 1 -- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c30b0 msgr2=0x7f36d80c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d5d9b700 1 --2- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c30b0 0x7f36d80c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d5d9b700 1 -- 172.21.15.29:0/2578752435 >> v1:172.21.15.53:6789/0 conn(0x7f36d8070c40 legacy=0x7f36d806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.581+0000 7f36d5d9b700 1 -- 172.21.15.29:0/2578752435 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80c4f20 con 0x7f36d80c07f0 2023-10-16T19:40:22.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f36d5d9b700 1 --2- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d80c07f0 0x7f36d8070700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009840 tx=0x7f36cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8960e1d849f3ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 0x7f92a80bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92a80c07f0 0x7f92a81e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80bc7b0 con 0x7f92a80c07f0 2023-10-16T19:40:22.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80be040 con 0x7f92a80c30b0 2023-10-16T19:40:22.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92b0189700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80ab6e0 con 0x7f92a8070c40 2023-10-16T19:40:22.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92ae726700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92adf25700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 0x7f92a80bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92ae726700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42310/0 (socket says 172.21.15.29:42310) 2023-10-16T19:40:22.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92adf25700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 0x7f92a80bfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44480/0 (socket says 172.21.15.29:44480) 2023-10-16T19:40:22.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92ae726700 1 -- 172.21.15.29:0/4128545997 learned_addr learned my addr 172.21.15.29:0/4128545997 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f92ad724700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92a80c07f0 0x7f92a81e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f6c4d4f9700 1 -- start start 2023-10-16T19:40:22.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f36d559a700 1 -- 172.21.15.29:0/2578752435 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00c900 con 0x7f36d80c07f0 2023-10-16T19:40:22.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f36d559a700 1 -- 172.21.15.29:0/2578752435 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00ca60 con 0x7f36d80c07f0 2023-10-16T19:40:22.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.582+0000 7f36d559a700 1 -- 172.21.15.29:0/2578752435 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00cdd0 con 0x7f36d80c07f0 2023-10-16T19:40:22.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 -- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 msgr2=0x7f92a80bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 0x7f92a80bfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 -- 172.21.15.29:0/4128545997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92a80c07f0 msgr2=0x7f92a81e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92a80c07f0 0x7f92a81e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 -- 172.21.15.29:0/4128545997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4009430 con 0x7f92a80c30b0 2023-10-16T19:40:22.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c07f0 0x7f6c4814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c480c30b0 0x7f6c481fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481fa770 con 0x7f6c480c30b0 2023-10-16T19:40:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480bf1b0 con 0x7f6c48070c40 2023-10-16T19:40:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c4d4f9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480bf490 con 0x7f6c480c07f0 2023-10-16T19:40:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f36dcdcb700 1 -- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d80c07f0 msgr2=0x7f36d8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d80c07f0 0x7f36d8070700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009840 tx=0x7f36cc009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f396c054b10 con 0x7f39780ab9a0 2023-10-16T19:40:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f9a337fe700 1 -- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a34156320 msgr2=0x7f9a34159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f9a337fe700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a34156320 0x7f9a34159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f9a337fe700 1 -- 172.21.15.29:0/282279623 >> v1:172.21.15.29:6789/0 conn(0x7f9a340caa30 legacy=0x7f9a3415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f9a337fe700 1 -- 172.21.15.29:0/282279623 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3415c390 con 0x7f9a340c8130 2023-10-16T19:40:22.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c46ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c46ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42314/0 (socket says 172.21.15.29:42314) 2023-10-16T19:40:22.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c46ffd700 1 -- 172.21.15.29:0/2419376849 learned_addr learned my addr 172.21.15.29:0/2419376849 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f92ae726700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c9f0 tx=0x7f92a000cd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c467fc700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c07f0 0x7f6c4814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.583+0000 7f6c477fe700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c480c30b0 0x7f6c481fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 -- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c07f0 msgr2=0x7f6c4814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c07f0 0x7f6c4814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 -- 172.21.15.29:0/2419376849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c480c30b0 msgr2=0x7f6c481fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c480c30b0 0x7f6c481fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 -- 172.21.15.29:0/2419376849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009430 con 0x7f6c48070c40 2023-10-16T19:40:22.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.584+0000 7f6c46ffd700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009b70 tx=0x7f6c38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f36dcdcb700 1 -- 172.21.15.29:0/2578752435 shutdown_connections 2023-10-16T19:40:22.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c30b0 0x7f36d80c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/2578752435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d80c07f0 0x7f36d8070700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f36dcdcb700 1 -- 172.21.15.29:0/2578752435 >> 172.21.15.29:0/2578752435 conn(0x7f36d80a7c20 msgr2=0x7f36d80a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000a9e0 con 0x7f92a80c30b0 2023-10-16T19:40:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a000ce90 con 0x7f92a80c30b0 2023-10-16T19:40:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a80ab9c0 con 0x7f92a80c30b0 2023-10-16T19:40:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000ad60 con 0x7f92a80c30b0 2023-10-16T19:40:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.585+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a80bdcd0 con 0x7f92a80c30b0 2023-10-16T19:40:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.586+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a80be1b0 con 0x7f92a80c30b0 2023-10-16T19:40:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.586+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92a001c440 con 0x7f92a80c30b0 2023-10-16T19:40:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.587+0000 7f929e7fc700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 0x7f929406d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.587+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92a0089550 con 0x7f92a80c30b0 2023-10-16T19:40:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.587+0000 7f92adf25700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 0x7f929406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.588+0000 7f9a337fe700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340ca4f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a280098f0 tx=0x7f9a28009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166d5189ec53888c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.588+0000 7f92adf25700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 0x7f929406d580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92a4007fd0 tx=0x7f92a4008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f36dcdcb700 1 -- 172.21.15.29:0/2578752435 shutdown_connections 2023-10-16T19:40:22.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f9a32ffd700 1 -- 172.21.15.29:0/282279623 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28004230 con 0x7f9a340c8130 2023-10-16T19:40:22.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f9a32ffd700 1 -- 172.21.15.29:0/282279623 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28004390 con 0x7f9a340c8130 2023-10-16T19:40:22.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f9a32ffd700 1 -- 172.21.15.29:0/282279623 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280036a0 con 0x7f9a340c8130 2023-10-16T19:40:22.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92a0054380 con 0x7f92a80c30b0 2023-10-16T19:40:22.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.591+0000 7f36dcdcb700 1 -- 172.21.15.29:0/2578752435 wait complete. 2023-10-16T19:40:22.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.592+0000 7f9a3a421700 1 -- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 msgr2=0x7f9a340ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.592+0000 7f9a3a421700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340ca4f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a280098f0 tx=0x7f9a28009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:22.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.593+0000 7f36dcdcb700 1 Processor -- start 2023-10-16T19:40:22.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.593+0000 7f36dcdcb700 1 -- start start 2023-10-16T19:40:22.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 0x7f36d81eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f9a3a421700 1 -- 172.21.15.29:0/282279623 shutdown_connections 2023-10-16T19:40:22.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f9a3a421700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a34156320 0x7f9a34159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f9a3a421700 1 --2- 172.21.15.29:0/282279623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340ca4f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f9a3a421700 1 -- 172.21.15.29:0/282279623 >> 172.21.15.29:0/282279623 conn(0x7f9a34072190 msgr2=0x7f9a340725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c07f0 0x7f36d80bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80be200 con 0x7f36d80c30b0 2023-10-16T19:40:22.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80ba5c0 con 0x7f36d8070c40 2023-10-16T19:40:22.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.594+0000 7f36dcdcb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d81dc410 con 0x7f36d80c07f0 2023-10-16T19:40:22.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52040/0 (socket says 172.21.15.29:52040) 2023-10-16T19:40:22.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 -- 172.21.15.29:0/4194783456 learned_addr learned my addr 172.21.15.29:0/4194783456 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d659c700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 0x7f36d81eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 -- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c07f0 msgr2=0x7f36d80bc5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:40:22.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c07f0 0x7f36d80bc5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 -- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 msgr2=0x7f36d81eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 0x7f36d81eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 -- 172.21.15.29:0/4194783456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc0094a0 con 0x7f36d80c30b0 2023-10-16T19:40:22.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d659c700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 0x7f36d81eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:22.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.595+0000 7f36d6d9d700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36d0001a50 tx=0x7f36d0001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f9a3a421700 1 -- 172.21.15.29:0/282279623 shutdown_connections 2023-10-16T19:40:22.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f9a3a421700 1 -- 172.21.15.29:0/282279623 wait complete. 2023-10-16T19:40:22.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3801f070 con 0x7f6c48070c40 2023-10-16T19:40:22.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38004260 con 0x7f6c48070c40 2023-10-16T19:40:22.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c480bf770 con 0x7f6c48070c40 2023-10-16T19:40:22.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0006550 con 0x7f36d80c30b0 2023-10-16T19:40:22.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00066b0 con 0x7f36d80c30b0 2023-10-16T19:40:22.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0006a60 con 0x7f36d80c30b0 2023-10-16T19:40:22.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.597+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d80bef90 con 0x7f36d80c30b0 2023-10-16T19:40:22.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.597+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d8151ca0 con 0x7f36d80c30b0 2023-10-16T19:40:22.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.600+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36d0006bc0 con 0x7f36d80c30b0 2023-10-16T19:40:22.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.601+0000 7f36c6ffd700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 0x7f36b8071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.601+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36d0089850 con 0x7f36d80c30b0 2023-10-16T19:40:22.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.601+0000 7f36d659c700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 0x7f36b8071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.602+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d80bed60 con 0x7f36d80c30b0 2023-10-16T19:40:22.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.602+0000 7f36d659c700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 0x7f36b8071820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009de0 tx=0x7f36c8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.596+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4814e550 con 0x7f6c48070c40 2023-10-16T19:40:22.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.604+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c480bfc90 con 0x7f6c48070c40 2023-10-16T19:40:22.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.598+0000 7f9a3a421700 1 Processor -- start 2023-10-16T19:40:22.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.607+0000 7f9a3a421700 1 -- start start 2023-10-16T19:40:22.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a340caa30 0x7f9a341eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 0x7f9a341ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34152200 con 0x7f9a34156320 2023-10-16T19:40:22.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340c1300 con 0x7f9a340c8130 2023-10-16T19:40:22.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a3a421700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341588b0 con 0x7f9a340caa30 2023-10-16T19:40:22.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42330/0 (socket says 172.21.15.29:42330) 2023-10-16T19:40:22.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a33fff700 1 -- 172.21.15.29:0/3619711718 learned_addr learned my addr 172.21.15.29:0/3619711718 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:22.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.608+0000 7f9a389be700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 0x7f9a341ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a337fe700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a340caa30 0x7f9a341eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380045f0 con 0x7f6c48070c40 2023-10-16T19:40:22.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c380036a0 con 0x7f6c48070c40 2023-10-16T19:40:22.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f6c2f7fe700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 0x7f6c3406d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c3808ad00 con 0x7f6c48070c40 2023-10-16T19:40:22.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f6c467fc700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 0x7f6c3406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c480bfc90 con 0x7f6c48070c40 2023-10-16T19:40:22.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 -- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a340caa30 msgr2=0x7f9a341eb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a340caa30 0x7f9a341eb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 -- 172.21.15.29:0/3619711718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 msgr2=0x7f9a341ebc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 0x7f9a341ebc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 -- 172.21.15.29:0/3619711718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28009550 con 0x7f9a340c8130 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a389be700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 0x7f9a341ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.609+0000 7f9a33fff700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e870 tx=0x7f9a2400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24013680 con 0x7f9a340c8130 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240137e0 con 0x7f9a340c8130 2023-10-16T19:40:22.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24013b50 con 0x7f9a340c8130 2023-10-16T19:40:22.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f6c467fc700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 0x7f6c3406d510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c481f9710 tx=0x7f6c3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a341eeed0 con 0x7f9a340c8130 2023-10-16T19:40:22.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.610+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a340c1550 con 0x7f9a340c8130 2023-10-16T19:40:22.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.612+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a24013cb0 con 0x7f9a340c8130 2023-10-16T19:40:22.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.612+0000 7f9a30ff9700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 0x7f9a2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:22.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.613+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a24089790 con 0x7f9a340c8130 2023-10-16T19:40:22.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.611+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36d80bed60 con 0x7f36d80c30b0 2023-10-16T19:40:22.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.620+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a140052f0 con 0x7f9a340c8130 2023-10-16T19:40:22.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.620+0000 7f9a337fe700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 0x7f9a2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:22.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.624+0000 7f9a337fe700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 0x7f9a2006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a340c8590 tx=0x7f9a28008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:22.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.625+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a24054540 con 0x7f9a340c8130 2023-10-16T19:40:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.907+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa58c0055a0 con 0x7fa5ac0bb800 2023-10-16T19:40:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.908+0000 7fa5a1ffb700 1 -- 172.21.15.29:0/2514448597 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5a4055d30 con 0x7fa5ac0bb800 2023-10-16T19:40:22.912 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff33c005870 con 0x7ff3601ef250 2023-10-16T19:40:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 msgr2=0x7fa59006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 0x7fa59006d490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0a7340 tx=0x7fa5a8008040 comp rx=0 tx=0).stop 2023-10-16T19:40:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 msgr2=0x7fa5ac150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000f80 tx=0x7fa5a4005420 comp rx=0 tx=0).stop 2023-10-16T19:40:22.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 shutdown_connections 2023-10-16T19:40:22.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa59006afd0 0x7fa59006d490 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0a7340 tx=0x7fa5a8008040 comp rx=0 tx=0).stop 2023-10-16T19:40:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.911+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa5ac151430 0x7fa5ac0b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5ac0bb420 0x7fa5ac150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7fa5b344c700 1 --2- 172.21.15.29:0/2514448597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5ac0bb800 0x7fa5ac150760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 >> 172.21.15.29:0/2514448597 conn(0x7fa5ac0a7c20 msgr2=0x7fa5ac0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7ff35cff9700 1 -- 172.21.15.29:0/3841840154 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff354053ad0 con 0x7ff3601ef250 2023-10-16T19:40:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 shutdown_connections 2023-10-16T19:40:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.912+0000 7fa5b344c700 1 -- 172.21.15.29:0/2514448597 wait complete. 2023-10-16T19:40:22.917 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 msgr2=0x7ff34406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 0x7ff34406d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff350013040 tx=0x7ff350010000 comp rx=0 tx=0).stop 2023-10-16T19:40:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 msgr2=0x7ff36015a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff35400f4c0 tx=0x7ff35400f880 comp rx=0 tx=0).stop 2023-10-16T19:40:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 shutdown_connections 2023-10-16T19:40:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff34406aed0 0x7ff34406d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff360157160 0x7ff3601575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff348003a00 0x7ff3601f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 --2- 172.21.15.29:0/3841840154 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff3601ef250 0x7ff36015a7a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.916+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 >> 172.21.15.29:0/3841840154 conn(0x7ff3600a7c20 msgr2=0x7ff3600bdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.920+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 shutdown_connections 2023-10-16T19:40:22.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.920+0000 7ff366695700 1 -- 172.21.15.29:0/3841840154 wait complete. 2023-10-16T19:40:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.934+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76cc0b8e10 con 0x7f76cc06d790 2023-10-16T19:40:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.934+0000 7f76baffd700 1 -- 172.21.15.29:0/1650440983 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76bc057b10 con 0x7f76cc06d790 2023-10-16T19:40:22.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2023-10-16T19:40:22.938 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:22.939 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2023-10-16T19:40:22.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.938+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 msgr2=0x7f76ac06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.938+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 0x7f76ac06d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76c0006fd0 tx=0x7f76c0008040 comp rx=0 tx=0).stop 2023-10-16T19:40:22.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.938+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 msgr2=0x7f76cc0a8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.938+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c520 tx=0x7f76bc00c8e0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 shutdown_connections 2023-10-16T19:40:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f76ac06afd0 0x7f76ac06d490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f76cc0c3d70 0x7f76cc0beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76cc06d790 0x7f76cc0a8b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 --2- 172.21.15.29:0/1650440983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76cc0726d0 0x7f76cc15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 >> 172.21.15.29:0/1650440983 conn(0x7f76cc0a7c20 msgr2=0x7f76cc14c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 shutdown_connections 2023-10-16T19:40:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.939+0000 7f76d0a21700 1 -- 172.21.15.29:0/1650440983 wait complete. 2023-10-16T19:40:22.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.1 2023-10-16T19:40:22.944 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:22.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.6 2023-10-16T19:40:22.954 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.982+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f36d80bed60 con 0x7f36d80c30b0 2023-10-16T19:40:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.982+0000 7f36c6ffd700 1 -- 172.21.15.29:0/4194783456 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36d80bed60 con 0x7f36d80c30b0 2023-10-16T19:40:22.985 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 msgr2=0x7f36b8071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 0x7f36b8071820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009de0 tx=0x7f36c8009190 comp rx=0 tx=0).stop 2023-10-16T19:40:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 msgr2=0x7f36d81db6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f397806d590 con 0x7f39780ab9a0 2023-10-16T19:40:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36d0001a50 tx=0x7f36d0001d60 comp rx=0 tx=0).stop 2023-10-16T19:40:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 shutdown_connections 2023-10-16T19:40:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36b806f360 0x7f36b8071820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d80c30b0 0x7f36d81db6a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d8070c40 0x7f36d81eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 --2- 172.21.15.29:0/4194783456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36d80c07f0 0x7f36d80bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.984+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 >> 172.21.15.29:0/4194783456 conn(0x7f36d80a7c20 msgr2=0x7f36d806cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.985+0000 7f3974ff9700 1 -- 172.21.15.29:0/4139305588 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f396c017090 con 0x7f39780ab9a0 2023-10-16T19:40:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.985+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 shutdown_connections 2023-10-16T19:40:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.985+0000 7f36dcdcb700 1 -- 172.21.15.29:0/4194783456 wait complete. 2023-10-16T19:40:22.990 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.987+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 msgr2=0x7f396406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.987+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 0x7f396406d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3968000f60 tx=0x7f3968007a40 comp rx=0 tx=0).stop 2023-10-16T19:40:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.987+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 msgr2=0x7f39780c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.987+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e9c0 tx=0x7f396c00ed80 comp rx=0 tx=0).stop 2023-10-16T19:40:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 shutdown_connections 2023-10-16T19:40:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f396406afd0 0x7f396406d490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f39780bcf40 0x7f397814d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39780ab9a0 0x7f39780c5fe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 --2- 172.21.15.29:0/4139305588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39780c5660 0x7f397814cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 >> 172.21.15.29:0/4139305588 conn(0x7f39780a7c20 msgr2=0x7f397806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 shutdown_connections 2023-10-16T19:40:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:22.994+0000 7f397ea59700 1 -- 172.21.15.29:0/4139305588 wait complete. 2023-10-16T19:40:22.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2023-10-16T19:40:23.000 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:23.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.010+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f92a804f400 con 0x7f92a80c30b0 2023-10-16T19:40:23.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.010+0000 7f929e7fc700 1 -- 172.21.15.29:0/4128545997 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92a0017020 con 0x7f92a80c30b0 2023-10-16T19:40:23.012 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2023-10-16T19:40:23.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.5 2023-10-16T19:40:23.014 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:23.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 msgr2=0x7f929406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 0x7f929406d580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92a4007fd0 tx=0x7f92a4008070 comp rx=0 tx=0).stop 2023-10-16T19:40:23.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 msgr2=0x7f92a81e7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c9f0 tx=0x7f92a000cd00 comp rx=0 tx=0).stop 2023-10-16T19:40:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 shutdown_connections 2023-10-16T19:40:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f929406b0c0 0x7f929406d580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92a80c30b0 0x7f92a81e7090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92a8070c40 0x7f92a80bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 --2- 172.21.15.29:0/4128545997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92a80c07f0 0x7f92a81e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 >> 172.21.15.29:0/4128545997 conn(0x7f92a80a7c20 msgr2=0x7f92a80a58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 shutdown_connections 2023-10-16T19:40:23.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.014+0000 7f92b0189700 1 -- 172.21.15.29:0/4128545997 wait complete. 2023-10-16T19:40:23.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.023+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c480bfc90 con 0x7f6c48070c40 2023-10-16T19:40:23.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.023+0000 7f6c2f7fe700 1 -- 172.21.15.29:0/2419376849 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c480bfc90 con 0x7f6c48070c40 2023-10-16T19:40:23.026 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2023-10-16T19:40:23.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2023-10-16T19:40:23.031 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:23.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 msgr2=0x7f6c3406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 0x7f6c3406d510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c481f9710 tx=0x7f6c3c008040 comp rx=0 tx=0).stop 2023-10-16T19:40:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 msgr2=0x7f6c480bff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009b70 tx=0x7f6c38004750 comp rx=0 tx=0).stop 2023-10-16T19:40:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 shutdown_connections 2023-10-16T19:40:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c3406b050 0x7f6c3406d510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c480c30b0 0x7f6c481fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c48070c40 0x7f6c480bff70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 --2- 172.21.15.29:0/2419376849 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c480c07f0 0x7f6c4814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 >> 172.21.15.29:0/2419376849 conn(0x7f6c480a7c20 msgr2=0x7f6c480a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 shutdown_connections 2023-10-16T19:40:23.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.027+0000 7f6c4d4f9700 1 -- 172.21.15.29:0/2419376849 wait complete. 2023-10-16T19:40:23.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.028+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a140055a0 con 0x7f9a340c8130 2023-10-16T19:40:23.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.028+0000 7f9a30ff9700 1 -- 172.21.15.29:0/3619711718 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a24021070 con 0x7f9a340c8130 2023-10-16T19:40:23.035 INFO:teuthology.orchestra.run.smithi029.stdout:55834574860 2023-10-16T19:40:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 msgr2=0x7f9a2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 0x7f9a2006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a340c8590 tx=0x7f9a28008030 comp rx=0 tx=0).stop 2023-10-16T19:40:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 msgr2=0x7f9a340c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e870 tx=0x7f9a2400eb80 comp rx=0 tx=0).stop 2023-10-16T19:40:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 shutdown_connections 2023-10-16T19:40:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9a2006af00 0x7f9a2006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a34156320 0x7f9a341ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340c8130 0x7f9a340c4140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 --2- 172.21.15.29:0/3619711718 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9a340caa30 0x7f9a341eb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 >> 172.21.15.29:0/3619711718 conn(0x7f9a34072190 msgr2=0x7f9a340c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 shutdown_connections 2023-10-16T19:40:23.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.031+0000 7f9a3a421700 1 -- 172.21.15.29:0/3619711718 wait complete. 2023-10-16T19:40:23.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2023-10-16T19:40:23.043 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:23.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.3 2023-10-16T19:40:23.046 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:23.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T19:40:23.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:40:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.208+0000 7f2c6f817700 1 Processor -- start 2023-10-16T19:40:23.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.208+0000 7f2c6f817700 1 -- start start 2023-10-16T19:40:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6f817700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c680c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6f817700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6806bac0 con 0x7f2c680bd650 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6f817700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c681559d0 con 0x7f2c68152190 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6f817700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681554e0 con 0x7f2c680c66d0 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6cdb2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2c680bd650 0x7f2c680c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37500/0 (socket says 172.21.15.29:37500) 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6cdb2700 1 -- 172.21.15.29:0/3182461504 learned_addr learned my addr 172.21.15.29:0/3182461504 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.209+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c680c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760225275 0 0) 0x7f2c6806bac0 con 0x7f2c680bd650 2023-10-16T19:40:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c540035b0 con 0x7f2c680bd650 2023-10-16T19:40:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850946206 0 0) 0x7f2c681559d0 con 0x7f2c68152190 2023-10-16T19:40:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6806bac0 con 0x7f2c68152190 2023-10-16T19:40:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2211517162 0 0) 0x7f2c540035b0 con 0x7f2c680bd650 2023-10-16T19:40:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 msgr2=0x7f2c680c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c680c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 >> v1:172.21.15.53:6789/0 conn(0x7f2c68152190 legacy=0x7f2c680bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680c6c20 con 0x7f2c680bd650 2023-10-16T19:40:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f2c64001670 con 0x7f2c680bd650 2023-10-16T19:40:23.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 >> v1:172.21.15.29:6789/0 conn(0x7f2c680bd650 legacy=0x7f2c680c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c54003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004170 0x7f2c54004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c54004d90 0x7f2c54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681554e0 con 0x7f2c54004d90 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5400bbd0 con 0x7f2c54004170 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5400bd90 con 0x7f2c680c66d0 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c54004d90 0x7f2c54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6cdb2700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004170 0x7f2c54004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6d5b3700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c54003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 msgr2=0x7f2c54003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c680c66d0 0x7f2c54003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004170 msgr2=0x7f2c54004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004170 0x7f2c54004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.210+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/3182461504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540035b0 con 0x7f2c54004d90 2023-10-16T19:40:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c54004d90 0x7f2c54005210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009fc0 tx=0x7f2c54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b174757263c64dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000ec30 con 0x7f2c54004d90 2023-10-16T19:40:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000f040 con 0x7f2c54004d90 2023-10-16T19:40:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c5ffff700 1 -- 172.21.15.29:0/3182461504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60014480 con 0x7f2c54004d90 2023-10-16T19:40:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 -- 172.21.15.29:0/3182461504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c54004d90 msgr2=0x7f2c54005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 --2- 172.21.15.29:0/3182461504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c54004d90 0x7f2c54005210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009fc0 tx=0x7f2c54005880 comp rx=0 tx=0).stop 2023-10-16T19:40:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/3182461504 reap_dead start 2023-10-16T19:40:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 -- 172.21.15.29:0/3182461504 shutdown_connections 2023-10-16T19:40:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 -- 172.21.15.29:0/3182461504 >> 172.21.15.29:0/3182461504 conn(0x7f2c680a9cd0 msgr2=0x7f2c680aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 -- 172.21.15.29:0/3182461504 shutdown_connections 2023-10-16T19:40:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.211+0000 7f2c6f817700 1 -- 172.21.15.29:0/3182461504 wait complete. 2023-10-16T19:40:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 Processor -- start 2023-10-16T19:40:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 -- start start 2023-10-16T19:40:23.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c680c13e0 0x7f2c680c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c68155e50 0x7f2c68153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681ee290 con 0x7f2c681543e0 2023-10-16T19:40:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680bfe10 con 0x7f2c680c13e0 2023-10-16T19:40:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6f817700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681edd10 con 0x7f2c68155e50 2023-10-16T19:40:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6ddb4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6ddb4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52070/0 (socket says 172.21.15.29:52070) 2023-10-16T19:40:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/1269426229 learned_addr learned my addr 172.21.15.29:0/1269426229 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6d5b3700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c680c13e0 0x7f2c680c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.213+0000 7f2c6cdb2700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c68155e50 0x7f2c68153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c68155e50 msgr2=0x7f2c68153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c68155e50 0x7f2c68153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c680c13e0 msgr2=0x7f2c680c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c680c13e0 0x7f2c680c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 -- 172.21.15.29:0/1269426229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6806c0d0 con 0x7f2c681543e0 2023-10-16T19:40:23.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6ddb4700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c60017040 tx=0x7f2c60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60007000 con 0x7f2c681543e0 2023-10-16T19:40:23.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60003e50 con 0x7f2c681543e0 2023-10-16T19:40:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600149f0 con 0x7f2c681543e0 2023-10-16T19:40:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c68070250 con 0x7f2c681543e0 2023-10-16T19:40:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.214+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c681edf20 con 0x7f2c681543e0 2023-10-16T19:40:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.215+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6804f400 con 0x7f2c681543e0 2023-10-16T19:40:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.216+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c60023020 con 0x7f2c681543e0 2023-10-16T19:40:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.216+0000 7f2c5dffb700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 0x7f2c4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.216+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c6008abb0 con 0x7f2c681543e0 2023-10-16T19:40:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.216+0000 7f2c6d5b3700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 0x7f2c4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.217+0000 7f2c6d5b3700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 0x7f2c4c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000c00 tx=0x7f2c58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.221+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c60055a00 con 0x7f2c681543e0 2023-10-16T19:40:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.417+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c6806bf50 con 0x7f2c4c06af00 2023-10-16T19:40:23.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.427+0000 7f2c5dffb700 1 -- 172.21.15.29:0/1269426229 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345251 (secure 0 0 0) 0x7f2c58006860 con 0x7f2c4c06af00 2023-10-16T19:40:23.433 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:23.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 msgr2=0x7f2c4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 0x7f2c4c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000c00 tx=0x7f2c58009040 comp rx=0 tx=0).stop 2023-10-16T19:40:23.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 msgr2=0x7f2c681ea130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c60017040 tx=0x7f2c60009750 comp rx=0 tx=0).stop 2023-10-16T19:40:23.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 shutdown_connections 2023-10-16T19:40:23.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2c4c06af00 0x7f2c4c06d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c681543e0 0x7f2c681ea130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c680c13e0 0x7f2c680c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 --2- 172.21.15.29:0/1269426229 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2c68155e50 0x7f2c68153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 >> 172.21.15.29:0/1269426229 conn(0x7f2c680a9cd0 msgr2=0x7f2c680bcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 shutdown_connections 2023-10-16T19:40:23.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.431+0000 7f2c6f817700 1 -- 172.21.15.29:0/1269426229 wait complete. 2023-10-16T19:40:23.438 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:40:23.445 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-16T19:40:22.563002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2025624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003636"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056933+0000","last_change":"2023-10-16T19:39:52.970740+0000","last_active":"2023-10-16T19:39:57.056933+0000","last_peered":"2023-10-16T19:39:57.056933+0000","last_clean":"2023-10-16T19:39:57.056933+0000","last_became_active":"2023-10-16T19:39:52.970471+0000","last_became_peered":"2023-10-16T19:39:52.970471+0000","last_unstale":"2023-10-16T19:39:57.056933+0000","last_undegraded":"2023-10-16T19:39:57.056933+0000","last_fullsized":"2023-10-16T19:39:57.056933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:28.159875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995299+0000","last_change":"2023-10-16T19:39:52.967596+0000","last_active":"2023-10-16T19:39:56.995299+0000","last_peered":"2023-10-16T19:39:56.995299+0000","last_clean":"2023-10-16T19:39:56.995299+0000","last_became_active":"2023-10-16T19:39:52.967235+0000","last_became_peered":"2023-10-16T19:39:52.967235+0000","last_unstale":"2023-10-16T19:39:56.995299+0000","last_undegraded":"2023-10-16T19:39:56.995299+0000","last_fullsized":"2023-10-16T19:39:56.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983237+0000","last_change":"2023-10-16T19:39:52.973343+0000","last_active":"2023-10-16T19:39:56.983237+0000","last_peered":"2023-10-16T19:39:56.983237+0000","last_clean":"2023-10-16T19:39:56.983237+0000","last_became_active":"2023-10-16T19:39:52.973035+0000","last_became_peered":"2023-10-16T19:39:52.973035+0000","last_unstale":"2023-10-16T19:39:56.983237+0000","last_undegraded":"2023-10-16T19:39:56.983237+0000","last_fullsized":"2023-10-16T19:39:56.983237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:11.377449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984370+0000","last_change":"2023-10-16T19:39:52.971942+0000","last_active":"2023-10-16T19:39:56.984370+0000","last_peered":"2023-10-16T19:39:56.984370+0000","last_clean":"2023-10-16T19:39:56.984370+0000","last_became_active":"2023-10-16T19:39:52.971194+0000","last_became_peered":"2023-10-16T19:39:52.971194+0000","last_unstale":"2023-10-16T19:39:56.984370+0000","last_undegraded":"2023-10-16T19:39:56.984370+0000","last_fullsized":"2023-10-16T19:39:56.984370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055336+0000","last_change":"2023-10-16T19:39:52.968333+0000","last_active":"2023-10-16T19:39:57.055336+0000","last_peered":"2023-10-16T19:39:57.055336+0000","last_clean":"2023-10-16T19:39:57.055336+0000","last_became_active":"2023-10-16T19:39:52.968039+0000","last_became_peered":"2023-10-16T19:39:52.968039+0000","last_unstale":"2023-10-16T19:39:57.055336+0000","last_undegraded":"2023-10-16T19:39:57.055336+0000","last_fullsized":"2023-10-16T19:39:57.055336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984153+0000","last_change":"2023-10-16T19:39:52.977137+0000","last_active":"2023-10-16T19:39:56.984153+0000","last_peered":"2023-10-16T19:39:56.984153+0000","last_clean":"2023-10-16T19:39:56.984153+0000","last_became_active":"2023-10-16T19:39:52.976671+0000","last_became_peered":"2023-10-16T19:39:52.976671+0000","last_unstale":"2023-10-16T19:39:56.984153+0000","last_undegraded":"2023-10-16T19:39:56.984153+0000","last_fullsized":"2023-10-16T19:39:56.984153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054955+0000","last_change":"2023-10-16T19:39:52.969912+0000","last_active":"2023-10-16T19:39:57.054955+0000","last_peered":"2023-10-16T19:39:57.054955+0000","last_clean":"2023-10-16T19:39:57.054955+0000","last_became_active":"2023-10-16T19:39:52.969619+0000","last_became_peered":"2023-10-16T19:39:52.969619+0000","last_unstale":"2023-10-16T19:39:57.054955+0000","last_undegraded":"2023-10-16T19:39:57.054955+0000","last_fullsized":"2023-10-16T19:39:57.054955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988599+0000","last_change":"2023-10-16T19:39:52.977292+0000","last_active":"2023-10-16T19:39:56.988599+0000","last_peered":"2023-10-16T19:39:56.988599+0000","last_clean":"2023-10-16T19:39:56.988599+0000","last_became_active":"2023-10-16T19:39:52.976867+0000","last_became_peered":"2023-10-16T19:39:52.976867+0000","last_unstale":"2023-10-16T19:39:56.988599+0000","last_undegraded":"2023-10-16T19:39:56.988599+0000","last_fullsized":"2023-10-16T19:39:56.988599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056855+0000","last_change":"2023-10-16T19:39:52.971411+0000","last_active":"2023-10-16T19:39:57.056855+0000","last_peered":"2023-10-16T19:39:57.056855+0000","last_clean":"2023-10-16T19:39:57.056855+0000","last_became_active":"2023-10-16T19:39:52.971042+0000","last_became_peered":"2023-10-16T19:39:52.971042+0000","last_unstale":"2023-10-16T19:39:57.056855+0000","last_undegraded":"2023-10-16T19:39:57.056855+0000","last_fullsized":"2023-10-16T19:39:57.056855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:43.719224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978310+0000","last_change":"2023-10-16T19:39:52.966574+0000","last_active":"2023-10-16T19:39:56.978310+0000","last_peered":"2023-10-16T19:39:56.978310+0000","last_clean":"2023-10-16T19:39:56.978310+0000","last_became_active":"2023-10-16T19:39:52.966277+0000","last_became_peered":"2023-10-16T19:39:52.966277+0000","last_unstale":"2023-10-16T19:39:56.978310+0000","last_undegraded":"2023-10-16T19:39:56.978310+0000","last_fullsized":"2023-10-16T19:39:56.978310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978886+0000","last_change":"2023-10-16T19:39:52.971359+0000","last_active":"2023-10-16T19:39:56.978886+0000","last_peered":"2023-10-16T19:39:56.978886+0000","last_clean":"2023-10-16T19:39:56.978886+0000","last_became_active":"2023-10-16T19:39:52.971111+0000","last_became_peered":"2023-10-16T19:39:52.971111+0000","last_unstale":"2023-10-16T19:39:56.978886+0000","last_undegraded":"2023-10-16T19:39:56.978886+0000","last_fullsized":"2023-10-16T19:39:56.978886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979383+0000","last_change":"2023-10-16T19:39:52.966121+0000","last_active":"2023-10-16T19:39:56.979383+0000","last_peered":"2023-10-16T19:39:56.979383+0000","last_clean":"2023-10-16T19:39:56.979383+0000","last_became_active":"2023-10-16T19:39:52.965817+0000","last_became_peered":"2023-10-16T19:39:52.965817+0000","last_unstale":"2023-10-16T19:39:56.979383+0000","last_undegraded":"2023-10-16T19:39:56.979383+0000","last_fullsized":"2023-10-16T19:39:56.979383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996155+0000","last_change":"2023-10-16T19:39:52.971739+0000","last_active":"2023-10-16T19:39:56.996155+0000","last_peered":"2023-10-16T19:39:56.996155+0000","last_clean":"2023-10-16T19:39:56.996155+0000","last_became_active":"2023-10-16T19:39:52.970983+0000","last_became_peered":"2023-10-16T19:39:52.970983+0000","last_unstale":"2023-10-16T19:39:56.996155+0000","last_undegraded":"2023-10-16T19:39:56.996155+0000","last_fullsized":"2023-10-16T19:39:56.996155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982897+0000","last_change":"2023-10-16T19:39:52.962992+0000","last_active":"2023-10-16T19:39:56.982897+0000","last_peered":"2023-10-16T19:39:56.982897+0000","last_clean":"2023-10-16T19:39:56.982897+0000","last_became_active":"2023-10-16T19:39:52.962658+0000","last_became_peered":"2023-10-16T19:39:52.962658+0000","last_unstale":"2023-10-16T19:39:56.982897+0000","last_undegraded":"2023-10-16T19:39:56.982897+0000","last_fullsized":"2023-10-16T19:39:56.982897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.991949+0000","last_change":"2023-10-16T19:39:52.965403+0000","last_active":"2023-10-16T19:39:56.991949+0000","last_peered":"2023-10-16T19:39:56.991949+0000","last_clean":"2023-10-16T19:39:56.991949+0000","last_became_active":"2023-10-16T19:39:52.965160+0000","last_became_peered":"2023-10-16T19:39:52.965160+0000","last_unstale":"2023-10-16T19:39:56.991949+0000","last_undegraded":"2023-10-16T19:39:56.991949+0000","last_fullsized":"2023-10-16T19:39:56.991949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983686+0000","last_change":"2023-10-16T19:39:52.969063+0000","last_active":"2023-10-16T19:39:56.983686+0000","last_peered":"2023-10-16T19:39:56.983686+0000","last_clean":"2023-10-16T19:39:56.983686+0000","last_became_active":"2023-10-16T19:39:52.968770+0000","last_became_peered":"2023-10-16T19:39:52.968770+0000","last_unstale":"2023-10-16T19:39:56.983686+0000","last_undegraded":"2023-10-16T19:39:56.983686+0000","last_fullsized":"2023-10-16T19:39:56.983686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984501+0000","last_change":"2023-10-16T19:39:52.973031+0000","last_active":"2023-10-16T19:39:56.984501+0000","last_peered":"2023-10-16T19:39:56.984501+0000","last_clean":"2023-10-16T19:39:56.984501+0000","last_became_active":"2023-10-16T19:39:52.972734+0000","last_became_peered":"2023-10-16T19:39:52.972734+0000","last_unstale":"2023-10-16T19:39:56.984501+0000","last_undegraded":"2023-10-16T19:39:56.984501+0000","last_fullsized":"2023-10-16T19:39:56.984501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977146+0000","last_change":"2023-10-16T19:39:52.953856+0000","last_active":"2023-10-16T19:39:56.977146+0000","last_peered":"2023-10-16T19:39:56.977146+0000","last_clean":"2023-10-16T19:39:56.977146+0000","last_became_active":"2023-10-16T19:39:52.953556+0000","last_became_peered":"2023-10-16T19:39:52.953556+0000","last_unstale":"2023-10-16T19:39:56.977146+0000","last_undegraded":"2023-10-16T19:39:56.977146+0000","last_fullsized":"2023-10-16T19:39:56.977146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056318+0000","last_change":"2023-10-16T19:39:52.966778+0000","last_active":"2023-10-16T19:39:57.056318+0000","last_peered":"2023-10-16T19:39:57.056318+0000","last_clean":"2023-10-16T19:39:57.056318+0000","last_became_active":"2023-10-16T19:39:52.966444+0000","last_became_peered":"2023-10-16T19:39:52.966444+0000","last_unstale":"2023-10-16T19:39:57.056318+0000","last_undegraded":"2023-10-16T19:39:57.056318+0000","last_fullsized":"2023-10-16T19:39:57.056318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014044+0000","last_change":"2023-10-16T19:39:57.060100+0000","last_active":"2023-10-16T19:39:58.014044+0000","last_peered":"2023-10-16T19:39:58.014044+0000","last_clean":"2023-10-16T19:39:58.014044+0000","last_became_active":"2023-10-16T19:39:57.059654+0000","last_became_peered":"2023-10-16T19:39:57.059654+0000","last_unstale":"2023-10-16T19:39:58.014044+0000","last_undegraded":"2023-10-16T19:39:58.014044+0000","last_fullsized":"2023-10-16T19:39:58.014044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983501+0000","last_change":"2023-10-16T19:39:51.960397+0000","last_active":"2023-10-16T19:39:56.983501+0000","last_peered":"2023-10-16T19:39:56.983501+0000","last_clean":"2023-10-16T19:39:56.983501+0000","last_became_active":"2023-10-16T19:39:51.959720+0000","last_became_peered":"2023-10-16T19:39:51.959720+0000","last_unstale":"2023-10-16T19:39:56.983501+0000","last_undegraded":"2023-10-16T19:39:56.983501+0000","last_fullsized":"2023-10-16T19:39:56.983501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997016+0000","last_change":"2023-10-16T19:39:52.970235+0000","last_active":"2023-10-16T19:39:56.997016+0000","last_peered":"2023-10-16T19:39:56.997016+0000","last_clean":"2023-10-16T19:39:56.997016+0000","last_became_active":"2023-10-16T19:39:52.969954+0000","last_became_peered":"2023-10-16T19:39:52.969954+0000","last_unstale":"2023-10-16T19:39:56.997016+0000","last_undegraded":"2023-10-16T19:39:56.997016+0000","last_fullsized":"2023-10-16T19:39:56.997016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014481+0000","last_change":"2023-10-16T19:39:56.998346+0000","last_active":"2023-10-16T19:39:58.014481+0000","last_peered":"2023-10-16T19:39:58.014481+0000","last_clean":"2023-10-16T19:39:58.014481+0000","last_became_active":"2023-10-16T19:39:56.997873+0000","last_became_peered":"2023-10-16T19:39:56.997873+0000","last_unstale":"2023-10-16T19:39:58.014481+0000","last_undegraded":"2023-10-16T19:39:58.014481+0000","last_fullsized":"2023-10-16T19:39:58.014481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:23.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997110+0000","last_change":"2023-10-16T19:39:51.953173+0000","last_active":"2023-10-16T19:39:56.997110+0000","last_peered":"2023-10-16T19:39:56.997110+0000","last_clean":"2023-10-16T19:39:56.997110+0000","last_became_active":"2023-10-16T19:39:51.952008+0000","last_became_peered":"2023-10-16T19:39:51.952008+0000","last_unstale":"2023-10-16T19:39:56.997110+0000","last_undegraded":"2023-10-16T19:39:56.997110+0000","last_fullsized":"2023-10-16T19:39:56.997110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983121+0000","last_change":"2023-10-16T19:39:52.972725+0000","last_active":"2023-10-16T19:39:56.983121+0000","last_peered":"2023-10-16T19:39:56.983121+0000","last_clean":"2023-10-16T19:39:56.983121+0000","last_became_active":"2023-10-16T19:39:52.972414+0000","last_became_peered":"2023-10-16T19:39:52.972414+0000","last_unstale":"2023-10-16T19:39:56.983121+0000","last_undegraded":"2023-10-16T19:39:56.983121+0000","last_fullsized":"2023-10-16T19:39:56.983121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014362+0000","last_change":"2023-10-16T19:39:56.999448+0000","last_active":"2023-10-16T19:39:58.014362+0000","last_peered":"2023-10-16T19:39:58.014362+0000","last_clean":"2023-10-16T19:39:58.014362+0000","last_became_active":"2023-10-16T19:39:56.997855+0000","last_became_peered":"2023-10-16T19:39:56.997855+0000","last_unstale":"2023-10-16T19:39:58.014362+0000","last_undegraded":"2023-10-16T19:39:58.014362+0000","last_fullsized":"2023-10-16T19:39:58.014362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:56.072025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055844+0000","last_change":"2023-10-16T19:39:51.960815+0000","last_active":"2023-10-16T19:39:57.055844+0000","last_peered":"2023-10-16T19:39:57.055844+0000","last_clean":"2023-10-16T19:39:57.055844+0000","last_became_active":"2023-10-16T19:39:51.960470+0000","last_became_peered":"2023-10-16T19:39:51.960470+0000","last_unstale":"2023-10-16T19:39:57.055844+0000","last_undegraded":"2023-10-16T19:39:57.055844+0000","last_fullsized":"2023-10-16T19:39:57.055844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:35.736680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984118+0000","last_change":"2023-10-16T19:39:52.965519+0000","last_active":"2023-10-16T19:39:56.984118+0000","last_peered":"2023-10-16T19:39:56.984118+0000","last_clean":"2023-10-16T19:39:56.984118+0000","last_became_active":"2023-10-16T19:39:52.965232+0000","last_became_peered":"2023-10-16T19:39:52.965232+0000","last_unstale":"2023-10-16T19:39:56.984118+0000","last_undegraded":"2023-10-16T19:39:56.984118+0000","last_fullsized":"2023-10-16T19:39:56.984118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014702+0000","last_change":"2023-10-16T19:39:56.998686+0000","last_active":"2023-10-16T19:39:58.014702+0000","last_peered":"2023-10-16T19:39:58.014702+0000","last_clean":"2023-10-16T19:39:58.014702+0000","last_became_active":"2023-10-16T19:39:56.998124+0000","last_became_peered":"2023-10-16T19:39:56.998124+0000","last_unstale":"2023-10-16T19:39:58.014702+0000","last_undegraded":"2023-10-16T19:39:58.014702+0000","last_fullsized":"2023-10-16T19:39:58.014702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:09.298354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055487+0000","last_change":"2023-10-16T19:39:51.963066+0000","last_active":"2023-10-16T19:39:57.055487+0000","last_peered":"2023-10-16T19:39:57.055487+0000","last_clean":"2023-10-16T19:39:57.055487+0000","last_became_active":"2023-10-16T19:39:51.962643+0000","last_became_peered":"2023-10-16T19:39:51.962643+0000","last_unstale":"2023-10-16T19:39:57.055487+0000","last_undegraded":"2023-10-16T19:39:57.055487+0000","last_fullsized":"2023-10-16T19:39:57.055487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:47.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984874+0000","last_change":"2023-10-16T19:39:52.965735+0000","last_active":"2023-10-16T19:39:56.984874+0000","last_peered":"2023-10-16T19:39:56.984874+0000","last_clean":"2023-10-16T19:39:56.984874+0000","last_became_active":"2023-10-16T19:39:52.965467+0000","last_became_peered":"2023-10-16T19:39:52.965467+0000","last_unstale":"2023-10-16T19:39:56.984874+0000","last_undegraded":"2023-10-16T19:39:56.984874+0000","last_fullsized":"2023-10-16T19:39:56.984874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014328+0000","last_change":"2023-10-16T19:39:57.004000+0000","last_active":"2023-10-16T19:39:58.014328+0000","last_peered":"2023-10-16T19:39:58.014328+0000","last_clean":"2023-10-16T19:39:58.014328+0000","last_became_active":"2023-10-16T19:39:57.003585+0000","last_became_peered":"2023-10-16T19:39:57.003585+0000","last_unstale":"2023-10-16T19:39:58.014328+0000","last_undegraded":"2023-10-16T19:39:58.014328+0000","last_fullsized":"2023-10-16T19:39:58.014328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:49.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996688+0000","last_change":"2023-10-16T19:39:51.963390+0000","last_active":"2023-10-16T19:39:56.996688+0000","last_peered":"2023-10-16T19:39:56.996688+0000","last_clean":"2023-10-16T19:39:56.996688+0000","last_became_active":"2023-10-16T19:39:51.963076+0000","last_became_peered":"2023-10-16T19:39:51.963076+0000","last_unstale":"2023-10-16T19:39:56.996688+0000","last_undegraded":"2023-10-16T19:39:56.996688+0000","last_fullsized":"2023-10-16T19:39:56.996688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978342+0000","last_change":"2023-10-16T19:39:52.961791+0000","last_active":"2023-10-16T19:39:56.978342+0000","last_peered":"2023-10-16T19:39:56.978342+0000","last_clean":"2023-10-16T19:39:56.978342+0000","last_became_active":"2023-10-16T19:39:52.960383+0000","last_became_peered":"2023-10-16T19:39:52.960383+0000","last_unstale":"2023-10-16T19:39:56.978342+0000","last_undegraded":"2023-10-16T19:39:56.978342+0000","last_fullsized":"2023-10-16T19:39:56.978342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:48.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.375697+0000","last_change":"2023-10-16T19:39:56.998866+0000","last_active":"2023-10-16T19:39:58.375697+0000","last_peered":"2023-10-16T19:39:58.375697+0000","last_clean":"2023-10-16T19:39:58.375697+0000","last_became_active":"2023-10-16T19:39:56.998515+0000","last_became_peered":"2023-10-16T19:39:56.998515+0000","last_unstale":"2023-10-16T19:39:58.375697+0000","last_undegraded":"2023-10-16T19:39:58.375697+0000","last_fullsized":"2023-10-16T19:39:58.375697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:15.516547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978023+0000","last_change":"2023-10-16T19:39:51.952902+0000","last_active":"2023-10-16T19:39:56.978023+0000","last_peered":"2023-10-16T19:39:56.978023+0000","last_clean":"2023-10-16T19:39:56.978023+0000","last_became_active":"2023-10-16T19:39:51.952591+0000","last_became_peered":"2023-10-16T19:39:51.952591+0000","last_unstale":"2023-10-16T19:39:56.978023+0000","last_undegraded":"2023-10-16T19:39:56.978023+0000","last_fullsized":"2023-10-16T19:39:56.978023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982312+0000","last_change":"2023-10-16T19:39:52.970475+0000","last_active":"2023-10-16T19:39:56.982312+0000","last_peered":"2023-10-16T19:39:56.982312+0000","last_clean":"2023-10-16T19:39:56.982312+0000","last_became_active":"2023-10-16T19:39:52.968544+0000","last_became_peered":"2023-10-16T19:39:52.968544+0000","last_unstale":"2023-10-16T19:39:56.982312+0000","last_undegraded":"2023-10-16T19:39:56.982312+0000","last_fullsized":"2023-10-16T19:39:56.982312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015980+0000","last_change":"2023-10-16T19:39:56.994009+0000","last_active":"2023-10-16T19:39:58.015980+0000","last_peered":"2023-10-16T19:39:58.015980+0000","last_clean":"2023-10-16T19:39:58.015980+0000","last_became_active":"2023-10-16T19:39:56.993681+0000","last_became_peered":"2023-10-16T19:39:56.993681+0000","last_unstale":"2023-10-16T19:39:58.015980+0000","last_undegraded":"2023-10-16T19:39:58.015980+0000","last_fullsized":"2023-10-16T19:39:58.015980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995806+0000","last_change":"2023-10-16T19:39:51.963829+0000","last_active":"2023-10-16T19:39:56.995806+0000","last_peered":"2023-10-16T19:39:56.995806+0000","last_clean":"2023-10-16T19:39:56.995806+0000","last_became_active":"2023-10-16T19:39:51.962756+0000","last_became_peered":"2023-10-16T19:39:51.962756+0000","last_unstale":"2023-10-16T19:39:56.995806+0000","last_undegraded":"2023-10-16T19:39:56.995806+0000","last_fullsized":"2023-10-16T19:39:56.995806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988378+0000","last_change":"2023-10-16T19:39:52.969328+0000","last_active":"2023-10-16T19:39:56.988378+0000","last_peered":"2023-10-16T19:39:56.988378+0000","last_clean":"2023-10-16T19:39:56.988378+0000","last_became_active":"2023-10-16T19:39:52.968930+0000","last_became_peered":"2023-10-16T19:39:52.968930+0000","last_unstale":"2023-10-16T19:39:56.988378+0000","last_undegraded":"2023-10-16T19:39:56.988378+0000","last_fullsized":"2023-10-16T19:39:56.988378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753706+0000","last_change":"2023-10-16T19:39:57.060169+0000","last_active":"2023-10-16T19:39:58.753706+0000","last_peered":"2023-10-16T19:39:58.753706+0000","last_clean":"2023-10-16T19:39:58.753706+0000","last_became_active":"2023-10-16T19:39:57.059047+0000","last_became_peered":"2023-10-16T19:39:57.059047+0000","last_unstale":"2023-10-16T19:39:58.753706+0000","last_undegraded":"2023-10-16T19:39:58.753706+0000","last_fullsized":"2023-10-16T19:39:58.753706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983925+0000","last_change":"2023-10-16T19:39:51.965322+0000","last_active":"2023-10-16T19:39:56.983925+0000","last_peered":"2023-10-16T19:39:56.983925+0000","last_clean":"2023-10-16T19:39:56.983925+0000","last_became_active":"2023-10-16T19:39:51.964942+0000","last_became_peered":"2023-10-16T19:39:51.964942+0000","last_unstale":"2023-10-16T19:39:56.983925+0000","last_undegraded":"2023-10-16T19:39:56.983925+0000","last_fullsized":"2023-10-16T19:39:56.983925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992388+0000","last_change":"2023-10-16T19:39:52.959908+0000","last_active":"2023-10-16T19:39:56.992388+0000","last_peered":"2023-10-16T19:39:56.992388+0000","last_clean":"2023-10-16T19:39:56.992388+0000","last_became_active":"2023-10-16T19:39:52.959614+0000","last_became_peered":"2023-10-16T19:39:52.959614+0000","last_unstale":"2023-10-16T19:39:56.992388+0000","last_undegraded":"2023-10-16T19:39:56.992388+0000","last_fullsized":"2023-10-16T19:39:56.992388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013814+0000","last_change":"2023-10-16T19:39:57.060218+0000","last_active":"2023-10-16T19:39:58.013814+0000","last_peered":"2023-10-16T19:39:58.013814+0000","last_clean":"2023-10-16T19:39:58.013814+0000","last_became_active":"2023-10-16T19:39:57.059234+0000","last_became_peered":"2023-10-16T19:39:57.059234+0000","last_unstale":"2023-10-16T19:39:58.013814+0000","last_undegraded":"2023-10-16T19:39:58.013814+0000","last_fullsized":"2023-10-16T19:39:58.013814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978943+0000","last_change":"2023-10-16T19:39:51.958717+0000","last_active":"2023-10-16T19:39:56.978943+0000","last_peered":"2023-10-16T19:39:56.978943+0000","last_clean":"2023-10-16T19:39:56.978943+0000","last_became_active":"2023-10-16T19:39:51.958416+0000","last_became_peered":"2023-10-16T19:39:51.958416+0000","last_unstale":"2023-10-16T19:39:56.978943+0000","last_undegraded":"2023-10-16T19:39:56.978943+0000","last_fullsized":"2023-10-16T19:39:56.978943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983880+0000","last_change":"2023-10-16T19:39:52.972637+0000","last_active":"2023-10-16T19:39:56.983880+0000","last_peered":"2023-10-16T19:39:56.983880+0000","last_clean":"2023-10-16T19:39:56.983880+0000","last_became_active":"2023-10-16T19:39:52.970837+0000","last_became_peered":"2023-10-16T19:39:52.970837+0000","last_unstale":"2023-10-16T19:39:56.983880+0000","last_undegraded":"2023-10-16T19:39:56.983880+0000","last_fullsized":"2023-10-16T19:39:56.983880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013875+0000","last_change":"2023-10-16T19:39:57.000167+0000","last_active":"2023-10-16T19:39:58.013875+0000","last_peered":"2023-10-16T19:39:58.013875+0000","last_clean":"2023-10-16T19:39:58.013875+0000","last_became_active":"2023-10-16T19:39:56.999442+0000","last_became_peered":"2023-10-16T19:39:56.999442+0000","last_unstale":"2023-10-16T19:39:58.013875+0000","last_undegraded":"2023-10-16T19:39:58.013875+0000","last_fullsized":"2023-10-16T19:39:58.013875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:03.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983872+0000","last_change":"2023-10-16T19:39:51.961261+0000","last_active":"2023-10-16T19:39:56.983872+0000","last_peered":"2023-10-16T19:39:56.983872+0000","last_clean":"2023-10-16T19:39:56.983872+0000","last_became_active":"2023-10-16T19:39:51.960815+0000","last_became_peered":"2023-10-16T19:39:51.960815+0000","last_unstale":"2023-10-16T19:39:56.983872+0000","last_undegraded":"2023-10-16T19:39:56.983872+0000","last_fullsized":"2023-10-16T19:39:56.983872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:20.342371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983682+0000","last_change":"2023-10-16T19:39:52.972640+0000","last_active":"2023-10-16T19:39:56.983682+0000","last_peered":"2023-10-16T19:39:56.983682+0000","last_clean":"2023-10-16T19:39:56.983682+0000","last_became_active":"2023-10-16T19:39:52.972308+0000","last_became_peered":"2023-10-16T19:39:52.972308+0000","last_unstale":"2023-10-16T19:39:56.983682+0000","last_undegraded":"2023-10-16T19:39:56.983682+0000","last_fullsized":"2023-10-16T19:39:56.983682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014924+0000","last_change":"2023-10-16T19:39:56.995225+0000","last_active":"2023-10-16T19:39:58.014924+0000","last_peered":"2023-10-16T19:39:58.014924+0000","last_clean":"2023-10-16T19:39:58.014924+0000","last_became_active":"2023-10-16T19:39:56.994760+0000","last_became_peered":"2023-10-16T19:39:56.994760+0000","last_unstale":"2023-10-16T19:39:58.014924+0000","last_undegraded":"2023-10-16T19:39:58.014924+0000","last_fullsized":"2023-10-16T19:39:58.014924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:43.007379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993849+0000","last_change":"2023-10-16T19:39:51.962481+0000","last_active":"2023-10-16T19:39:56.993849+0000","last_peered":"2023-10-16T19:39:56.993849+0000","last_clean":"2023-10-16T19:39:56.993849+0000","last_became_active":"2023-10-16T19:39:51.962183+0000","last_became_peered":"2023-10-16T19:39:51.962183+0000","last_unstale":"2023-10-16T19:39:56.993849+0000","last_undegraded":"2023-10-16T19:39:56.993849+0000","last_fullsized":"2023-10-16T19:39:56.993849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979596+0000","last_change":"2023-10-16T19:39:52.974753+0000","last_active":"2023-10-16T19:39:56.979596+0000","last_peered":"2023-10-16T19:39:56.979596+0000","last_clean":"2023-10-16T19:39:56.979596+0000","last_became_active":"2023-10-16T19:39:52.974437+0000","last_became_peered":"2023-10-16T19:39:52.974437+0000","last_unstale":"2023-10-16T19:39:56.979596+0000","last_undegraded":"2023-10-16T19:39:56.979596+0000","last_fullsized":"2023-10-16T19:39:56.979596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988925+0000","last_change":"2023-10-16T19:39:57.008281+0000","last_active":"2023-10-16T19:39:58.988925+0000","last_peered":"2023-10-16T19:39:58.988925+0000","last_clean":"2023-10-16T19:39:58.988925+0000","last_became_active":"2023-10-16T19:39:57.007275+0000","last_became_peered":"2023-10-16T19:39:57.007275+0000","last_unstale":"2023-10-16T19:39:58.988925+0000","last_undegraded":"2023-10-16T19:39:58.988925+0000","last_fullsized":"2023-10-16T19:39:58.988925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:40:08.652465+0000","last_change":"2023-10-16T19:39:51.949368+0000","last_active":"2023-10-16T19:40:08.652465+0000","last_peered":"2023-10-16T19:40:08.652465+0000","last_clean":"2023-10-16T19:40:08.652465+0000","last_became_active":"2023-10-16T19:39:51.948876+0000","last_became_peered":"2023-10-16T19:39:51.948876+0000","last_unstale":"2023-10-16T19:40:08.652465+0000","last_undegraded":"2023-10-16T19:40:08.652465+0000","last_fullsized":"2023-10-16T19:40:08.652465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.058349+0000","last_change":"2023-10-16T19:39:52.975376+0000","last_active":"2023-10-16T19:39:57.058349+0000","last_peered":"2023-10-16T19:39:57.058349+0000","last_clean":"2023-10-16T19:39:57.058349+0000","last_became_active":"2023-10-16T19:39:52.975093+0000","last_became_peered":"2023-10-16T19:39:52.975093+0000","last_unstale":"2023-10-16T19:39:57.058349+0000","last_undegraded":"2023-10-16T19:39:57.058349+0000","last_fullsized":"2023-10-16T19:39:57.058349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707865+0000","last_change":"2023-10-16T19:39:57.058788+0000","last_active":"2023-10-16T19:39:58.707865+0000","last_peered":"2023-10-16T19:39:58.707865+0000","last_clean":"2023-10-16T19:39:58.707865+0000","last_became_active":"2023-10-16T19:39:57.058309+0000","last_became_peered":"2023-10-16T19:39:57.058309+0000","last_unstale":"2023-10-16T19:39:58.707865+0000","last_undegraded":"2023-10-16T19:39:58.707865+0000","last_fullsized":"2023-10-16T19:39:58.707865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983378+0000","last_change":"2023-10-16T19:39:51.948746+0000","last_active":"2023-10-16T19:39:56.983378+0000","last_peered":"2023-10-16T19:39:56.983378+0000","last_clean":"2023-10-16T19:39:56.983378+0000","last_became_active":"2023-10-16T19:39:51.948396+0000","last_became_peered":"2023-10-16T19:39:51.948396+0000","last_unstale":"2023-10-16T19:39:56.983378+0000","last_undegraded":"2023-10-16T19:39:56.983378+0000","last_fullsized":"2023-10-16T19:39:56.983378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983007+0000","last_change":"2023-10-16T19:39:52.968344+0000","last_active":"2023-10-16T19:39:56.983007+0000","last_peered":"2023-10-16T19:39:56.983007+0000","last_clean":"2023-10-16T19:39:56.983007+0000","last_became_active":"2023-10-16T19:39:52.967192+0000","last_became_peered":"2023-10-16T19:39:52.967192+0000","last_unstale":"2023-10-16T19:39:56.983007+0000","last_undegraded":"2023-10-16T19:39:56.983007+0000","last_fullsized":"2023-10-16T19:39:56.983007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014138+0000","last_change":"2023-10-16T19:39:57.055830+0000","last_active":"2023-10-16T19:39:58.014138+0000","last_peered":"2023-10-16T19:39:58.014138+0000","last_clean":"2023-10-16T19:39:58.014138+0000","last_became_active":"2023-10-16T19:39:57.055354+0000","last_became_peered":"2023-10-16T19:39:57.055354+0000","last_unstale":"2023-10-16T19:39:58.014138+0000","last_undegraded":"2023-10-16T19:39:58.014138+0000","last_fullsized":"2023-10-16T19:39:58.014138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:29.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983949+0000","last_change":"2023-10-16T19:39:51.964774+0000","last_active":"2023-10-16T19:39:56.983949+0000","last_peered":"2023-10-16T19:39:56.983949+0000","last_clean":"2023-10-16T19:39:56.983949+0000","last_became_active":"2023-10-16T19:39:51.964474+0000","last_became_peered":"2023-10-16T19:39:51.964474+0000","last_unstale":"2023-10-16T19:39:56.983949+0000","last_undegraded":"2023-10-16T19:39:56.983949+0000","last_fullsized":"2023-10-16T19:39:56.983949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055729+0000","last_change":"2023-10-16T19:39:52.968350+0000","last_active":"2023-10-16T19:39:57.055729+0000","last_peered":"2023-10-16T19:39:57.055729+0000","last_clean":"2023-10-16T19:39:57.055729+0000","last_became_active":"2023-10-16T19:39:52.968051+0000","last_became_peered":"2023-10-16T19:39:52.968051+0000","last_unstale":"2023-10-16T19:39:57.055729+0000","last_undegraded":"2023-10-16T19:39:57.055729+0000","last_fullsized":"2023-10-16T19:39:57.055729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014589+0000","last_change":"2023-10-16T19:39:57.059505+0000","last_active":"2023-10-16T19:39:58.014589+0000","last_peered":"2023-10-16T19:39:58.014589+0000","last_clean":"2023-10-16T19:39:58.014589+0000","last_became_active":"2023-10-16T19:39:57.059040+0000","last_became_peered":"2023-10-16T19:39:57.059040+0000","last_unstale":"2023-10-16T19:39:58.014589+0000","last_undegraded":"2023-10-16T19:39:58.014589+0000","last_fullsized":"2023-10-16T19:39:58.014589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:11.600778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978736+0000","last_change":"2023-10-16T19:39:51.953128+0000","last_active":"2023-10-16T19:39:56.978736+0000","last_peered":"2023-10-16T19:39:56.978736+0000","last_clean":"2023-10-16T19:39:56.978736+0000","last_became_active":"2023-10-16T19:39:51.952236+0000","last_became_peered":"2023-10-16T19:39:51.952236+0000","last_unstale":"2023-10-16T19:39:56.978736+0000","last_undegraded":"2023-10-16T19:39:56.978736+0000","last_fullsized":"2023-10-16T19:39:56.978736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:33.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977997+0000","last_change":"2023-10-16T19:39:52.967912+0000","last_active":"2023-10-16T19:39:56.977997+0000","last_peered":"2023-10-16T19:39:56.977997+0000","last_clean":"2023-10-16T19:39:56.977997+0000","last_became_active":"2023-10-16T19:39:52.967616+0000","last_became_peered":"2023-10-16T19:39:52.967616+0000","last_unstale":"2023-10-16T19:39:56.977997+0000","last_undegraded":"2023-10-16T19:39:56.977997+0000","last_fullsized":"2023-10-16T19:39:56.977997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.000483+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.000036+0000","last_became_peered":"2023-10-16T19:39:57.000036+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:47.756036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976895+0000","last_change":"2023-10-16T19:39:51.956225+0000","last_active":"2023-10-16T19:39:56.976895+0000","last_peered":"2023-10-16T19:39:56.976895+0000","last_clean":"2023-10-16T19:39:56.976895+0000","last_became_active":"2023-10-16T19:39:51.955913+0000","last_became_peered":"2023-10-16T19:39:51.955913+0000","last_unstale":"2023-10-16T19:39:56.976895+0000","last_undegraded":"2023-10-16T19:39:56.976895+0000","last_fullsized":"2023-10-16T19:39:56.976895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:55.435969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055053+0000","last_change":"2023-10-16T19:39:52.968227+0000","last_active":"2023-10-16T19:39:57.055053+0000","last_peered":"2023-10-16T19:39:57.055053+0000","last_clean":"2023-10-16T19:39:57.055053+0000","last_became_active":"2023-10-16T19:39:52.967354+0000","last_became_peered":"2023-10-16T19:39:52.967354+0000","last_unstale":"2023-10-16T19:39:57.055053+0000","last_undegraded":"2023-10-16T19:39:57.055053+0000","last_fullsized":"2023-10-16T19:39:57.055053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015289+0000","last_change":"2023-10-16T19:39:56.999092+0000","last_active":"2023-10-16T19:39:58.015289+0000","last_peered":"2023-10-16T19:39:58.015289+0000","last_clean":"2023-10-16T19:39:58.015289+0000","last_became_active":"2023-10-16T19:39:56.998522+0000","last_became_peered":"2023-10-16T19:39:56.998522+0000","last_unstale":"2023-10-16T19:39:58.015289+0000","last_undegraded":"2023-10-16T19:39:58.015289+0000","last_fullsized":"2023-10-16T19:39:58.015289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:40.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979452+0000","last_change":"2023-10-16T19:39:51.962668+0000","last_active":"2023-10-16T19:39:56.979452+0000","last_peered":"2023-10-16T19:39:56.979452+0000","last_clean":"2023-10-16T19:39:56.979452+0000","last_became_active":"2023-10-16T19:39:51.962380+0000","last_became_peered":"2023-10-16T19:39:51.962380+0000","last_unstale":"2023-10-16T19:39:56.979452+0000","last_undegraded":"2023-10-16T19:39:56.979452+0000","last_fullsized":"2023-10-16T19:39:56.979452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055973+0000","last_change":"2023-10-16T19:39:52.967234+0000","last_active":"2023-10-16T19:39:57.055973+0000","last_peered":"2023-10-16T19:39:57.055973+0000","last_clean":"2023-10-16T19:39:57.055973+0000","last_became_active":"2023-10-16T19:39:52.966932+0000","last_became_peered":"2023-10-16T19:39:52.966932+0000","last_unstale":"2023-10-16T19:39:57.055973+0000","last_undegraded":"2023-10-16T19:39:57.055973+0000","last_fullsized":"2023-10-16T19:39:57.055973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988889+0000","last_change":"2023-10-16T19:39:57.008404+0000","last_active":"2023-10-16T19:39:58.988889+0000","last_peered":"2023-10-16T19:39:58.988889+0000","last_clean":"2023-10-16T19:39:58.988889+0000","last_became_active":"2023-10-16T19:39:57.007860+0000","last_became_peered":"2023-10-16T19:39:57.007860+0000","last_unstale":"2023-10-16T19:39:58.988889+0000","last_undegraded":"2023-10-16T19:39:58.988889+0000","last_fullsized":"2023-10-16T19:39:58.988889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993704+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.993704+0000","last_peered":"2023-10-16T19:39:56.993704+0000","last_clean":"2023-10-16T19:39:56.993704+0000","last_became_active":"2023-10-16T19:39:51.956344+0000","last_became_peered":"2023-10-16T19:39:51.956344+0000","last_unstale":"2023-10-16T19:39:56.993704+0000","last_undegraded":"2023-10-16T19:39:56.993704+0000","last_fullsized":"2023-10-16T19:39:56.993704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:07.860685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984972+0000","last_change":"2023-10-16T19:39:52.976139+0000","last_active":"2023-10-16T19:39:56.984972+0000","last_peered":"2023-10-16T19:39:56.984972+0000","last_clean":"2023-10-16T19:39:56.984972+0000","last_became_active":"2023-10-16T19:39:52.975846+0000","last_became_peered":"2023-10-16T19:39:52.975846+0000","last_unstale":"2023-10-16T19:39:56.984972+0000","last_undegraded":"2023-10-16T19:39:56.984972+0000","last_fullsized":"2023-10-16T19:39:56.984972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988843+0000","last_change":"2023-10-16T19:39:57.005213+0000","last_active":"2023-10-16T19:39:58.988843+0000","last_peered":"2023-10-16T19:39:58.988843+0000","last_clean":"2023-10-16T19:39:58.988843+0000","last_became_active":"2023-10-16T19:39:57.004875+0000","last_became_peered":"2023-10-16T19:39:57.004875+0000","last_unstale":"2023-10-16T19:39:58.988843+0000","last_undegraded":"2023-10-16T19:39:58.988843+0000","last_fullsized":"2023-10-16T19:39:58.988843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983833+0000","last_change":"2023-10-16T19:39:51.966189+0000","last_active":"2023-10-16T19:39:56.983833+0000","last_peered":"2023-10-16T19:39:56.983833+0000","last_clean":"2023-10-16T19:39:56.983833+0000","last_became_active":"2023-10-16T19:39:51.965851+0000","last_became_peered":"2023-10-16T19:39:51.965851+0000","last_unstale":"2023-10-16T19:39:56.983833+0000","last_undegraded":"2023-10-16T19:39:56.983833+0000","last_fullsized":"2023-10-16T19:39:56.983833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979924+0000","last_change":"2023-10-16T19:39:52.969798+0000","last_active":"2023-10-16T19:39:56.979924+0000","last_peered":"2023-10-16T19:39:56.979924+0000","last_clean":"2023-10-16T19:39:56.979924+0000","last_became_active":"2023-10-16T19:39:52.969403+0000","last_became_peered":"2023-10-16T19:39:52.969403+0000","last_unstale":"2023-10-16T19:39:56.979924+0000","last_undegraded":"2023-10-16T19:39:56.979924+0000","last_fullsized":"2023-10-16T19:39:56.979924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:18.043026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989269+0000","last_change":"2023-10-16T19:39:57.006715+0000","last_active":"2023-10-16T19:39:58.989269+0000","last_peered":"2023-10-16T19:39:58.989269+0000","last_clean":"2023-10-16T19:39:58.989269+0000","last_became_active":"2023-10-16T19:39:57.006456+0000","last_became_peered":"2023-10-16T19:39:57.006456+0000","last_unstale":"2023-10-16T19:39:58.989269+0000","last_undegraded":"2023-10-16T19:39:58.989269+0000","last_fullsized":"2023-10-16T19:39:58.989269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992572+0000","last_change":"2023-10-16T19:39:52.959610+0000","last_active":"2023-10-16T19:39:56.992572+0000","last_peered":"2023-10-16T19:39:56.992572+0000","last_clean":"2023-10-16T19:39:56.992572+0000","last_became_active":"2023-10-16T19:39:52.959281+0000","last_became_peered":"2023-10-16T19:39:52.959281+0000","last_unstale":"2023-10-16T19:39:56.992572+0000","last_undegraded":"2023-10-16T19:39:56.992572+0000","last_fullsized":"2023-10-16T19:39:56.992572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976892+0000","last_change":"2023-10-16T19:39:51.959600+0000","last_active":"2023-10-16T19:39:56.976892+0000","last_peered":"2023-10-16T19:39:56.976892+0000","last_clean":"2023-10-16T19:39:56.976892+0000","last_became_active":"2023-10-16T19:39:51.959297+0000","last_became_peered":"2023-10-16T19:39:51.959297+0000","last_unstale":"2023-10-16T19:39:56.976892+0000","last_undegraded":"2023-10-16T19:39:56.976892+0000","last_fullsized":"2023-10-16T19:39:56.976892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015841+0000","last_change":"2023-10-16T19:39:57.059572+0000","last_active":"2023-10-16T19:39:58.015841+0000","last_peered":"2023-10-16T19:39:58.015841+0000","last_clean":"2023-10-16T19:39:58.015841+0000","last_became_active":"2023-10-16T19:39:57.059178+0000","last_became_peered":"2023-10-16T19:39:57.059178+0000","last_unstale":"2023-10-16T19:39:58.015841+0000","last_undegraded":"2023-10-16T19:39:58.015841+0000","last_fullsized":"2023-10-16T19:39:58.015841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.986497+0000","last_change":"2023-10-16T19:39:52.976022+0000","last_active":"2023-10-16T19:39:56.986497+0000","last_peered":"2023-10-16T19:39:56.986497+0000","last_clean":"2023-10-16T19:39:56.986497+0000","last_became_active":"2023-10-16T19:39:52.971031+0000","last_became_peered":"2023-10-16T19:39:52.971031+0000","last_unstale":"2023-10-16T19:39:56.986497+0000","last_undegraded":"2023-10-16T19:39:56.986497+0000","last_fullsized":"2023-10-16T19:39:56.986497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984582+0000","last_change":"2023-10-16T19:39:51.965776+0000","last_active":"2023-10-16T19:39:56.984582+0000","last_peered":"2023-10-16T19:39:56.984582+0000","last_clean":"2023-10-16T19:39:56.984582+0000","last_became_active":"2023-10-16T19:39:51.965449+0000","last_became_peered":"2023-10-16T19:39:51.965449+0000","last_unstale":"2023-10-16T19:39:56.984582+0000","last_undegraded":"2023-10-16T19:39:56.984582+0000","last_fullsized":"2023-10-16T19:39:56.984582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054846+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:39:57.054846+0000","last_peered":"2023-10-16T19:39:57.054846+0000","last_clean":"2023-10-16T19:39:57.054846+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:39:57.054846+0000","last_undegraded":"2023-10-16T19:39:57.054846+0000","last_fullsized":"2023-10-16T19:39:57.054846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.057034+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.056631+0000","last_became_peered":"2023-10-16T19:39:57.056631+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.981859+0000","last_change":"2023-10-16T19:39:52.968932+0000","last_active":"2023-10-16T19:39:56.981859+0000","last_peered":"2023-10-16T19:39:56.981859+0000","last_clean":"2023-10-16T19:39:56.981859+0000","last_became_active":"2023-10-16T19:39:52.968511+0000","last_became_peered":"2023-10-16T19:39:52.968511+0000","last_unstale":"2023-10-16T19:39:56.981859+0000","last_undegraded":"2023-10-16T19:39:56.981859+0000","last_fullsized":"2023-10-16T19:39:56.981859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:11.479736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054988+0000","last_change":"2023-10-16T19:39:51.960837+0000","last_active":"2023-10-16T19:39:57.054988+0000","last_peered":"2023-10-16T19:39:57.054988+0000","last_clean":"2023-10-16T19:39:57.054988+0000","last_became_active":"2023-10-16T19:39:51.960545+0000","last_became_peered":"2023-10-16T19:39:51.960545+0000","last_unstale":"2023-10-16T19:39:57.054988+0000","last_undegraded":"2023-10-16T19:39:57.054988+0000","last_fullsized":"2023-10-16T19:39:57.054988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752919+0000","last_change":"2023-10-16T19:39:57.055815+0000","last_active":"2023-10-16T19:39:58.752919+0000","last_peered":"2023-10-16T19:39:58.752919+0000","last_clean":"2023-10-16T19:39:58.752919+0000","last_became_active":"2023-10-16T19:39:57.055391+0000","last_became_peered":"2023-10-16T19:39:57.055391+0000","last_unstale":"2023-10-16T19:39:58.752919+0000","last_undegraded":"2023-10-16T19:39:58.752919+0000","last_fullsized":"2023-10-16T19:39:58.752919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055422+0000","last_change":"2023-10-16T19:39:51.967737+0000","last_active":"2023-10-16T19:39:57.055422+0000","last_peered":"2023-10-16T19:39:57.055422+0000","last_clean":"2023-10-16T19:39:57.055422+0000","last_became_active":"2023-10-16T19:39:51.967471+0000","last_became_peered":"2023-10-16T19:39:51.967471+0000","last_unstale":"2023-10-16T19:39:57.055422+0000","last_undegraded":"2023-10-16T19:39:57.055422+0000","last_fullsized":"2023-10-16T19:39:57.055422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:25.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993807+0000","last_change":"2023-10-16T19:39:52.955655+0000","last_active":"2023-10-16T19:39:56.993807+0000","last_peered":"2023-10-16T19:39:56.993807+0000","last_clean":"2023-10-16T19:39:56.993807+0000","last_became_active":"2023-10-16T19:39:52.955304+0000","last_became_peered":"2023-10-16T19:39:52.955304+0000","last_unstale":"2023-10-16T19:39:56.993807+0000","last_undegraded":"2023-10-16T19:39:56.993807+0000","last_fullsized":"2023-10-16T19:39:56.993807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013463+0000","last_change":"2023-10-16T19:39:57.059558+0000","last_active":"2023-10-16T19:39:58.013463+0000","last_peered":"2023-10-16T19:39:58.013463+0000","last_clean":"2023-10-16T19:39:58.013463+0000","last_became_active":"2023-10-16T19:39:57.059184+0000","last_became_peered":"2023-10-16T19:39:57.059184+0000","last_unstale":"2023-10-16T19:39:58.013463+0000","last_undegraded":"2023-10-16T19:39:58.013463+0000","last_fullsized":"2023-10-16T19:39:58.013463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995142+0000","last_change":"2023-10-16T19:39:51.959372+0000","last_active":"2023-10-16T19:39:56.995142+0000","last_peered":"2023-10-16T19:39:56.995142+0000","last_clean":"2023-10-16T19:39:56.995142+0000","last_became_active":"2023-10-16T19:39:51.959042+0000","last_became_peered":"2023-10-16T19:39:51.959042+0000","last_unstale":"2023-10-16T19:39:56.995142+0000","last_undegraded":"2023-10-16T19:39:56.995142+0000","last_fullsized":"2023-10-16T19:39:56.995142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000396+0000","last_change":"2023-10-16T19:39:52.971901+0000","last_active":"2023-10-16T19:39:57.000396+0000","last_peered":"2023-10-16T19:39:57.000396+0000","last_clean":"2023-10-16T19:39:57.000396+0000","last_became_active":"2023-10-16T19:39:52.971585+0000","last_became_peered":"2023-10-16T19:39:52.971585+0000","last_unstale":"2023-10-16T19:39:57.000396+0000","last_undegraded":"2023-10-16T19:39:57.000396+0000","last_fullsized":"2023-10-16T19:39:57.000396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014361+0000","last_change":"2023-10-16T19:39:57.058350+0000","last_active":"2023-10-16T19:39:58.014361+0000","last_peered":"2023-10-16T19:39:58.014361+0000","last_clean":"2023-10-16T19:39:58.014361+0000","last_became_active":"2023-10-16T19:39:57.057923+0000","last_became_peered":"2023-10-16T19:39:57.057923+0000","last_unstale":"2023-10-16T19:39:58.014361+0000","last_undegraded":"2023-10-16T19:39:58.014361+0000","last_fullsized":"2023-10-16T19:39:58.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:30.363712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978788+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.978788+0000","last_peered":"2023-10-16T19:39:56.978788+0000","last_clean":"2023-10-16T19:39:56.978788+0000","last_became_active":"2023-10-16T19:39:51.956150+0000","last_became_peered":"2023-10-16T19:39:51.956150+0000","last_unstale":"2023-10-16T19:39:56.978788+0000","last_undegraded":"2023-10-16T19:39:56.978788+0000","last_fullsized":"2023-10-16T19:39:56.978788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.989271+0000","last_change":"2023-10-16T19:39:52.966065+0000","last_active":"2023-10-16T19:39:56.989271+0000","last_peered":"2023-10-16T19:39:56.989271+0000","last_clean":"2023-10-16T19:39:56.989271+0000","last_became_active":"2023-10-16T19:39:52.965732+0000","last_became_peered":"2023-10-16T19:39:52.965732+0000","last_unstale":"2023-10-16T19:39:56.989271+0000","last_undegraded":"2023-10-16T19:39:56.989271+0000","last_fullsized":"2023-10-16T19:39:56.989271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014987+0000","last_change":"2023-10-16T19:39:56.998411+0000","last_active":"2023-10-16T19:39:58.014987+0000","last_peered":"2023-10-16T19:39:58.014987+0000","last_clean":"2023-10-16T19:39:58.014987+0000","last_became_active":"2023-10-16T19:39:56.997765+0000","last_became_peered":"2023-10-16T19:39:56.997765+0000","last_unstale":"2023-10-16T19:39:58.014987+0000","last_undegraded":"2023-10-16T19:39:58.014987+0000","last_fullsized":"2023-10-16T19:39:58.014987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:48.787388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054917+0000","last_change":"2023-10-16T19:39:51.967870+0000","last_active":"2023-10-16T19:39:57.054917+0000","last_peered":"2023-10-16T19:39:57.054917+0000","last_clean":"2023-10-16T19:39:57.054917+0000","last_became_active":"2023-10-16T19:39:51.967540+0000","last_became_peered":"2023-10-16T19:39:51.967540+0000","last_unstale":"2023-10-16T19:39:57.054917+0000","last_undegraded":"2023-10-16T19:39:57.054917+0000","last_fullsized":"2023-10-16T19:39:57.054917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979126+0000","last_change":"2023-10-16T19:39:52.969100+0000","last_active":"2023-10-16T19:39:56.979126+0000","last_peered":"2023-10-16T19:39:56.979126+0000","last_clean":"2023-10-16T19:39:56.979126+0000","last_became_active":"2023-10-16T19:39:52.968640+0000","last_became_peered":"2023-10-16T19:39:52.968640+0000","last_unstale":"2023-10-16T19:39:56.979126+0000","last_undegraded":"2023-10-16T19:39:56.979126+0000","last_fullsized":"2023-10-16T19:39:56.979126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:36.664859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989349+0000","last_change":"2023-10-16T19:39:57.055862+0000","last_active":"2023-10-16T19:39:58.989349+0000","last_peered":"2023-10-16T19:39:58.989349+0000","last_clean":"2023-10-16T19:39:58.989349+0000","last_became_active":"2023-10-16T19:39:57.055442+0000","last_became_peered":"2023-10-16T19:39:57.055442+0000","last_unstale":"2023-10-16T19:39:58.989349+0000","last_undegraded":"2023-10-16T19:39:58.989349+0000","last_fullsized":"2023-10-16T19:39:58.989349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992158+0000","last_change":"2023-10-16T19:39:51.963084+0000","last_active":"2023-10-16T19:39:56.992158+0000","last_peered":"2023-10-16T19:39:56.992158+0000","last_clean":"2023-10-16T19:39:56.992158+0000","last_became_active":"2023-10-16T19:39:51.962807+0000","last_became_peered":"2023-10-16T19:39:51.962807+0000","last_unstale":"2023-10-16T19:39:56.992158+0000","last_undegraded":"2023-10-16T19:39:56.992158+0000","last_fullsized":"2023-10-16T19:39:56.992158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988486+0000","last_change":"2023-10-16T19:39:52.978428+0000","last_active":"2023-10-16T19:39:56.988486+0000","last_peered":"2023-10-16T19:39:56.988486+0000","last_clean":"2023-10-16T19:39:56.988486+0000","last_became_active":"2023-10-16T19:39:52.978101+0000","last_became_peered":"2023-10-16T19:39:52.978101+0000","last_unstale":"2023-10-16T19:39:56.988486+0000","last_undegraded":"2023-10-16T19:39:56.988486+0000","last_fullsized":"2023-10-16T19:39:56.988486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015410+0000","last_change":"2023-10-16T19:39:56.998806+0000","last_active":"2023-10-16T19:39:58.015410+0000","last_peered":"2023-10-16T19:39:58.015410+0000","last_clean":"2023-10-16T19:39:58.015410+0000","last_became_active":"2023-10-16T19:39:56.997925+0000","last_became_peered":"2023-10-16T19:39:56.997925+0000","last_unstale":"2023-10-16T19:39:58.015410+0000","last_undegraded":"2023-10-16T19:39:58.015410+0000","last_fullsized":"2023-10-16T19:39:58.015410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:08.168565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992271+0000","last_change":"2023-10-16T19:39:51.964864+0000","last_active":"2023-10-16T19:39:56.992271+0000","last_peered":"2023-10-16T19:39:56.992271+0000","last_clean":"2023-10-16T19:39:56.992271+0000","last_became_active":"2023-10-16T19:39:51.964479+0000","last_became_peered":"2023-10-16T19:39:51.964479+0000","last_unstale":"2023-10-16T19:39:56.992271+0000","last_undegraded":"2023-10-16T19:39:56.992271+0000","last_fullsized":"2023-10-16T19:39:56.992271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.659971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996915+0000","last_change":"2023-10-16T19:39:52.971775+0000","last_active":"2023-10-16T19:39:56.996915+0000","last_peered":"2023-10-16T19:39:56.996915+0000","last_clean":"2023-10-16T19:39:56.996915+0000","last_became_active":"2023-10-16T19:39:52.971381+0000","last_became_peered":"2023-10-16T19:39:52.971381+0000","last_unstale":"2023-10-16T19:39:56.996915+0000","last_undegraded":"2023-10-16T19:39:56.996915+0000","last_fullsized":"2023-10-16T19:39:56.996915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015073+0000","last_change":"2023-10-16T19:39:56.995155+0000","last_active":"2023-10-16T19:39:58.015073+0000","last_peered":"2023-10-16T19:39:58.015073+0000","last_clean":"2023-10-16T19:39:58.015073+0000","last_became_active":"2023-10-16T19:39:56.994693+0000","last_became_peered":"2023-10-16T19:39:56.994693+0000","last_unstale":"2023-10-16T19:39:58.015073+0000","last_undegraded":"2023-10-16T19:39:58.015073+0000","last_fullsized":"2023-10-16T19:39:58.015073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055607+0000","last_change":"2023-10-16T19:39:51.961933+0000","last_active":"2023-10-16T19:39:57.055607+0000","last_peered":"2023-10-16T19:39:57.055607+0000","last_clean":"2023-10-16T19:39:57.055607+0000","last_became_active":"2023-10-16T19:39:51.961548+0000","last_became_peered":"2023-10-16T19:39:51.961548+0000","last_unstale":"2023-10-16T19:39:57.055607+0000","last_undegraded":"2023-10-16T19:39:57.055607+0000","last_fullsized":"2023-10-16T19:39:57.055607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978123+0000","last_change":"2023-10-16T19:39:52.959823+0000","last_active":"2023-10-16T19:39:56.978123+0000","last_peered":"2023-10-16T19:39:56.978123+0000","last_clean":"2023-10-16T19:39:56.978123+0000","last_became_active":"2023-10-16T19:39:52.959508+0000","last_became_peered":"2023-10-16T19:39:52.959508+0000","last_unstale":"2023-10-16T19:39:56.978123+0000","last_undegraded":"2023-10-16T19:39:56.978123+0000","last_fullsized":"2023-10-16T19:39:56.978123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015856+0000","last_change":"2023-10-16T19:39:57.055819+0000","last_active":"2023-10-16T19:39:58.015856+0000","last_peered":"2023-10-16T19:39:58.015856+0000","last_clean":"2023-10-16T19:39:58.015856+0000","last_became_active":"2023-10-16T19:39:57.055371+0000","last_became_peered":"2023-10-16T19:39:57.055371+0000","last_unstale":"2023-10-16T19:39:58.015856+0000","last_undegraded":"2023-10-16T19:39:58.015856+0000","last_fullsized":"2023-10-16T19:39:58.015856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977712+0000","last_change":"2023-10-16T19:39:51.962380+0000","last_active":"2023-10-16T19:39:56.977712+0000","last_peered":"2023-10-16T19:39:56.977712+0000","last_clean":"2023-10-16T19:39:56.977712+0000","last_became_active":"2023-10-16T19:39:51.962053+0000","last_became_peered":"2023-10-16T19:39:51.962053+0000","last_unstale":"2023-10-16T19:39:56.977712+0000","last_undegraded":"2023-10-16T19:39:56.977712+0000","last_fullsized":"2023-10-16T19:39:56.977712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055763+0000","last_change":"2023-10-16T19:39:52.973102+0000","last_active":"2023-10-16T19:39:57.055763+0000","last_peered":"2023-10-16T19:39:57.055763+0000","last_clean":"2023-10-16T19:39:57.055763+0000","last_became_active":"2023-10-16T19:39:52.972823+0000","last_became_peered":"2023-10-16T19:39:52.972823+0000","last_unstale":"2023-10-16T19:39:57.055763+0000","last_undegraded":"2023-10-16T19:39:57.055763+0000","last_fullsized":"2023-10-16T19:39:57.055763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752852+0000","last_change":"2023-10-16T19:39:56.998067+0000","last_active":"2023-10-16T19:39:58.752852+0000","last_peered":"2023-10-16T19:39:58.752852+0000","last_clean":"2023-10-16T19:39:58.752852+0000","last_became_active":"2023-10-16T19:39:56.996916+0000","last_became_peered":"2023-10-16T19:39:56.996916+0000","last_unstale":"2023-10-16T19:39:58.752852+0000","last_undegraded":"2023-10-16T19:39:58.752852+0000","last_fullsized":"2023-10-16T19:39:58.752852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993787+0000","last_change":"2023-10-16T19:39:51.962402+0000","last_active":"2023-10-16T19:39:56.993787+0000","last_peered":"2023-10-16T19:39:56.993787+0000","last_clean":"2023-10-16T19:39:56.993787+0000","last_became_active":"2023-10-16T19:39:51.961789+0000","last_became_peered":"2023-10-16T19:39:51.961789+0000","last_unstale":"2023-10-16T19:39:56.993787+0000","last_undegraded":"2023-10-16T19:39:56.993787+0000","last_fullsized":"2023-10-16T19:39:56.993787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984210+0000","last_change":"2023-10-16T19:39:52.972162+0000","last_active":"2023-10-16T19:39:56.984210+0000","last_peered":"2023-10-16T19:39:56.984210+0000","last_clean":"2023-10-16T19:39:56.984210+0000","last_became_active":"2023-10-16T19:39:52.971650+0000","last_became_peered":"2023-10-16T19:39:52.971650+0000","last_unstale":"2023-10-16T19:39:56.984210+0000","last_undegraded":"2023-10-16T19:39:56.984210+0000","last_fullsized":"2023-10-16T19:39:56.984210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707432+0000","last_change":"2023-10-16T19:39:57.057262+0000","last_active":"2023-10-16T19:39:58.707432+0000","last_peered":"2023-10-16T19:39:58.707432+0000","last_clean":"2023-10-16T19:39:58.707432+0000","last_became_active":"2023-10-16T19:39:57.056817+0000","last_became_peered":"2023-10-16T19:39:57.056817+0000","last_unstale":"2023-10-16T19:39:58.707432+0000","last_undegraded":"2023-10-16T19:39:58.707432+0000","last_fullsized":"2023-10-16T19:39:58.707432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977037+0000","last_change":"2023-10-16T19:39:51.962396+0000","last_active":"2023-10-16T19:39:56.977037+0000","last_peered":"2023-10-16T19:39:56.977037+0000","last_clean":"2023-10-16T19:39:56.977037+0000","last_became_active":"2023-10-16T19:39:51.962087+0000","last_became_peered":"2023-10-16T19:39:51.962087+0000","last_unstale":"2023-10-16T19:39:56.977037+0000","last_undegraded":"2023-10-16T19:39:56.977037+0000","last_fullsized":"2023-10-16T19:39:56.977037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056819+0000","last_change":"2023-10-16T19:39:52.966846+0000","last_active":"2023-10-16T19:39:57.056819+0000","last_peered":"2023-10-16T19:39:57.056819+0000","last_clean":"2023-10-16T19:39:57.056819+0000","last_became_active":"2023-10-16T19:39:52.966558+0000","last_became_peered":"2023-10-16T19:39:52.966558+0000","last_unstale":"2023-10-16T19:39:57.056819+0000","last_undegraded":"2023-10-16T19:39:57.056819+0000","last_fullsized":"2023-10-16T19:39:57.056819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978101+0000","last_change":"2023-10-16T19:39:52.968833+0000","last_active":"2023-10-16T19:39:56.978101+0000","last_peered":"2023-10-16T19:39:56.978101+0000","last_clean":"2023-10-16T19:39:56.978101+0000","last_became_active":"2023-10-16T19:39:52.968540+0000","last_became_peered":"2023-10-16T19:39:52.968540+0000","last_unstale":"2023-10-16T19:39:56.978101+0000","last_undegraded":"2023-10-16T19:39:56.978101+0000","last_fullsized":"2023-10-16T19:39:56.978101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977005+0000","last_change":"2023-10-16T19:39:52.966376+0000","last_active":"2023-10-16T19:39:56.977005+0000","last_peered":"2023-10-16T19:39:56.977005+0000","last_clean":"2023-10-16T19:39:56.977005+0000","last_became_active":"2023-10-16T19:39:52.966044+0000","last_became_peered":"2023-10-16T19:39:52.966044+0000","last_unstale":"2023-10-16T19:39:56.977005+0000","last_undegraded":"2023-10-16T19:39:56.977005+0000","last_fullsized":"2023-10-16T19:39:56.977005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984282+0000","last_change":"2023-10-16T19:39:52.971488+0000","last_active":"2023-10-16T19:39:56.984282+0000","last_peered":"2023-10-16T19:39:56.984282+0000","last_clean":"2023-10-16T19:39:56.984282+0000","last_became_active":"2023-10-16T19:39:52.970909+0000","last_became_peered":"2023-10-16T19:39:52.970909+0000","last_unstale":"2023-10-16T19:39:56.984282+0000","last_undegraded":"2023-10-16T19:39:56.984282+0000","last_fullsized":"2023-10-16T19:39:56.984282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982419+0000","last_change":"2023-10-16T19:39:52.975269+0000","last_active":"2023-10-16T19:39:56.982419+0000","last_peered":"2023-10-16T19:39:56.982419+0000","last_clean":"2023-10-16T19:39:56.982419+0000","last_became_active":"2023-10-16T19:39:52.973150+0000","last_became_peered":"2023-10-16T19:39:52.973150+0000","last_unstale":"2023-10-16T19:39:56.982419+0000","last_undegraded":"2023-10-16T19:39:56.982419+0000","last_fullsized":"2023-10-16T19:39:56.982419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997003+0000","last_change":"2023-10-16T19:39:52.969771+0000","last_active":"2023-10-16T19:39:56.997003+0000","last_peered":"2023-10-16T19:39:56.997003+0000","last_clean":"2023-10-16T19:39:56.997003+0000","last_became_active":"2023-10-16T19:39:52.969468+0000","last_became_peered":"2023-10-16T19:39:52.969468+0000","last_unstale":"2023-10-16T19:39:56.997003+0000","last_undegraded":"2023-10-16T19:39:56.997003+0000","last_fullsized":"2023-10-16T19:39:56.997003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993745+0000","last_change":"2023-10-16T19:39:52.957538+0000","last_active":"2023-10-16T19:39:56.993745+0000","last_peered":"2023-10-16T19:39:56.993745+0000","last_clean":"2023-10-16T19:39:56.993745+0000","last_became_active":"2023-10-16T19:39:52.957106+0000","last_became_peered":"2023-10-16T19:39:52.957106+0000","last_unstale":"2023-10-16T19:39:56.993745+0000","last_undegraded":"2023-10-16T19:39:56.993745+0000","last_fullsized":"2023-10-16T19:39:56.993745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978579+0000","last_change":"2023-10-16T19:39:52.970773+0000","last_active":"2023-10-16T19:39:56.978579+0000","last_peered":"2023-10-16T19:39:56.978579+0000","last_clean":"2023-10-16T19:39:56.978579+0000","last_became_active":"2023-10-16T19:39:52.970485+0000","last_became_peered":"2023-10-16T19:39:52.970485+0000","last_unstale":"2023-10-16T19:39:56.978579+0000","last_undegraded":"2023-10-16T19:39:56.978579+0000","last_fullsized":"2023-10-16T19:39:56.978579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000749+0000","last_change":"2023-10-16T19:39:52.969630+0000","last_active":"2023-10-16T19:39:57.000749+0000","last_peered":"2023-10-16T19:39:57.000749+0000","last_clean":"2023-10-16T19:39:57.000749+0000","last_became_active":"2023-10-16T19:39:52.969298+0000","last_became_peered":"2023-10-16T19:39:52.969298+0000","last_unstale":"2023-10-16T19:39:57.000749+0000","last_undegraded":"2023-10-16T19:39:57.000749+0000","last_fullsized":"2023-10-16T19:39:57.000749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983919+0000","last_change":"2023-10-16T19:39:52.979228+0000","last_active":"2023-10-16T19:39:56.983919+0000","last_peered":"2023-10-16T19:39:56.983919+0000","last_clean":"2023-10-16T19:39:56.983919+0000","last_became_active":"2023-10-16T19:39:52.978788+0000","last_became_peered":"2023-10-16T19:39:52.978788+0000","last_unstale":"2023-10-16T19:39:56.983919+0000","last_undegraded":"2023-10-16T19:39:56.983919+0000","last_fullsized":"2023-10-16T19:39:56.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995707+0000","last_change":"2023-10-16T19:39:52.962415+0000","last_active":"2023-10-16T19:39:56.995707+0000","last_peered":"2023-10-16T19:39:56.995707+0000","last_clean":"2023-10-16T19:39:56.995707+0000","last_became_active":"2023-10-16T19:39:52.962093+0000","last_became_peered":"2023-10-16T19:39:52.962093+0000","last_unstale":"2023-10-16T19:39:56.995707+0000","last_undegraded":"2023-10-16T19:39:56.995707+0000","last_fullsized":"2023-10-16T19:39:56.995707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984054+0000","last_change":"2023-10-16T19:39:52.971993+0000","last_active":"2023-10-16T19:39:56.984054+0000","last_peered":"2023-10-16T19:39:56.984054+0000","last_clean":"2023-10-16T19:39:56.984054+0000","last_became_active":"2023-10-16T19:39:52.971684+0000","last_became_peered":"2023-10-16T19:39:52.971684+0000","last_unstale":"2023-10-16T19:39:56.984054+0000","last_undegraded":"2023-10-16T19:39:56.984054+0000","last_fullsized":"2023-10-16T19:39:56.984054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983218+0000","last_change":"2023-10-16T19:39:52.977733+0000","last_active":"2023-10-16T19:39:56.983218+0000","last_peered":"2023-10-16T19:39:56.983218+0000","last_clean":"2023-10-16T19:39:56.983218+0000","last_became_active":"2023-10-16T19:39:52.977383+0000","last_became_peered":"2023-10-16T19:39:52.977383+0000","last_unstale":"2023-10-16T19:39:56.983218+0000","last_undegraded":"2023-10-16T19:39:56.983218+0000","last_fullsized":"2023-10-16T19:39:56.983218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978000+0000","last_change":"2023-10-16T19:39:52.961967+0000","last_active":"2023-10-16T19:39:56.978000+0000","last_peered":"2023-10-16T19:39:56.978000+0000","last_clean":"2023-10-16T19:39:56.978000+0000","last_became_active":"2023-10-16T19:39:52.961663+0000","last_became_peered":"2023-10-16T19:39:52.961663+0000","last_unstale":"2023-10-16T19:39:56.978000+0000","last_undegraded":"2023-10-16T19:39:56.978000+0000","last_fullsized":"2023-10-16T19:39:56.978000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:40:23.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:40:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.608+0000 7f0a0fa18700 1 Processor -- start 2023-10-16T19:40:23.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0fa18700 1 -- start start 2023-10-16T19:40:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0fa18700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a080ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0fa18700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a08153710 con 0x7f0a08153290 2023-10-16T19:40:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0fa18700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a08156c60 con 0x7f0a0806a880 2023-10-16T19:40:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0fa18700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080ac7d0 con 0x7f0a0814c780 2023-10-16T19:40:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0cfb3700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0a08153290 0x7f0a0806d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37518/0 (socket says 172.21.15.29:37518) 2023-10-16T19:40:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.609+0000 7f0a0cfb3700 1 -- 172.21.15.29:0/2969361437 learned_addr learned my addr 172.21.15.29:0/2969361437 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f0a0d7b4700 1 --2- 172.21.15.29:0/2969361437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a080ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669801245 0 0) 0x7f0a08153710 con 0x7f0a08153290 2023-10-16T19:40:23.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f40035b0 con 0x7f0a08153290 2023-10-16T19:40:23.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717396830 0 0) 0x7f0a08156c60 con 0x7f0a0806a880 2023-10-16T19:40:23.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a08153710 con 0x7f0a0806a880 2023-10-16T19:40:23.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794145761 0 0) 0x7f09f40035b0 con 0x7f0a08153290 2023-10-16T19:40:23.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f0a0d7b4700 1 -- 172.21.15.29:0/2969361437 >> v1:172.21.15.53:6789/0 conn(0x7f0a0806a880 legacy=0x7f0a0806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f0a0d7b4700 1 -- 172.21.15.29:0/2969361437 >> v1:172.21.15.29:6789/0 conn(0x7f0a08153290 legacy=0x7f0a0806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f0a0d7b4700 1 -- 172.21.15.29:0/2969361437 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08155ea0 con 0x7f0a0814c780 2023-10-16T19:40:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f0a0d7b4700 1 --2- 172.21.15.29:0/2969361437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a080ac0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009870 tx=0x7f09fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71074b8567c2e146 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04001670 con 0x7f0a0814c780 2023-10-16T19:40:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc004030 con 0x7f0a0814c780 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.610+0000 7f09fbfff700 1 -- 172.21.15.29:0/2969361437 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0043a0 con 0x7f0a0814c780 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 -- 172.21.15.29:0/2969361437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 msgr2=0x7f0a080ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/2969361437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a080ac0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009870 tx=0x7f09fc009b80 comp rx=0 tx=0).stop 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 -- 172.21.15.29:0/2969361437 shutdown_connections 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/2969361437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a080ac0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 -- 172.21.15.29:0/2969361437 >> 172.21.15.29:0/2969361437 conn(0x7f0a080c66d0 msgr2=0x7f0a080c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 -- 172.21.15.29:0/2969361437 shutdown_connections 2023-10-16T19:40:23.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.611+0000 7f0a0fa18700 1 -- 172.21.15.29:0/2969361437 wait complete. 2023-10-16T19:40:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.612+0000 7f0a0fa18700 1 Processor -- start 2023-10-16T19:40:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.612+0000 7f0a0fa18700 1 -- start start 2023-10-16T19:40:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a0806a880 0x7f0a080c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a081ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08155c00 con 0x7f0a08153290 2023-10-16T19:40:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081ea1b0 con 0x7f0a0806a880 2023-10-16T19:40:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0fa18700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081e9ea0 con 0x7f0a0814c780 2023-10-16T19:40:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52084/0 (socket says 172.21.15.29:52084) 2023-10-16T19:40:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 -- 172.21.15.29:0/3883250341 learned_addr learned my addr 172.21.15.29:0/3883250341 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0d7b4700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a0806a880 0x7f0a080c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0cfb3700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a081ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 -- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 msgr2=0x7f0a081ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a081ea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 -- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a0806a880 msgr2=0x7f0a080c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a0806a880 0x7f0a080c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 -- 172.21.15.29:0/3883250341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0094a0 con 0x7f0a08153290 2023-10-16T19:40:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f0a0dfb5700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000cb10 tx=0x7f0a0000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.613+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00003c00 con 0x7f0a08153290 2023-10-16T19:40:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.614+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00003d60 con 0x7f0a08153290 2023-10-16T19:40:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.614+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a08153fd0 con 0x7f0a08153290 2023-10-16T19:40:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.614+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000a9e0 con 0x7f0a08153290 2023-10-16T19:40:23.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.614+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a08155920 con 0x7f0a08153290 2023-10-16T19:40:23.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.615+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a081ea2f0 con 0x7f0a08153290 2023-10-16T19:40:23.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.615+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a0000ab40 con 0x7f0a08153290 2023-10-16T19:40:23.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.616+0000 7f09f9ffb700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:23.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.616+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a00089730 con 0x7f0a08153290 2023-10-16T19:40:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.616+0000 7f0a0d7b4700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.616+0000 7f0a0d7b4700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 0x7f09ec06d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0097c0 tx=0x7f09fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.620+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a081ea2f0 con 0x7f0a08153290 2023-10-16T19:40:23.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.818+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a08156460 con 0x7f09ec06af00 2023-10-16T19:40:23.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.829+0000 7f09f9ffb700 1 -- 172.21.15.29:0/3883250341 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345251 (secure 0 0 0) 0x7f09fc0042c0 con 0x7f09ec06af00 2023-10-16T19:40:23.834 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:23.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 msgr2=0x7f09ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 0x7f09ec06d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0097c0 tx=0x7f09fc008030 comp rx=0 tx=0).stop 2023-10-16T19:40:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 msgr2=0x7f0a08070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000cb10 tx=0x7f0a0000ce20 comp rx=0 tx=0).stop 2023-10-16T19:40:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 shutdown_connections 2023-10-16T19:40:23.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f09ec06af00 0x7f09ec06d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a08153290 0x7f0a08070aa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a0806a880 0x7f0a080c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 --2- 172.21.15.29:0/3883250341 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0a0814c780 0x7f0a081ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 >> 172.21.15.29:0/3883250341 conn(0x7f0a080c66d0 msgr2=0x7f0a0806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:23.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 shutdown_connections 2023-10-16T19:40:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:23.832+0000 7f0a0fa18700 1 -- 172.21.15.29:0/3883250341 wait complete. 2023-10-16T19:40:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:40:23.846 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-16T19:40:22.563002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2025624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003636"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056933+0000","last_change":"2023-10-16T19:39:52.970740+0000","last_active":"2023-10-16T19:39:57.056933+0000","last_peered":"2023-10-16T19:39:57.056933+0000","last_clean":"2023-10-16T19:39:57.056933+0000","last_became_active":"2023-10-16T19:39:52.970471+0000","last_became_peered":"2023-10-16T19:39:52.970471+0000","last_unstale":"2023-10-16T19:39:57.056933+0000","last_undegraded":"2023-10-16T19:39:57.056933+0000","last_fullsized":"2023-10-16T19:39:57.056933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:28.159875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995299+0000","last_change":"2023-10-16T19:39:52.967596+0000","last_active":"2023-10-16T19:39:56.995299+0000","last_peered":"2023-10-16T19:39:56.995299+0000","last_clean":"2023-10-16T19:39:56.995299+0000","last_became_active":"2023-10-16T19:39:52.967235+0000","last_became_peered":"2023-10-16T19:39:52.967235+0000","last_unstale":"2023-10-16T19:39:56.995299+0000","last_undegraded":"2023-10-16T19:39:56.995299+0000","last_fullsized":"2023-10-16T19:39:56.995299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983237+0000","last_change":"2023-10-16T19:39:52.973343+0000","last_active":"2023-10-16T19:39:56.983237+0000","last_peered":"2023-10-16T19:39:56.983237+0000","last_clean":"2023-10-16T19:39:56.983237+0000","last_became_active":"2023-10-16T19:39:52.973035+0000","last_became_peered":"2023-10-16T19:39:52.973035+0000","last_unstale":"2023-10-16T19:39:56.983237+0000","last_undegraded":"2023-10-16T19:39:56.983237+0000","last_fullsized":"2023-10-16T19:39:56.983237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:11.377449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984370+0000","last_change":"2023-10-16T19:39:52.971942+0000","last_active":"2023-10-16T19:39:56.984370+0000","last_peered":"2023-10-16T19:39:56.984370+0000","last_clean":"2023-10-16T19:39:56.984370+0000","last_became_active":"2023-10-16T19:39:52.971194+0000","last_became_peered":"2023-10-16T19:39:52.971194+0000","last_unstale":"2023-10-16T19:39:56.984370+0000","last_undegraded":"2023-10-16T19:39:56.984370+0000","last_fullsized":"2023-10-16T19:39:56.984370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055336+0000","last_change":"2023-10-16T19:39:52.968333+0000","last_active":"2023-10-16T19:39:57.055336+0000","last_peered":"2023-10-16T19:39:57.055336+0000","last_clean":"2023-10-16T19:39:57.055336+0000","last_became_active":"2023-10-16T19:39:52.968039+0000","last_became_peered":"2023-10-16T19:39:52.968039+0000","last_unstale":"2023-10-16T19:39:57.055336+0000","last_undegraded":"2023-10-16T19:39:57.055336+0000","last_fullsized":"2023-10-16T19:39:57.055336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984153+0000","last_change":"2023-10-16T19:39:52.977137+0000","last_active":"2023-10-16T19:39:56.984153+0000","last_peered":"2023-10-16T19:39:56.984153+0000","last_clean":"2023-10-16T19:39:56.984153+0000","last_became_active":"2023-10-16T19:39:52.976671+0000","last_became_peered":"2023-10-16T19:39:52.976671+0000","last_unstale":"2023-10-16T19:39:56.984153+0000","last_undegraded":"2023-10-16T19:39:56.984153+0000","last_fullsized":"2023-10-16T19:39:56.984153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054955+0000","last_change":"2023-10-16T19:39:52.969912+0000","last_active":"2023-10-16T19:39:57.054955+0000","last_peered":"2023-10-16T19:39:57.054955+0000","last_clean":"2023-10-16T19:39:57.054955+0000","last_became_active":"2023-10-16T19:39:52.969619+0000","last_became_peered":"2023-10-16T19:39:52.969619+0000","last_unstale":"2023-10-16T19:39:57.054955+0000","last_undegraded":"2023-10-16T19:39:57.054955+0000","last_fullsized":"2023-10-16T19:39:57.054955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988599+0000","last_change":"2023-10-16T19:39:52.977292+0000","last_active":"2023-10-16T19:39:56.988599+0000","last_peered":"2023-10-16T19:39:56.988599+0000","last_clean":"2023-10-16T19:39:56.988599+0000","last_became_active":"2023-10-16T19:39:52.976867+0000","last_became_peered":"2023-10-16T19:39:52.976867+0000","last_unstale":"2023-10-16T19:39:56.988599+0000","last_undegraded":"2023-10-16T19:39:56.988599+0000","last_fullsized":"2023-10-16T19:39:56.988599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056855+0000","last_change":"2023-10-16T19:39:52.971411+0000","last_active":"2023-10-16T19:39:57.056855+0000","last_peered":"2023-10-16T19:39:57.056855+0000","last_clean":"2023-10-16T19:39:57.056855+0000","last_became_active":"2023-10-16T19:39:52.971042+0000","last_became_peered":"2023-10-16T19:39:52.971042+0000","last_unstale":"2023-10-16T19:39:57.056855+0000","last_undegraded":"2023-10-16T19:39:57.056855+0000","last_fullsized":"2023-10-16T19:39:57.056855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:43.719224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978310+0000","last_change":"2023-10-16T19:39:52.966574+0000","last_active":"2023-10-16T19:39:56.978310+0000","last_peered":"2023-10-16T19:39:56.978310+0000","last_clean":"2023-10-16T19:39:56.978310+0000","last_became_active":"2023-10-16T19:39:52.966277+0000","last_became_peered":"2023-10-16T19:39:52.966277+0000","last_unstale":"2023-10-16T19:39:56.978310+0000","last_undegraded":"2023-10-16T19:39:56.978310+0000","last_fullsized":"2023-10-16T19:39:56.978310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978886+0000","last_change":"2023-10-16T19:39:52.971359+0000","last_active":"2023-10-16T19:39:56.978886+0000","last_peered":"2023-10-16T19:39:56.978886+0000","last_clean":"2023-10-16T19:39:56.978886+0000","last_became_active":"2023-10-16T19:39:52.971111+0000","last_became_peered":"2023-10-16T19:39:52.971111+0000","last_unstale":"2023-10-16T19:39:56.978886+0000","last_undegraded":"2023-10-16T19:39:56.978886+0000","last_fullsized":"2023-10-16T19:39:56.978886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979383+0000","last_change":"2023-10-16T19:39:52.966121+0000","last_active":"2023-10-16T19:39:56.979383+0000","last_peered":"2023-10-16T19:39:56.979383+0000","last_clean":"2023-10-16T19:39:56.979383+0000","last_became_active":"2023-10-16T19:39:52.965817+0000","last_became_peered":"2023-10-16T19:39:52.965817+0000","last_unstale":"2023-10-16T19:39:56.979383+0000","last_undegraded":"2023-10-16T19:39:56.979383+0000","last_fullsized":"2023-10-16T19:39:56.979383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996155+0000","last_change":"2023-10-16T19:39:52.971739+0000","last_active":"2023-10-16T19:39:56.996155+0000","last_peered":"2023-10-16T19:39:56.996155+0000","last_clean":"2023-10-16T19:39:56.996155+0000","last_became_active":"2023-10-16T19:39:52.970983+0000","last_became_peered":"2023-10-16T19:39:52.970983+0000","last_unstale":"2023-10-16T19:39:56.996155+0000","last_undegraded":"2023-10-16T19:39:56.996155+0000","last_fullsized":"2023-10-16T19:39:56.996155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982897+0000","last_change":"2023-10-16T19:39:52.962992+0000","last_active":"2023-10-16T19:39:56.982897+0000","last_peered":"2023-10-16T19:39:56.982897+0000","last_clean":"2023-10-16T19:39:56.982897+0000","last_became_active":"2023-10-16T19:39:52.962658+0000","last_became_peered":"2023-10-16T19:39:52.962658+0000","last_unstale":"2023-10-16T19:39:56.982897+0000","last_undegraded":"2023-10-16T19:39:56.982897+0000","last_fullsized":"2023-10-16T19:39:56.982897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.991949+0000","last_change":"2023-10-16T19:39:52.965403+0000","last_active":"2023-10-16T19:39:56.991949+0000","last_peered":"2023-10-16T19:39:56.991949+0000","last_clean":"2023-10-16T19:39:56.991949+0000","last_became_active":"2023-10-16T19:39:52.965160+0000","last_became_peered":"2023-10-16T19:39:52.965160+0000","last_unstale":"2023-10-16T19:39:56.991949+0000","last_undegraded":"2023-10-16T19:39:56.991949+0000","last_fullsized":"2023-10-16T19:39:56.991949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983686+0000","last_change":"2023-10-16T19:39:52.969063+0000","last_active":"2023-10-16T19:39:56.983686+0000","last_peered":"2023-10-16T19:39:56.983686+0000","last_clean":"2023-10-16T19:39:56.983686+0000","last_became_active":"2023-10-16T19:39:52.968770+0000","last_became_peered":"2023-10-16T19:39:52.968770+0000","last_unstale":"2023-10-16T19:39:56.983686+0000","last_undegraded":"2023-10-16T19:39:56.983686+0000","last_fullsized":"2023-10-16T19:39:56.983686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984501+0000","last_change":"2023-10-16T19:39:52.973031+0000","last_active":"2023-10-16T19:39:56.984501+0000","last_peered":"2023-10-16T19:39:56.984501+0000","last_clean":"2023-10-16T19:39:56.984501+0000","last_became_active":"2023-10-16T19:39:52.972734+0000","last_became_peered":"2023-10-16T19:39:52.972734+0000","last_unstale":"2023-10-16T19:39:56.984501+0000","last_undegraded":"2023-10-16T19:39:56.984501+0000","last_fullsized":"2023-10-16T19:39:56.984501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977146+0000","last_change":"2023-10-16T19:39:52.953856+0000","last_active":"2023-10-16T19:39:56.977146+0000","last_peered":"2023-10-16T19:39:56.977146+0000","last_clean":"2023-10-16T19:39:56.977146+0000","last_became_active":"2023-10-16T19:39:52.953556+0000","last_became_peered":"2023-10-16T19:39:52.953556+0000","last_unstale":"2023-10-16T19:39:56.977146+0000","last_undegraded":"2023-10-16T19:39:56.977146+0000","last_fullsized":"2023-10-16T19:39:56.977146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:34.876574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056318+0000","last_change":"2023-10-16T19:39:52.966778+0000","last_active":"2023-10-16T19:39:57.056318+0000","last_peered":"2023-10-16T19:39:57.056318+0000","last_clean":"2023-10-16T19:39:57.056318+0000","last_became_active":"2023-10-16T19:39:52.966444+0000","last_became_peered":"2023-10-16T19:39:52.966444+0000","last_unstale":"2023-10-16T19:39:57.056318+0000","last_undegraded":"2023-10-16T19:39:57.056318+0000","last_fullsized":"2023-10-16T19:39:57.056318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014044+0000","last_change":"2023-10-16T19:39:57.060100+0000","last_active":"2023-10-16T19:39:58.014044+0000","last_peered":"2023-10-16T19:39:58.014044+0000","last_clean":"2023-10-16T19:39:58.014044+0000","last_became_active":"2023-10-16T19:39:57.059654+0000","last_became_peered":"2023-10-16T19:39:57.059654+0000","last_unstale":"2023-10-16T19:39:58.014044+0000","last_undegraded":"2023-10-16T19:39:58.014044+0000","last_fullsized":"2023-10-16T19:39:58.014044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983501+0000","last_change":"2023-10-16T19:39:51.960397+0000","last_active":"2023-10-16T19:39:56.983501+0000","last_peered":"2023-10-16T19:39:56.983501+0000","last_clean":"2023-10-16T19:39:56.983501+0000","last_became_active":"2023-10-16T19:39:51.959720+0000","last_became_peered":"2023-10-16T19:39:51.959720+0000","last_unstale":"2023-10-16T19:39:56.983501+0000","last_undegraded":"2023-10-16T19:39:56.983501+0000","last_fullsized":"2023-10-16T19:39:56.983501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997016+0000","last_change":"2023-10-16T19:39:52.970235+0000","last_active":"2023-10-16T19:39:56.997016+0000","last_peered":"2023-10-16T19:39:56.997016+0000","last_clean":"2023-10-16T19:39:56.997016+0000","last_became_active":"2023-10-16T19:39:52.969954+0000","last_became_peered":"2023-10-16T19:39:52.969954+0000","last_unstale":"2023-10-16T19:39:56.997016+0000","last_undegraded":"2023-10-16T19:39:56.997016+0000","last_fullsized":"2023-10-16T19:39:56.997016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014481+0000","last_change":"2023-10-16T19:39:56.998346+0000","last_active":"2023-10-16T19:39:58.014481+0000","last_peered":"2023-10-16T19:39:58.014481+0000","last_clean":"2023-10-16T19:39:58.014481+0000","last_became_active":"2023-10-16T19:39:56.997873+0000","last_became_peered":"2023-10-16T19:39:56.997873+0000","last_unstale":"2023-10-16T19:39:58.014481+0000","last_undegraded":"2023-10-16T19:39:58.014481+0000","last_fullsized":"2023-10-16T19:39:58.014481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:23.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997110+0000","last_change":"2023-10-16T19:39:51.953173+0000","last_active":"2023-10-16T19:39:56.997110+0000","last_peered":"2023-10-16T19:39:56.997110+0000","last_clean":"2023-10-16T19:39:56.997110+0000","last_became_active":"2023-10-16T19:39:51.952008+0000","last_became_peered":"2023-10-16T19:39:51.952008+0000","last_unstale":"2023-10-16T19:39:56.997110+0000","last_undegraded":"2023-10-16T19:39:56.997110+0000","last_fullsized":"2023-10-16T19:39:56.997110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983121+0000","last_change":"2023-10-16T19:39:52.972725+0000","last_active":"2023-10-16T19:39:56.983121+0000","last_peered":"2023-10-16T19:39:56.983121+0000","last_clean":"2023-10-16T19:39:56.983121+0000","last_became_active":"2023-10-16T19:39:52.972414+0000","last_became_peered":"2023-10-16T19:39:52.972414+0000","last_unstale":"2023-10-16T19:39:56.983121+0000","last_undegraded":"2023-10-16T19:39:56.983121+0000","last_fullsized":"2023-10-16T19:39:56.983121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014362+0000","last_change":"2023-10-16T19:39:56.999448+0000","last_active":"2023-10-16T19:39:58.014362+0000","last_peered":"2023-10-16T19:39:58.014362+0000","last_clean":"2023-10-16T19:39:58.014362+0000","last_became_active":"2023-10-16T19:39:56.997855+0000","last_became_peered":"2023-10-16T19:39:56.997855+0000","last_unstale":"2023-10-16T19:39:58.014362+0000","last_undegraded":"2023-10-16T19:39:58.014362+0000","last_fullsized":"2023-10-16T19:39:58.014362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:56.072025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055844+0000","last_change":"2023-10-16T19:39:51.960815+0000","last_active":"2023-10-16T19:39:57.055844+0000","last_peered":"2023-10-16T19:39:57.055844+0000","last_clean":"2023-10-16T19:39:57.055844+0000","last_became_active":"2023-10-16T19:39:51.960470+0000","last_became_peered":"2023-10-16T19:39:51.960470+0000","last_unstale":"2023-10-16T19:39:57.055844+0000","last_undegraded":"2023-10-16T19:39:57.055844+0000","last_fullsized":"2023-10-16T19:39:57.055844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:35.736680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984118+0000","last_change":"2023-10-16T19:39:52.965519+0000","last_active":"2023-10-16T19:39:56.984118+0000","last_peered":"2023-10-16T19:39:56.984118+0000","last_clean":"2023-10-16T19:39:56.984118+0000","last_became_active":"2023-10-16T19:39:52.965232+0000","last_became_peered":"2023-10-16T19:39:52.965232+0000","last_unstale":"2023-10-16T19:39:56.984118+0000","last_undegraded":"2023-10-16T19:39:56.984118+0000","last_fullsized":"2023-10-16T19:39:56.984118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014702+0000","last_change":"2023-10-16T19:39:56.998686+0000","last_active":"2023-10-16T19:39:58.014702+0000","last_peered":"2023-10-16T19:39:58.014702+0000","last_clean":"2023-10-16T19:39:58.014702+0000","last_became_active":"2023-10-16T19:39:56.998124+0000","last_became_peered":"2023-10-16T19:39:56.998124+0000","last_unstale":"2023-10-16T19:39:58.014702+0000","last_undegraded":"2023-10-16T19:39:58.014702+0000","last_fullsized":"2023-10-16T19:39:58.014702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:09.298354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055487+0000","last_change":"2023-10-16T19:39:51.963066+0000","last_active":"2023-10-16T19:39:57.055487+0000","last_peered":"2023-10-16T19:39:57.055487+0000","last_clean":"2023-10-16T19:39:57.055487+0000","last_became_active":"2023-10-16T19:39:51.962643+0000","last_became_peered":"2023-10-16T19:39:51.962643+0000","last_unstale":"2023-10-16T19:39:57.055487+0000","last_undegraded":"2023-10-16T19:39:57.055487+0000","last_fullsized":"2023-10-16T19:39:57.055487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:47.391429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984874+0000","last_change":"2023-10-16T19:39:52.965735+0000","last_active":"2023-10-16T19:39:56.984874+0000","last_peered":"2023-10-16T19:39:56.984874+0000","last_clean":"2023-10-16T19:39:56.984874+0000","last_became_active":"2023-10-16T19:39:52.965467+0000","last_became_peered":"2023-10-16T19:39:52.965467+0000","last_unstale":"2023-10-16T19:39:56.984874+0000","last_undegraded":"2023-10-16T19:39:56.984874+0000","last_fullsized":"2023-10-16T19:39:56.984874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014328+0000","last_change":"2023-10-16T19:39:57.004000+0000","last_active":"2023-10-16T19:39:58.014328+0000","last_peered":"2023-10-16T19:39:58.014328+0000","last_clean":"2023-10-16T19:39:58.014328+0000","last_became_active":"2023-10-16T19:39:57.003585+0000","last_became_peered":"2023-10-16T19:39:57.003585+0000","last_unstale":"2023-10-16T19:39:58.014328+0000","last_undegraded":"2023-10-16T19:39:58.014328+0000","last_fullsized":"2023-10-16T19:39:58.014328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:49.417708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996688+0000","last_change":"2023-10-16T19:39:51.963390+0000","last_active":"2023-10-16T19:39:56.996688+0000","last_peered":"2023-10-16T19:39:56.996688+0000","last_clean":"2023-10-16T19:39:56.996688+0000","last_became_active":"2023-10-16T19:39:51.963076+0000","last_became_peered":"2023-10-16T19:39:51.963076+0000","last_unstale":"2023-10-16T19:39:56.996688+0000","last_undegraded":"2023-10-16T19:39:56.996688+0000","last_fullsized":"2023-10-16T19:39:56.996688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978342+0000","last_change":"2023-10-16T19:39:52.961791+0000","last_active":"2023-10-16T19:39:56.978342+0000","last_peered":"2023-10-16T19:39:56.978342+0000","last_clean":"2023-10-16T19:39:56.978342+0000","last_became_active":"2023-10-16T19:39:52.960383+0000","last_became_peered":"2023-10-16T19:39:52.960383+0000","last_unstale":"2023-10-16T19:39:56.978342+0000","last_undegraded":"2023-10-16T19:39:56.978342+0000","last_fullsized":"2023-10-16T19:39:56.978342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:36:48.396317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.375697+0000","last_change":"2023-10-16T19:39:56.998866+0000","last_active":"2023-10-16T19:39:58.375697+0000","last_peered":"2023-10-16T19:39:58.375697+0000","last_clean":"2023-10-16T19:39:58.375697+0000","last_became_active":"2023-10-16T19:39:56.998515+0000","last_became_peered":"2023-10-16T19:39:56.998515+0000","last_unstale":"2023-10-16T19:39:58.375697+0000","last_undegraded":"2023-10-16T19:39:58.375697+0000","last_fullsized":"2023-10-16T19:39:58.375697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:15.516547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978023+0000","last_change":"2023-10-16T19:39:51.952902+0000","last_active":"2023-10-16T19:39:56.978023+0000","last_peered":"2023-10-16T19:39:56.978023+0000","last_clean":"2023-10-16T19:39:56.978023+0000","last_became_active":"2023-10-16T19:39:51.952591+0000","last_became_peered":"2023-10-16T19:39:51.952591+0000","last_unstale":"2023-10-16T19:39:56.978023+0000","last_undegraded":"2023-10-16T19:39:56.978023+0000","last_fullsized":"2023-10-16T19:39:56.978023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982312+0000","last_change":"2023-10-16T19:39:52.970475+0000","last_active":"2023-10-16T19:39:56.982312+0000","last_peered":"2023-10-16T19:39:56.982312+0000","last_clean":"2023-10-16T19:39:56.982312+0000","last_became_active":"2023-10-16T19:39:52.968544+0000","last_became_peered":"2023-10-16T19:39:52.968544+0000","last_unstale":"2023-10-16T19:39:56.982312+0000","last_undegraded":"2023-10-16T19:39:56.982312+0000","last_fullsized":"2023-10-16T19:39:56.982312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015980+0000","last_change":"2023-10-16T19:39:56.994009+0000","last_active":"2023-10-16T19:39:58.015980+0000","last_peered":"2023-10-16T19:39:58.015980+0000","last_clean":"2023-10-16T19:39:58.015980+0000","last_became_active":"2023-10-16T19:39:56.993681+0000","last_became_peered":"2023-10-16T19:39:56.993681+0000","last_unstale":"2023-10-16T19:39:58.015980+0000","last_undegraded":"2023-10-16T19:39:58.015980+0000","last_fullsized":"2023-10-16T19:39:58.015980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995806+0000","last_change":"2023-10-16T19:39:51.963829+0000","last_active":"2023-10-16T19:39:56.995806+0000","last_peered":"2023-10-16T19:39:56.995806+0000","last_clean":"2023-10-16T19:39:56.995806+0000","last_became_active":"2023-10-16T19:39:51.962756+0000","last_became_peered":"2023-10-16T19:39:51.962756+0000","last_unstale":"2023-10-16T19:39:56.995806+0000","last_undegraded":"2023-10-16T19:39:56.995806+0000","last_fullsized":"2023-10-16T19:39:56.995806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988378+0000","last_change":"2023-10-16T19:39:52.969328+0000","last_active":"2023-10-16T19:39:56.988378+0000","last_peered":"2023-10-16T19:39:56.988378+0000","last_clean":"2023-10-16T19:39:56.988378+0000","last_became_active":"2023-10-16T19:39:52.968930+0000","last_became_peered":"2023-10-16T19:39:52.968930+0000","last_unstale":"2023-10-16T19:39:56.988378+0000","last_undegraded":"2023-10-16T19:39:56.988378+0000","last_fullsized":"2023-10-16T19:39:56.988378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753706+0000","last_change":"2023-10-16T19:39:57.060169+0000","last_active":"2023-10-16T19:39:58.753706+0000","last_peered":"2023-10-16T19:39:58.753706+0000","last_clean":"2023-10-16T19:39:58.753706+0000","last_became_active":"2023-10-16T19:39:57.059047+0000","last_became_peered":"2023-10-16T19:39:57.059047+0000","last_unstale":"2023-10-16T19:39:58.753706+0000","last_undegraded":"2023-10-16T19:39:58.753706+0000","last_fullsized":"2023-10-16T19:39:58.753706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983925+0000","last_change":"2023-10-16T19:39:51.965322+0000","last_active":"2023-10-16T19:39:56.983925+0000","last_peered":"2023-10-16T19:39:56.983925+0000","last_clean":"2023-10-16T19:39:56.983925+0000","last_became_active":"2023-10-16T19:39:51.964942+0000","last_became_peered":"2023-10-16T19:39:51.964942+0000","last_unstale":"2023-10-16T19:39:56.983925+0000","last_undegraded":"2023-10-16T19:39:56.983925+0000","last_fullsized":"2023-10-16T19:39:56.983925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992388+0000","last_change":"2023-10-16T19:39:52.959908+0000","last_active":"2023-10-16T19:39:56.992388+0000","last_peered":"2023-10-16T19:39:56.992388+0000","last_clean":"2023-10-16T19:39:56.992388+0000","last_became_active":"2023-10-16T19:39:52.959614+0000","last_became_peered":"2023-10-16T19:39:52.959614+0000","last_unstale":"2023-10-16T19:39:56.992388+0000","last_undegraded":"2023-10-16T19:39:56.992388+0000","last_fullsized":"2023-10-16T19:39:56.992388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013814+0000","last_change":"2023-10-16T19:39:57.060218+0000","last_active":"2023-10-16T19:39:58.013814+0000","last_peered":"2023-10-16T19:39:58.013814+0000","last_clean":"2023-10-16T19:39:58.013814+0000","last_became_active":"2023-10-16T19:39:57.059234+0000","last_became_peered":"2023-10-16T19:39:57.059234+0000","last_unstale":"2023-10-16T19:39:58.013814+0000","last_undegraded":"2023-10-16T19:39:58.013814+0000","last_fullsized":"2023-10-16T19:39:58.013814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978943+0000","last_change":"2023-10-16T19:39:51.958717+0000","last_active":"2023-10-16T19:39:56.978943+0000","last_peered":"2023-10-16T19:39:56.978943+0000","last_clean":"2023-10-16T19:39:56.978943+0000","last_became_active":"2023-10-16T19:39:51.958416+0000","last_became_peered":"2023-10-16T19:39:51.958416+0000","last_unstale":"2023-10-16T19:39:56.978943+0000","last_undegraded":"2023-10-16T19:39:56.978943+0000","last_fullsized":"2023-10-16T19:39:56.978943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:19.799333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983880+0000","last_change":"2023-10-16T19:39:52.972637+0000","last_active":"2023-10-16T19:39:56.983880+0000","last_peered":"2023-10-16T19:39:56.983880+0000","last_clean":"2023-10-16T19:39:56.983880+0000","last_became_active":"2023-10-16T19:39:52.970837+0000","last_became_peered":"2023-10-16T19:39:52.970837+0000","last_unstale":"2023-10-16T19:39:56.983880+0000","last_undegraded":"2023-10-16T19:39:56.983880+0000","last_fullsized":"2023-10-16T19:39:56.983880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013875+0000","last_change":"2023-10-16T19:39:57.000167+0000","last_active":"2023-10-16T19:39:58.013875+0000","last_peered":"2023-10-16T19:39:58.013875+0000","last_clean":"2023-10-16T19:39:58.013875+0000","last_became_active":"2023-10-16T19:39:56.999442+0000","last_became_peered":"2023-10-16T19:39:56.999442+0000","last_unstale":"2023-10-16T19:39:58.013875+0000","last_undegraded":"2023-10-16T19:39:58.013875+0000","last_fullsized":"2023-10-16T19:39:58.013875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:55:03.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983872+0000","last_change":"2023-10-16T19:39:51.961261+0000","last_active":"2023-10-16T19:39:56.983872+0000","last_peered":"2023-10-16T19:39:56.983872+0000","last_clean":"2023-10-16T19:39:56.983872+0000","last_became_active":"2023-10-16T19:39:51.960815+0000","last_became_peered":"2023-10-16T19:39:51.960815+0000","last_unstale":"2023-10-16T19:39:56.983872+0000","last_undegraded":"2023-10-16T19:39:56.983872+0000","last_fullsized":"2023-10-16T19:39:56.983872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:20.342371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983682+0000","last_change":"2023-10-16T19:39:52.972640+0000","last_active":"2023-10-16T19:39:56.983682+0000","last_peered":"2023-10-16T19:39:56.983682+0000","last_clean":"2023-10-16T19:39:56.983682+0000","last_became_active":"2023-10-16T19:39:52.972308+0000","last_became_peered":"2023-10-16T19:39:52.972308+0000","last_unstale":"2023-10-16T19:39:56.983682+0000","last_undegraded":"2023-10-16T19:39:56.983682+0000","last_fullsized":"2023-10-16T19:39:56.983682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014924+0000","last_change":"2023-10-16T19:39:56.995225+0000","last_active":"2023-10-16T19:39:58.014924+0000","last_peered":"2023-10-16T19:39:58.014924+0000","last_clean":"2023-10-16T19:39:58.014924+0000","last_became_active":"2023-10-16T19:39:56.994760+0000","last_became_peered":"2023-10-16T19:39:56.994760+0000","last_unstale":"2023-10-16T19:39:58.014924+0000","last_undegraded":"2023-10-16T19:39:58.014924+0000","last_fullsized":"2023-10-16T19:39:58.014924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:43.007379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993849+0000","last_change":"2023-10-16T19:39:51.962481+0000","last_active":"2023-10-16T19:39:56.993849+0000","last_peered":"2023-10-16T19:39:56.993849+0000","last_clean":"2023-10-16T19:39:56.993849+0000","last_became_active":"2023-10-16T19:39:51.962183+0000","last_became_peered":"2023-10-16T19:39:51.962183+0000","last_unstale":"2023-10-16T19:39:56.993849+0000","last_undegraded":"2023-10-16T19:39:56.993849+0000","last_fullsized":"2023-10-16T19:39:56.993849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979596+0000","last_change":"2023-10-16T19:39:52.974753+0000","last_active":"2023-10-16T19:39:56.979596+0000","last_peered":"2023-10-16T19:39:56.979596+0000","last_clean":"2023-10-16T19:39:56.979596+0000","last_became_active":"2023-10-16T19:39:52.974437+0000","last_became_peered":"2023-10-16T19:39:52.974437+0000","last_unstale":"2023-10-16T19:39:56.979596+0000","last_undegraded":"2023-10-16T19:39:56.979596+0000","last_fullsized":"2023-10-16T19:39:56.979596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988925+0000","last_change":"2023-10-16T19:39:57.008281+0000","last_active":"2023-10-16T19:39:58.988925+0000","last_peered":"2023-10-16T19:39:58.988925+0000","last_clean":"2023-10-16T19:39:58.988925+0000","last_became_active":"2023-10-16T19:39:57.007275+0000","last_became_peered":"2023-10-16T19:39:57.007275+0000","last_unstale":"2023-10-16T19:39:58.988925+0000","last_undegraded":"2023-10-16T19:39:58.988925+0000","last_fullsized":"2023-10-16T19:39:58.988925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:40:08.652465+0000","last_change":"2023-10-16T19:39:51.949368+0000","last_active":"2023-10-16T19:40:08.652465+0000","last_peered":"2023-10-16T19:40:08.652465+0000","last_clean":"2023-10-16T19:40:08.652465+0000","last_became_active":"2023-10-16T19:39:51.948876+0000","last_became_peered":"2023-10-16T19:39:51.948876+0000","last_unstale":"2023-10-16T19:40:08.652465+0000","last_undegraded":"2023-10-16T19:40:08.652465+0000","last_fullsized":"2023-10-16T19:40:08.652465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.058349+0000","last_change":"2023-10-16T19:39:52.975376+0000","last_active":"2023-10-16T19:39:57.058349+0000","last_peered":"2023-10-16T19:39:57.058349+0000","last_clean":"2023-10-16T19:39:57.058349+0000","last_became_active":"2023-10-16T19:39:52.975093+0000","last_became_peered":"2023-10-16T19:39:52.975093+0000","last_unstale":"2023-10-16T19:39:57.058349+0000","last_undegraded":"2023-10-16T19:39:57.058349+0000","last_fullsized":"2023-10-16T19:39:57.058349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707865+0000","last_change":"2023-10-16T19:39:57.058788+0000","last_active":"2023-10-16T19:39:58.707865+0000","last_peered":"2023-10-16T19:39:58.707865+0000","last_clean":"2023-10-16T19:39:58.707865+0000","last_became_active":"2023-10-16T19:39:57.058309+0000","last_became_peered":"2023-10-16T19:39:57.058309+0000","last_unstale":"2023-10-16T19:39:58.707865+0000","last_undegraded":"2023-10-16T19:39:58.707865+0000","last_fullsized":"2023-10-16T19:39:58.707865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:28.658593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983378+0000","last_change":"2023-10-16T19:39:51.948746+0000","last_active":"2023-10-16T19:39:56.983378+0000","last_peered":"2023-10-16T19:39:56.983378+0000","last_clean":"2023-10-16T19:39:56.983378+0000","last_became_active":"2023-10-16T19:39:51.948396+0000","last_became_peered":"2023-10-16T19:39:51.948396+0000","last_unstale":"2023-10-16T19:39:56.983378+0000","last_undegraded":"2023-10-16T19:39:56.983378+0000","last_fullsized":"2023-10-16T19:39:56.983378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983007+0000","last_change":"2023-10-16T19:39:52.968344+0000","last_active":"2023-10-16T19:39:56.983007+0000","last_peered":"2023-10-16T19:39:56.983007+0000","last_clean":"2023-10-16T19:39:56.983007+0000","last_became_active":"2023-10-16T19:39:52.967192+0000","last_became_peered":"2023-10-16T19:39:52.967192+0000","last_unstale":"2023-10-16T19:39:56.983007+0000","last_undegraded":"2023-10-16T19:39:56.983007+0000","last_fullsized":"2023-10-16T19:39:56.983007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014138+0000","last_change":"2023-10-16T19:39:57.055830+0000","last_active":"2023-10-16T19:39:58.014138+0000","last_peered":"2023-10-16T19:39:58.014138+0000","last_clean":"2023-10-16T19:39:58.014138+0000","last_became_active":"2023-10-16T19:39:57.055354+0000","last_became_peered":"2023-10-16T19:39:57.055354+0000","last_unstale":"2023-10-16T19:39:58.014138+0000","last_undegraded":"2023-10-16T19:39:58.014138+0000","last_fullsized":"2023-10-16T19:39:58.014138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:29.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983949+0000","last_change":"2023-10-16T19:39:51.964774+0000","last_active":"2023-10-16T19:39:56.983949+0000","last_peered":"2023-10-16T19:39:56.983949+0000","last_clean":"2023-10-16T19:39:56.983949+0000","last_became_active":"2023-10-16T19:39:51.964474+0000","last_became_peered":"2023-10-16T19:39:51.964474+0000","last_unstale":"2023-10-16T19:39:56.983949+0000","last_undegraded":"2023-10-16T19:39:56.983949+0000","last_fullsized":"2023-10-16T19:39:56.983949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055729+0000","last_change":"2023-10-16T19:39:52.968350+0000","last_active":"2023-10-16T19:39:57.055729+0000","last_peered":"2023-10-16T19:39:57.055729+0000","last_clean":"2023-10-16T19:39:57.055729+0000","last_became_active":"2023-10-16T19:39:52.968051+0000","last_became_peered":"2023-10-16T19:39:52.968051+0000","last_unstale":"2023-10-16T19:39:57.055729+0000","last_undegraded":"2023-10-16T19:39:57.055729+0000","last_fullsized":"2023-10-16T19:39:57.055729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:17.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014589+0000","last_change":"2023-10-16T19:39:57.059505+0000","last_active":"2023-10-16T19:39:58.014589+0000","last_peered":"2023-10-16T19:39:58.014589+0000","last_clean":"2023-10-16T19:39:58.014589+0000","last_became_active":"2023-10-16T19:39:57.059040+0000","last_became_peered":"2023-10-16T19:39:57.059040+0000","last_unstale":"2023-10-16T19:39:58.014589+0000","last_undegraded":"2023-10-16T19:39:58.014589+0000","last_fullsized":"2023-10-16T19:39:58.014589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:11.600778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978736+0000","last_change":"2023-10-16T19:39:51.953128+0000","last_active":"2023-10-16T19:39:56.978736+0000","last_peered":"2023-10-16T19:39:56.978736+0000","last_clean":"2023-10-16T19:39:56.978736+0000","last_became_active":"2023-10-16T19:39:51.952236+0000","last_became_peered":"2023-10-16T19:39:51.952236+0000","last_unstale":"2023-10-16T19:39:56.978736+0000","last_undegraded":"2023-10-16T19:39:56.978736+0000","last_fullsized":"2023-10-16T19:39:56.978736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:43:33.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977997+0000","last_change":"2023-10-16T19:39:52.967912+0000","last_active":"2023-10-16T19:39:56.977997+0000","last_peered":"2023-10-16T19:39:56.977997+0000","last_clean":"2023-10-16T19:39:56.977997+0000","last_became_active":"2023-10-16T19:39:52.967616+0000","last_became_peered":"2023-10-16T19:39:52.967616+0000","last_unstale":"2023-10-16T19:39:56.977997+0000","last_undegraded":"2023-10-16T19:39:56.977997+0000","last_fullsized":"2023-10-16T19:39:56.977997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.000483+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.000036+0000","last_became_peered":"2023-10-16T19:39:57.000036+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:47.756036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976895+0000","last_change":"2023-10-16T19:39:51.956225+0000","last_active":"2023-10-16T19:39:56.976895+0000","last_peered":"2023-10-16T19:39:56.976895+0000","last_clean":"2023-10-16T19:39:56.976895+0000","last_became_active":"2023-10-16T19:39:51.955913+0000","last_became_peered":"2023-10-16T19:39:51.955913+0000","last_unstale":"2023-10-16T19:39:56.976895+0000","last_undegraded":"2023-10-16T19:39:56.976895+0000","last_fullsized":"2023-10-16T19:39:56.976895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:55.435969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055053+0000","last_change":"2023-10-16T19:39:52.968227+0000","last_active":"2023-10-16T19:39:57.055053+0000","last_peered":"2023-10-16T19:39:57.055053+0000","last_clean":"2023-10-16T19:39:57.055053+0000","last_became_active":"2023-10-16T19:39:52.967354+0000","last_became_peered":"2023-10-16T19:39:52.967354+0000","last_unstale":"2023-10-16T19:39:57.055053+0000","last_undegraded":"2023-10-16T19:39:57.055053+0000","last_fullsized":"2023-10-16T19:39:57.055053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:45.889255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015289+0000","last_change":"2023-10-16T19:39:56.999092+0000","last_active":"2023-10-16T19:39:58.015289+0000","last_peered":"2023-10-16T19:39:58.015289+0000","last_clean":"2023-10-16T19:39:58.015289+0000","last_became_active":"2023-10-16T19:39:56.998522+0000","last_became_peered":"2023-10-16T19:39:56.998522+0000","last_unstale":"2023-10-16T19:39:58.015289+0000","last_undegraded":"2023-10-16T19:39:58.015289+0000","last_fullsized":"2023-10-16T19:39:58.015289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:40.778380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979452+0000","last_change":"2023-10-16T19:39:51.962668+0000","last_active":"2023-10-16T19:39:56.979452+0000","last_peered":"2023-10-16T19:39:56.979452+0000","last_clean":"2023-10-16T19:39:56.979452+0000","last_became_active":"2023-10-16T19:39:51.962380+0000","last_became_peered":"2023-10-16T19:39:51.962380+0000","last_unstale":"2023-10-16T19:39:56.979452+0000","last_undegraded":"2023-10-16T19:39:56.979452+0000","last_fullsized":"2023-10-16T19:39:56.979452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055973+0000","last_change":"2023-10-16T19:39:52.967234+0000","last_active":"2023-10-16T19:39:57.055973+0000","last_peered":"2023-10-16T19:39:57.055973+0000","last_clean":"2023-10-16T19:39:57.055973+0000","last_became_active":"2023-10-16T19:39:52.966932+0000","last_became_peered":"2023-10-16T19:39:52.966932+0000","last_unstale":"2023-10-16T19:39:57.055973+0000","last_undegraded":"2023-10-16T19:39:57.055973+0000","last_fullsized":"2023-10-16T19:39:57.055973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:38.970567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988889+0000","last_change":"2023-10-16T19:39:57.008404+0000","last_active":"2023-10-16T19:39:58.988889+0000","last_peered":"2023-10-16T19:39:58.988889+0000","last_clean":"2023-10-16T19:39:58.988889+0000","last_became_active":"2023-10-16T19:39:57.007860+0000","last_became_peered":"2023-10-16T19:39:57.007860+0000","last_unstale":"2023-10-16T19:39:58.988889+0000","last_undegraded":"2023-10-16T19:39:58.988889+0000","last_fullsized":"2023-10-16T19:39:58.988889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993704+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.993704+0000","last_peered":"2023-10-16T19:39:56.993704+0000","last_clean":"2023-10-16T19:39:56.993704+0000","last_became_active":"2023-10-16T19:39:51.956344+0000","last_became_peered":"2023-10-16T19:39:51.956344+0000","last_unstale":"2023-10-16T19:39:56.993704+0000","last_undegraded":"2023-10-16T19:39:56.993704+0000","last_fullsized":"2023-10-16T19:39:56.993704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:07.860685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984972+0000","last_change":"2023-10-16T19:39:52.976139+0000","last_active":"2023-10-16T19:39:56.984972+0000","last_peered":"2023-10-16T19:39:56.984972+0000","last_clean":"2023-10-16T19:39:56.984972+0000","last_became_active":"2023-10-16T19:39:52.975846+0000","last_became_peered":"2023-10-16T19:39:52.975846+0000","last_unstale":"2023-10-16T19:39:56.984972+0000","last_undegraded":"2023-10-16T19:39:56.984972+0000","last_fullsized":"2023-10-16T19:39:56.984972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.988843+0000","last_change":"2023-10-16T19:39:57.005213+0000","last_active":"2023-10-16T19:39:58.988843+0000","last_peered":"2023-10-16T19:39:58.988843+0000","last_clean":"2023-10-16T19:39:58.988843+0000","last_became_active":"2023-10-16T19:39:57.004875+0000","last_became_peered":"2023-10-16T19:39:57.004875+0000","last_unstale":"2023-10-16T19:39:58.988843+0000","last_undegraded":"2023-10-16T19:39:58.988843+0000","last_fullsized":"2023-10-16T19:39:58.988843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983833+0000","last_change":"2023-10-16T19:39:51.966189+0000","last_active":"2023-10-16T19:39:56.983833+0000","last_peered":"2023-10-16T19:39:56.983833+0000","last_clean":"2023-10-16T19:39:56.983833+0000","last_became_active":"2023-10-16T19:39:51.965851+0000","last_became_peered":"2023-10-16T19:39:51.965851+0000","last_unstale":"2023-10-16T19:39:56.983833+0000","last_undegraded":"2023-10-16T19:39:56.983833+0000","last_fullsized":"2023-10-16T19:39:56.983833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979924+0000","last_change":"2023-10-16T19:39:52.969798+0000","last_active":"2023-10-16T19:39:56.979924+0000","last_peered":"2023-10-16T19:39:56.979924+0000","last_clean":"2023-10-16T19:39:56.979924+0000","last_became_active":"2023-10-16T19:39:52.969403+0000","last_became_peered":"2023-10-16T19:39:52.969403+0000","last_unstale":"2023-10-16T19:39:56.979924+0000","last_undegraded":"2023-10-16T19:39:56.979924+0000","last_fullsized":"2023-10-16T19:39:56.979924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:18.043026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989269+0000","last_change":"2023-10-16T19:39:57.006715+0000","last_active":"2023-10-16T19:39:58.989269+0000","last_peered":"2023-10-16T19:39:58.989269+0000","last_clean":"2023-10-16T19:39:58.989269+0000","last_became_active":"2023-10-16T19:39:57.006456+0000","last_became_peered":"2023-10-16T19:39:57.006456+0000","last_unstale":"2023-10-16T19:39:58.989269+0000","last_undegraded":"2023-10-16T19:39:58.989269+0000","last_fullsized":"2023-10-16T19:39:58.989269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992572+0000","last_change":"2023-10-16T19:39:52.959610+0000","last_active":"2023-10-16T19:39:56.992572+0000","last_peered":"2023-10-16T19:39:56.992572+0000","last_clean":"2023-10-16T19:39:56.992572+0000","last_became_active":"2023-10-16T19:39:52.959281+0000","last_became_peered":"2023-10-16T19:39:52.959281+0000","last_unstale":"2023-10-16T19:39:56.992572+0000","last_undegraded":"2023-10-16T19:39:56.992572+0000","last_fullsized":"2023-10-16T19:39:56.992572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.976892+0000","last_change":"2023-10-16T19:39:51.959600+0000","last_active":"2023-10-16T19:39:56.976892+0000","last_peered":"2023-10-16T19:39:56.976892+0000","last_clean":"2023-10-16T19:39:56.976892+0000","last_became_active":"2023-10-16T19:39:51.959297+0000","last_became_peered":"2023-10-16T19:39:51.959297+0000","last_unstale":"2023-10-16T19:39:56.976892+0000","last_undegraded":"2023-10-16T19:39:56.976892+0000","last_fullsized":"2023-10-16T19:39:56.976892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015841+0000","last_change":"2023-10-16T19:39:57.059572+0000","last_active":"2023-10-16T19:39:58.015841+0000","last_peered":"2023-10-16T19:39:58.015841+0000","last_clean":"2023-10-16T19:39:58.015841+0000","last_became_active":"2023-10-16T19:39:57.059178+0000","last_became_peered":"2023-10-16T19:39:57.059178+0000","last_unstale":"2023-10-16T19:39:58.015841+0000","last_undegraded":"2023-10-16T19:39:58.015841+0000","last_fullsized":"2023-10-16T19:39:58.015841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.986497+0000","last_change":"2023-10-16T19:39:52.976022+0000","last_active":"2023-10-16T19:39:56.986497+0000","last_peered":"2023-10-16T19:39:56.986497+0000","last_clean":"2023-10-16T19:39:56.986497+0000","last_became_active":"2023-10-16T19:39:52.971031+0000","last_became_peered":"2023-10-16T19:39:52.971031+0000","last_unstale":"2023-10-16T19:39:56.986497+0000","last_undegraded":"2023-10-16T19:39:56.986497+0000","last_fullsized":"2023-10-16T19:39:56.986497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984582+0000","last_change":"2023-10-16T19:39:51.965776+0000","last_active":"2023-10-16T19:39:56.984582+0000","last_peered":"2023-10-16T19:39:56.984582+0000","last_clean":"2023-10-16T19:39:56.984582+0000","last_became_active":"2023-10-16T19:39:51.965449+0000","last_became_peered":"2023-10-16T19:39:51.965449+0000","last_unstale":"2023-10-16T19:39:56.984582+0000","last_undegraded":"2023-10-16T19:39:56.984582+0000","last_fullsized":"2023-10-16T19:39:56.984582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054846+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:39:57.054846+0000","last_peered":"2023-10-16T19:39:57.054846+0000","last_clean":"2023-10-16T19:39:57.054846+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:39:57.054846+0000","last_undegraded":"2023-10-16T19:39:57.054846+0000","last_fullsized":"2023-10-16T19:39:57.054846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.753535+0000","last_change":"2023-10-16T19:39:57.057034+0000","last_active":"2023-10-16T19:39:58.753535+0000","last_peered":"2023-10-16T19:39:58.753535+0000","last_clean":"2023-10-16T19:39:58.753535+0000","last_became_active":"2023-10-16T19:39:57.056631+0000","last_became_peered":"2023-10-16T19:39:57.056631+0000","last_unstale":"2023-10-16T19:39:58.753535+0000","last_undegraded":"2023-10-16T19:39:58.753535+0000","last_fullsized":"2023-10-16T19:39:58.753535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.981859+0000","last_change":"2023-10-16T19:39:52.968932+0000","last_active":"2023-10-16T19:39:56.981859+0000","last_peered":"2023-10-16T19:39:56.981859+0000","last_clean":"2023-10-16T19:39:56.981859+0000","last_became_active":"2023-10-16T19:39:52.968511+0000","last_became_peered":"2023-10-16T19:39:52.968511+0000","last_unstale":"2023-10-16T19:39:56.981859+0000","last_undegraded":"2023-10-16T19:39:56.981859+0000","last_fullsized":"2023-10-16T19:39:56.981859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:11.479736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054988+0000","last_change":"2023-10-16T19:39:51.960837+0000","last_active":"2023-10-16T19:39:57.054988+0000","last_peered":"2023-10-16T19:39:57.054988+0000","last_clean":"2023-10-16T19:39:57.054988+0000","last_became_active":"2023-10-16T19:39:51.960545+0000","last_became_peered":"2023-10-16T19:39:51.960545+0000","last_unstale":"2023-10-16T19:39:57.054988+0000","last_undegraded":"2023-10-16T19:39:57.054988+0000","last_fullsized":"2023-10-16T19:39:57.054988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752919+0000","last_change":"2023-10-16T19:39:57.055815+0000","last_active":"2023-10-16T19:39:58.752919+0000","last_peered":"2023-10-16T19:39:58.752919+0000","last_clean":"2023-10-16T19:39:58.752919+0000","last_became_active":"2023-10-16T19:39:57.055391+0000","last_became_peered":"2023-10-16T19:39:57.055391+0000","last_unstale":"2023-10-16T19:39:58.752919+0000","last_undegraded":"2023-10-16T19:39:58.752919+0000","last_fullsized":"2023-10-16T19:39:58.752919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:21.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055422+0000","last_change":"2023-10-16T19:39:51.967737+0000","last_active":"2023-10-16T19:39:57.055422+0000","last_peered":"2023-10-16T19:39:57.055422+0000","last_clean":"2023-10-16T19:39:57.055422+0000","last_became_active":"2023-10-16T19:39:51.967471+0000","last_became_peered":"2023-10-16T19:39:51.967471+0000","last_unstale":"2023-10-16T19:39:57.055422+0000","last_undegraded":"2023-10-16T19:39:57.055422+0000","last_fullsized":"2023-10-16T19:39:57.055422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:25.322012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993807+0000","last_change":"2023-10-16T19:39:52.955655+0000","last_active":"2023-10-16T19:39:56.993807+0000","last_peered":"2023-10-16T19:39:56.993807+0000","last_clean":"2023-10-16T19:39:56.993807+0000","last_became_active":"2023-10-16T19:39:52.955304+0000","last_became_peered":"2023-10-16T19:39:52.955304+0000","last_unstale":"2023-10-16T19:39:56.993807+0000","last_undegraded":"2023-10-16T19:39:56.993807+0000","last_fullsized":"2023-10-16T19:39:56.993807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.013463+0000","last_change":"2023-10-16T19:39:57.059558+0000","last_active":"2023-10-16T19:39:58.013463+0000","last_peered":"2023-10-16T19:39:58.013463+0000","last_clean":"2023-10-16T19:39:58.013463+0000","last_became_active":"2023-10-16T19:39:57.059184+0000","last_became_peered":"2023-10-16T19:39:57.059184+0000","last_unstale":"2023-10-16T19:39:58.013463+0000","last_undegraded":"2023-10-16T19:39:58.013463+0000","last_fullsized":"2023-10-16T19:39:58.013463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:32.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995142+0000","last_change":"2023-10-16T19:39:51.959372+0000","last_active":"2023-10-16T19:39:56.995142+0000","last_peered":"2023-10-16T19:39:56.995142+0000","last_clean":"2023-10-16T19:39:56.995142+0000","last_became_active":"2023-10-16T19:39:51.959042+0000","last_became_peered":"2023-10-16T19:39:51.959042+0000","last_unstale":"2023-10-16T19:39:56.995142+0000","last_undegraded":"2023-10-16T19:39:56.995142+0000","last_fullsized":"2023-10-16T19:39:56.995142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:10.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000396+0000","last_change":"2023-10-16T19:39:52.971901+0000","last_active":"2023-10-16T19:39:57.000396+0000","last_peered":"2023-10-16T19:39:57.000396+0000","last_clean":"2023-10-16T19:39:57.000396+0000","last_became_active":"2023-10-16T19:39:52.971585+0000","last_became_peered":"2023-10-16T19:39:52.971585+0000","last_unstale":"2023-10-16T19:39:57.000396+0000","last_undegraded":"2023-10-16T19:39:57.000396+0000","last_fullsized":"2023-10-16T19:39:57.000396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:04.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014361+0000","last_change":"2023-10-16T19:39:57.058350+0000","last_active":"2023-10-16T19:39:58.014361+0000","last_peered":"2023-10-16T19:39:58.014361+0000","last_clean":"2023-10-16T19:39:58.014361+0000","last_became_active":"2023-10-16T19:39:57.057923+0000","last_became_peered":"2023-10-16T19:39:57.057923+0000","last_unstale":"2023-10-16T19:39:58.014361+0000","last_undegraded":"2023-10-16T19:39:58.014361+0000","last_fullsized":"2023-10-16T19:39:58.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:30.363712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978788+0000","last_change":"2023-10-16T19:39:51.956699+0000","last_active":"2023-10-16T19:39:56.978788+0000","last_peered":"2023-10-16T19:39:56.978788+0000","last_clean":"2023-10-16T19:39:56.978788+0000","last_became_active":"2023-10-16T19:39:51.956150+0000","last_became_peered":"2023-10-16T19:39:51.956150+0000","last_unstale":"2023-10-16T19:39:56.978788+0000","last_undegraded":"2023-10-16T19:39:56.978788+0000","last_fullsized":"2023-10-16T19:39:56.978788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.989271+0000","last_change":"2023-10-16T19:39:52.966065+0000","last_active":"2023-10-16T19:39:56.989271+0000","last_peered":"2023-10-16T19:39:56.989271+0000","last_clean":"2023-10-16T19:39:56.989271+0000","last_became_active":"2023-10-16T19:39:52.965732+0000","last_became_peered":"2023-10-16T19:39:52.965732+0000","last_unstale":"2023-10-16T19:39:56.989271+0000","last_undegraded":"2023-10-16T19:39:56.989271+0000","last_fullsized":"2023-10-16T19:39:56.989271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.014987+0000","last_change":"2023-10-16T19:39:56.998411+0000","last_active":"2023-10-16T19:39:58.014987+0000","last_peered":"2023-10-16T19:39:58.014987+0000","last_clean":"2023-10-16T19:39:58.014987+0000","last_became_active":"2023-10-16T19:39:56.997765+0000","last_became_peered":"2023-10-16T19:39:56.997765+0000","last_unstale":"2023-10-16T19:39:58.014987+0000","last_undegraded":"2023-10-16T19:39:58.014987+0000","last_fullsized":"2023-10-16T19:39:58.014987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:48.787388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.054917+0000","last_change":"2023-10-16T19:39:51.967870+0000","last_active":"2023-10-16T19:39:57.054917+0000","last_peered":"2023-10-16T19:39:57.054917+0000","last_clean":"2023-10-16T19:39:57.054917+0000","last_became_active":"2023-10-16T19:39:51.967540+0000","last_became_peered":"2023-10-16T19:39:51.967540+0000","last_unstale":"2023-10-16T19:39:57.054917+0000","last_undegraded":"2023-10-16T19:39:57.054917+0000","last_fullsized":"2023-10-16T19:39:57.054917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:15:17.038138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.979126+0000","last_change":"2023-10-16T19:39:52.969100+0000","last_active":"2023-10-16T19:39:56.979126+0000","last_peered":"2023-10-16T19:39:56.979126+0000","last_clean":"2023-10-16T19:39:56.979126+0000","last_became_active":"2023-10-16T19:39:52.968640+0000","last_became_peered":"2023-10-16T19:39:52.968640+0000","last_unstale":"2023-10-16T19:39:56.979126+0000","last_undegraded":"2023-10-16T19:39:56.979126+0000","last_fullsized":"2023-10-16T19:39:56.979126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:36.664859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.989349+0000","last_change":"2023-10-16T19:39:57.055862+0000","last_active":"2023-10-16T19:39:58.989349+0000","last_peered":"2023-10-16T19:39:58.989349+0000","last_clean":"2023-10-16T19:39:58.989349+0000","last_became_active":"2023-10-16T19:39:57.055442+0000","last_became_peered":"2023-10-16T19:39:57.055442+0000","last_unstale":"2023-10-16T19:39:58.989349+0000","last_undegraded":"2023-10-16T19:39:58.989349+0000","last_fullsized":"2023-10-16T19:39:58.989349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:34.344450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992158+0000","last_change":"2023-10-16T19:39:51.963084+0000","last_active":"2023-10-16T19:39:56.992158+0000","last_peered":"2023-10-16T19:39:56.992158+0000","last_clean":"2023-10-16T19:39:56.992158+0000","last_became_active":"2023-10-16T19:39:51.962807+0000","last_became_peered":"2023-10-16T19:39:51.962807+0000","last_unstale":"2023-10-16T19:39:56.992158+0000","last_undegraded":"2023-10-16T19:39:56.992158+0000","last_fullsized":"2023-10-16T19:39:56.992158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:54:45.089181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.988486+0000","last_change":"2023-10-16T19:39:52.978428+0000","last_active":"2023-10-16T19:39:56.988486+0000","last_peered":"2023-10-16T19:39:56.988486+0000","last_clean":"2023-10-16T19:39:56.988486+0000","last_became_active":"2023-10-16T19:39:52.978101+0000","last_became_peered":"2023-10-16T19:39:52.978101+0000","last_unstale":"2023-10-16T19:39:56.988486+0000","last_undegraded":"2023-10-16T19:39:56.988486+0000","last_fullsized":"2023-10-16T19:39:56.988486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:55:31.092499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015410+0000","last_change":"2023-10-16T19:39:56.998806+0000","last_active":"2023-10-16T19:39:58.015410+0000","last_peered":"2023-10-16T19:39:58.015410+0000","last_clean":"2023-10-16T19:39:58.015410+0000","last_became_active":"2023-10-16T19:39:56.997925+0000","last_became_peered":"2023-10-16T19:39:56.997925+0000","last_unstale":"2023-10-16T19:39:58.015410+0000","last_undegraded":"2023-10-16T19:39:58.015410+0000","last_fullsized":"2023-10-16T19:39:58.015410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:08.168565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.992271+0000","last_change":"2023-10-16T19:39:51.964864+0000","last_active":"2023-10-16T19:39:56.992271+0000","last_peered":"2023-10-16T19:39:56.992271+0000","last_clean":"2023-10-16T19:39:56.992271+0000","last_became_active":"2023-10-16T19:39:51.964479+0000","last_became_peered":"2023-10-16T19:39:51.964479+0000","last_unstale":"2023-10-16T19:39:56.992271+0000","last_undegraded":"2023-10-16T19:39:56.992271+0000","last_fullsized":"2023-10-16T19:39:56.992271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:35.659971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.996915+0000","last_change":"2023-10-16T19:39:52.971775+0000","last_active":"2023-10-16T19:39:56.996915+0000","last_peered":"2023-10-16T19:39:56.996915+0000","last_clean":"2023-10-16T19:39:56.996915+0000","last_became_active":"2023-10-16T19:39:52.971381+0000","last_became_peered":"2023-10-16T19:39:52.971381+0000","last_unstale":"2023-10-16T19:39:56.996915+0000","last_undegraded":"2023-10-16T19:39:56.996915+0000","last_fullsized":"2023-10-16T19:39:56.996915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015073+0000","last_change":"2023-10-16T19:39:56.995155+0000","last_active":"2023-10-16T19:39:58.015073+0000","last_peered":"2023-10-16T19:39:58.015073+0000","last_clean":"2023-10-16T19:39:58.015073+0000","last_became_active":"2023-10-16T19:39:56.994693+0000","last_became_peered":"2023-10-16T19:39:56.994693+0000","last_unstale":"2023-10-16T19:39:58.015073+0000","last_undegraded":"2023-10-16T19:39:58.015073+0000","last_fullsized":"2023-10-16T19:39:58.015073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:35.301404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055607+0000","last_change":"2023-10-16T19:39:51.961933+0000","last_active":"2023-10-16T19:39:57.055607+0000","last_peered":"2023-10-16T19:39:57.055607+0000","last_clean":"2023-10-16T19:39:57.055607+0000","last_became_active":"2023-10-16T19:39:51.961548+0000","last_became_peered":"2023-10-16T19:39:51.961548+0000","last_unstale":"2023-10-16T19:39:57.055607+0000","last_undegraded":"2023-10-16T19:39:57.055607+0000","last_fullsized":"2023-10-16T19:39:57.055607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:10.474848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978123+0000","last_change":"2023-10-16T19:39:52.959823+0000","last_active":"2023-10-16T19:39:56.978123+0000","last_peered":"2023-10-16T19:39:56.978123+0000","last_clean":"2023-10-16T19:39:56.978123+0000","last_became_active":"2023-10-16T19:39:52.959508+0000","last_became_peered":"2023-10-16T19:39:52.959508+0000","last_unstale":"2023-10-16T19:39:56.978123+0000","last_undegraded":"2023-10-16T19:39:56.978123+0000","last_fullsized":"2023-10-16T19:39:56.978123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:21.347259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.015856+0000","last_change":"2023-10-16T19:39:57.055819+0000","last_active":"2023-10-16T19:39:58.015856+0000","last_peered":"2023-10-16T19:39:58.015856+0000","last_clean":"2023-10-16T19:39:58.015856+0000","last_became_active":"2023-10-16T19:39:57.055371+0000","last_became_peered":"2023-10-16T19:39:57.055371+0000","last_unstale":"2023-10-16T19:39:58.015856+0000","last_undegraded":"2023-10-16T19:39:58.015856+0000","last_fullsized":"2023-10-16T19:39:58.015856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:49.926067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977712+0000","last_change":"2023-10-16T19:39:51.962380+0000","last_active":"2023-10-16T19:39:56.977712+0000","last_peered":"2023-10-16T19:39:56.977712+0000","last_clean":"2023-10-16T19:39:56.977712+0000","last_became_active":"2023-10-16T19:39:51.962053+0000","last_became_peered":"2023-10-16T19:39:51.962053+0000","last_unstale":"2023-10-16T19:39:56.977712+0000","last_undegraded":"2023-10-16T19:39:56.977712+0000","last_fullsized":"2023-10-16T19:39:56.977712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:27:01.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.055763+0000","last_change":"2023-10-16T19:39:52.973102+0000","last_active":"2023-10-16T19:39:57.055763+0000","last_peered":"2023-10-16T19:39:57.055763+0000","last_clean":"2023-10-16T19:39:57.055763+0000","last_became_active":"2023-10-16T19:39:52.972823+0000","last_became_peered":"2023-10-16T19:39:52.972823+0000","last_unstale":"2023-10-16T19:39:57.055763+0000","last_undegraded":"2023-10-16T19:39:57.055763+0000","last_fullsized":"2023-10-16T19:39:57.055763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:39.212757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.752852+0000","last_change":"2023-10-16T19:39:56.998067+0000","last_active":"2023-10-16T19:39:58.752852+0000","last_peered":"2023-10-16T19:39:58.752852+0000","last_clean":"2023-10-16T19:39:58.752852+0000","last_became_active":"2023-10-16T19:39:56.996916+0000","last_became_peered":"2023-10-16T19:39:56.996916+0000","last_unstale":"2023-10-16T19:39:58.752852+0000","last_undegraded":"2023-10-16T19:39:58.752852+0000","last_fullsized":"2023-10-16T19:39:58.752852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:43.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993787+0000","last_change":"2023-10-16T19:39:51.962402+0000","last_active":"2023-10-16T19:39:56.993787+0000","last_peered":"2023-10-16T19:39:56.993787+0000","last_clean":"2023-10-16T19:39:56.993787+0000","last_became_active":"2023-10-16T19:39:51.961789+0000","last_became_peered":"2023-10-16T19:39:51.961789+0000","last_unstale":"2023-10-16T19:39:56.993787+0000","last_undegraded":"2023-10-16T19:39:56.993787+0000","last_fullsized":"2023-10-16T19:39:56.993787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:31.098807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984210+0000","last_change":"2023-10-16T19:39:52.972162+0000","last_active":"2023-10-16T19:39:56.984210+0000","last_peered":"2023-10-16T19:39:56.984210+0000","last_clean":"2023-10-16T19:39:56.984210+0000","last_became_active":"2023-10-16T19:39:52.971650+0000","last_became_peered":"2023-10-16T19:39:52.971650+0000","last_unstale":"2023-10-16T19:39:56.984210+0000","last_undegraded":"2023-10-16T19:39:56.984210+0000","last_fullsized":"2023-10-16T19:39:56.984210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:44.750576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T19:39:58.707432+0000","last_change":"2023-10-16T19:39:57.057262+0000","last_active":"2023-10-16T19:39:58.707432+0000","last_peered":"2023-10-16T19:39:58.707432+0000","last_clean":"2023-10-16T19:39:58.707432+0000","last_became_active":"2023-10-16T19:39:57.056817+0000","last_became_peered":"2023-10-16T19:39:57.056817+0000","last_unstale":"2023-10-16T19:39:58.707432+0000","last_undegraded":"2023-10-16T19:39:58.707432+0000","last_fullsized":"2023-10-16T19:39:58.707432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:55.971201+0000","last_clean_scrub_stamp":"2023-10-16T19:39:55.971201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:32.486505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977037+0000","last_change":"2023-10-16T19:39:51.962396+0000","last_active":"2023-10-16T19:39:56.977037+0000","last_peered":"2023-10-16T19:39:56.977037+0000","last_clean":"2023-10-16T19:39:56.977037+0000","last_became_active":"2023-10-16T19:39:51.962087+0000","last_became_peered":"2023-10-16T19:39:51.962087+0000","last_unstale":"2023-10-16T19:39:56.977037+0000","last_undegraded":"2023-10-16T19:39:56.977037+0000","last_fullsized":"2023-10-16T19:39:56.977037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:50.929502+0000","last_clean_scrub_stamp":"2023-10-16T19:39:50.929502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:19.877967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.056819+0000","last_change":"2023-10-16T19:39:52.966846+0000","last_active":"2023-10-16T19:39:57.056819+0000","last_peered":"2023-10-16T19:39:57.056819+0000","last_clean":"2023-10-16T19:39:57.056819+0000","last_became_active":"2023-10-16T19:39:52.966558+0000","last_became_peered":"2023-10-16T19:39:52.966558+0000","last_unstale":"2023-10-16T19:39:57.056819+0000","last_undegraded":"2023-10-16T19:39:57.056819+0000","last_fullsized":"2023-10-16T19:39:57.056819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:30.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978101+0000","last_change":"2023-10-16T19:39:52.968833+0000","last_active":"2023-10-16T19:39:56.978101+0000","last_peered":"2023-10-16T19:39:56.978101+0000","last_clean":"2023-10-16T19:39:56.978101+0000","last_became_active":"2023-10-16T19:39:52.968540+0000","last_became_peered":"2023-10-16T19:39:52.968540+0000","last_unstale":"2023-10-16T19:39:56.978101+0000","last_undegraded":"2023-10-16T19:39:56.978101+0000","last_fullsized":"2023-10-16T19:39:56.978101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:00:19.890013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.977005+0000","last_change":"2023-10-16T19:39:52.966376+0000","last_active":"2023-10-16T19:39:56.977005+0000","last_peered":"2023-10-16T19:39:56.977005+0000","last_clean":"2023-10-16T19:39:56.977005+0000","last_became_active":"2023-10-16T19:39:52.966044+0000","last_became_peered":"2023-10-16T19:39:52.966044+0000","last_unstale":"2023-10-16T19:39:56.977005+0000","last_undegraded":"2023-10-16T19:39:56.977005+0000","last_fullsized":"2023-10-16T19:39:56.977005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:08.865573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984282+0000","last_change":"2023-10-16T19:39:52.971488+0000","last_active":"2023-10-16T19:39:56.984282+0000","last_peered":"2023-10-16T19:39:56.984282+0000","last_clean":"2023-10-16T19:39:56.984282+0000","last_became_active":"2023-10-16T19:39:52.970909+0000","last_became_peered":"2023-10-16T19:39:52.970909+0000","last_unstale":"2023-10-16T19:39:56.984282+0000","last_undegraded":"2023-10-16T19:39:56.984282+0000","last_fullsized":"2023-10-16T19:39:56.984282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:19.955289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.982419+0000","last_change":"2023-10-16T19:39:52.975269+0000","last_active":"2023-10-16T19:39:56.982419+0000","last_peered":"2023-10-16T19:39:56.982419+0000","last_clean":"2023-10-16T19:39:56.982419+0000","last_became_active":"2023-10-16T19:39:52.973150+0000","last_became_peered":"2023-10-16T19:39:52.973150+0000","last_unstale":"2023-10-16T19:39:56.982419+0000","last_undegraded":"2023-10-16T19:39:56.982419+0000","last_fullsized":"2023-10-16T19:39:56.982419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.997003+0000","last_change":"2023-10-16T19:39:52.969771+0000","last_active":"2023-10-16T19:39:56.997003+0000","last_peered":"2023-10-16T19:39:56.997003+0000","last_clean":"2023-10-16T19:39:56.997003+0000","last_became_active":"2023-10-16T19:39:52.969468+0000","last_became_peered":"2023-10-16T19:39:52.969468+0000","last_unstale":"2023-10-16T19:39:56.997003+0000","last_undegraded":"2023-10-16T19:39:56.997003+0000","last_fullsized":"2023-10-16T19:39:56.997003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.993745+0000","last_change":"2023-10-16T19:39:52.957538+0000","last_active":"2023-10-16T19:39:56.993745+0000","last_peered":"2023-10-16T19:39:56.993745+0000","last_clean":"2023-10-16T19:39:56.993745+0000","last_became_active":"2023-10-16T19:39:52.957106+0000","last_became_peered":"2023-10-16T19:39:52.957106+0000","last_unstale":"2023-10-16T19:39:56.993745+0000","last_undegraded":"2023-10-16T19:39:56.993745+0000","last_fullsized":"2023-10-16T19:39:56.993745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:26.326900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978579+0000","last_change":"2023-10-16T19:39:52.970773+0000","last_active":"2023-10-16T19:39:56.978579+0000","last_peered":"2023-10-16T19:39:56.978579+0000","last_clean":"2023-10-16T19:39:56.978579+0000","last_became_active":"2023-10-16T19:39:52.970485+0000","last_became_peered":"2023-10-16T19:39:52.970485+0000","last_unstale":"2023-10-16T19:39:56.978579+0000","last_undegraded":"2023-10-16T19:39:56.978579+0000","last_fullsized":"2023-10-16T19:39:56.978579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:06:39.934713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:57.000749+0000","last_change":"2023-10-16T19:39:52.969630+0000","last_active":"2023-10-16T19:39:57.000749+0000","last_peered":"2023-10-16T19:39:57.000749+0000","last_clean":"2023-10-16T19:39:57.000749+0000","last_became_active":"2023-10-16T19:39:52.969298+0000","last_became_peered":"2023-10-16T19:39:52.969298+0000","last_unstale":"2023-10-16T19:39:57.000749+0000","last_undegraded":"2023-10-16T19:39:57.000749+0000","last_fullsized":"2023-10-16T19:39:57.000749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:05.261542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983919+0000","last_change":"2023-10-16T19:39:52.979228+0000","last_active":"2023-10-16T19:39:56.983919+0000","last_peered":"2023-10-16T19:39:56.983919+0000","last_clean":"2023-10-16T19:39:56.983919+0000","last_became_active":"2023-10-16T19:39:52.978788+0000","last_became_peered":"2023-10-16T19:39:52.978788+0000","last_unstale":"2023-10-16T19:39:56.983919+0000","last_undegraded":"2023-10-16T19:39:56.983919+0000","last_fullsized":"2023-10-16T19:39:56.983919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:08:31.264592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.995707+0000","last_change":"2023-10-16T19:39:52.962415+0000","last_active":"2023-10-16T19:39:56.995707+0000","last_peered":"2023-10-16T19:39:56.995707+0000","last_clean":"2023-10-16T19:39:56.995707+0000","last_became_active":"2023-10-16T19:39:52.962093+0000","last_became_peered":"2023-10-16T19:39:52.962093+0000","last_unstale":"2023-10-16T19:39:56.995707+0000","last_undegraded":"2023-10-16T19:39:56.995707+0000","last_fullsized":"2023-10-16T19:39:56.995707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.984054+0000","last_change":"2023-10-16T19:39:52.971993+0000","last_active":"2023-10-16T19:39:56.984054+0000","last_peered":"2023-10-16T19:39:56.984054+0000","last_clean":"2023-10-16T19:39:56.984054+0000","last_became_active":"2023-10-16T19:39:52.971684+0000","last_became_peered":"2023-10-16T19:39:52.971684+0000","last_unstale":"2023-10-16T19:39:56.984054+0000","last_undegraded":"2023-10-16T19:39:56.984054+0000","last_fullsized":"2023-10-16T19:39:56.984054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:36.741568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.983218+0000","last_change":"2023-10-16T19:39:52.977733+0000","last_active":"2023-10-16T19:39:56.983218+0000","last_peered":"2023-10-16T19:39:56.983218+0000","last_clean":"2023-10-16T19:39:56.983218+0000","last_became_active":"2023-10-16T19:39:52.977383+0000","last_became_peered":"2023-10-16T19:39:52.977383+0000","last_unstale":"2023-10-16T19:39:56.983218+0000","last_undegraded":"2023-10-16T19:39:56.983218+0000","last_fullsized":"2023-10-16T19:39:56.983218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:57:45.531992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T19:39:56.978000+0000","last_change":"2023-10-16T19:39:52.961967+0000","last_active":"2023-10-16T19:39:56.978000+0000","last_peered":"2023-10-16T19:39:56.978000+0000","last_clean":"2023-10-16T19:39:56.978000+0000","last_became_active":"2023-10-16T19:39:52.961663+0000","last_became_peered":"2023-10-16T19:39:52.961663+0000","last_unstale":"2023-10-16T19:39:56.978000+0000","last_undegraded":"2023-10-16T19:39:56.978000+0000","last_fullsized":"2023-10-16T19:39:56.978000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:51.934390+0000","last_clean_scrub_stamp":"2023-10-16T19:39:51.934390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:52.035213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:40:23.856 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T19:40:23.857 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T19:40:23.857 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T19:40:23.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T19:40:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 Processor -- start 2023-10-16T19:40:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 -- start start 2023-10-16T19:40:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6814ec50 0x7f4c681555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6806db00 0x7f4c6806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c68155af0 con 0x7f4c680c3350 2023-10-16T19:40:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c68152300 con 0x7f4c6814ec50 2023-10-16T19:40:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.010+0000 7f4c6e86c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c2e40 con 0x7f4c6806db00 2023-10-16T19:40:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6814ec50 0x7f4c681555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c5ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4c680c3350 0x7f4c68071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37534/0 (socket says 172.21.15.29:37534) 2023-10-16T19:40:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6814ec50 0x7f4c681555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52088/0 (socket says 172.21.15.29:52088) 2023-10-16T19:40:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c5ffff700 1 -- 172.21.15.29:0/1561597610 learned_addr learned my addr 172.21.15.29:0/1561597610 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c6ce09700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6806db00 0x7f4c6806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 -- 172.21.15.29:0/1561597610 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6806db00 msgr2=0x7f4c6806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6806db00 0x7f4c6806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 -- 172.21.15.29:0/1561597610 >> v1:172.21.15.29:6789/0 conn(0x7f4c680c3350 legacy=0x7f4c68071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 -- 172.21.15.29:0/1561597610 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6814f030 con 0x7f4c6814ec50 2023-10-16T19:40:24.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c677fe700 1 -- 172.21.15.29:0/1561597610 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748649702 0 0) 0x7f4c50001110 con 0x7f4c680c3350 2023-10-16T19:40:24.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c67fff700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6814ec50 0x7f4c681555b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009840 tx=0x7f4c58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62282a586d48f25d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c677fe700 1 -- 172.21.15.29:0/1561597610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58011830 con 0x7f4c6814ec50 2023-10-16T19:40:24.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c677fe700 1 -- 172.21.15.29:0/1561597610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c58011990 con 0x7f4c6814ec50 2023-10-16T19:40:24.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.011+0000 7f4c677fe700 1 -- 172.21.15.29:0/1561597610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58011d20 con 0x7f4c6814ec50 2023-10-16T19:40:24.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 -- 172.21.15.29:0/1561597610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6814ec50 msgr2=0x7f4c681555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6814ec50 0x7f4c681555b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009840 tx=0x7f4c58009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:24.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 -- 172.21.15.29:0/1561597610 shutdown_connections 2023-10-16T19:40:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6806db00 0x7f4c6806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/1561597610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6814ec50 0x7f4c681555b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 -- 172.21.15.29:0/1561597610 >> 172.21.15.29:0/1561597610 conn(0x7f4c680c7110 msgr2=0x7f4c680c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 -- 172.21.15.29:0/1561597610 shutdown_connections 2023-10-16T19:40:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.012+0000 7f4c6e86c700 1 -- 172.21.15.29:0/1561597610 wait complete. 2023-10-16T19:40:24.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.013+0000 7f4c6e86c700 1 Processor -- start 2023-10-16T19:40:24.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.013+0000 7f4c6e86c700 1 -- start start 2023-10-16T19:40:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c6806db00 0x7f4c681e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 0x7f4c680aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680aa600 con 0x7f4c680c3350 2023-10-16T19:40:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6814bef0 con 0x7f4c6806db00 2023-10-16T19:40:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c6e86c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680a9980 con 0x7f4c6814ec50 2023-10-16T19:40:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.014+0000 7f4c5ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52096/0 (socket says 172.21.15.29:52096) 2023-10-16T19:40:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 -- 172.21.15.29:0/4147618358 learned_addr learned my addr 172.21.15.29:0/4147618358 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c6ce09700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 0x7f4c680aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c67fff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c6806db00 0x7f4c681e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 -- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 msgr2=0x7f4c680aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 0x7f4c680aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 -- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c6806db00 msgr2=0x7f4c681e7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c6806db00 0x7f4c681e7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 -- 172.21.15.29:0/4147618358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580094a0 con 0x7f4c680c3350 2023-10-16T19:40:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c6ce09700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 0x7f4c680aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:24.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c5ffff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c520 tx=0x7f4c5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50004c80 con 0x7f4c680c3350 2023-10-16T19:40:24.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50004de0 con 0x7f4c680c3350 2023-10-16T19:40:24.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c680a9c60 con 0x7f4c680c3350 2023-10-16T19:40:24.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500072d0 con 0x7f4c680c3350 2023-10-16T19:40:24.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.015+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c680aa220 con 0x7f4c680c3350 2023-10-16T19:40:24.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.016+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c680ab730 con 0x7f4c680c3350 2023-10-16T19:40:24.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.017+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c50007430 con 0x7f4c680c3350 2023-10-16T19:40:24.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.017+0000 7f4c657fa700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 0x7f4c4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.017+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c500893d0 con 0x7f4c680c3350 2023-10-16T19:40:24.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.017+0000 7f4c67fff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 0x7f4c4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.018+0000 7f4c67fff700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 0x7f4c4806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c580090b0 tx=0x7f4c58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.021+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c680ab730 con 0x7f4c680c3350 2023-10-16T19:40:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.270+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c68155af0 con 0x7f4c680c3350 2023-10-16T19:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.270+0000 7f4c657fa700 1 -- 172.21.15.29:0/4147618358 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4c68155af0 con 0x7f4c680c3350 2023-10-16T19:40:24.273 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:24.273 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T19:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 msgr2=0x7f4c4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 0x7f4c4806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c580090b0 tx=0x7f4c58008030 comp rx=0 tx=0).stop 2023-10-16T19:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 msgr2=0x7f4c6814b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c520 tx=0x7f4c5000c8e0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 shutdown_connections 2023-10-16T19:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4c4806af00 0x7f4c4806d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c6814ec50 0x7f4c680aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c6806db00 0x7f4c681e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 --2- 172.21.15.29:0/4147618358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c680c3350 0x7f4c6814b6e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 >> 172.21.15.29:0/4147618358 conn(0x7f4c680c7110 msgr2=0x7f4c6814c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 shutdown_connections 2023-10-16T19:40:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.273+0000 7f4c6e86c700 1 -- 172.21.15.29:0/4147618358 wait complete. 2023-10-16T19:40:24.287 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T19:40:24.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.411+0000 7f4eebbfe700 1 Processor -- start 2023-10-16T19:40:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.411+0000 7f4eebbfe700 1 -- start start 2023-10-16T19:40:24.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eebbfe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ee40c4f50 0x7f4ee4153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eebbfe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ee40c7bb0 0x7f4ee4070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eebbfe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40bd0e0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eebbfe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee40c3000 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eebbfe700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee40c5330 con 0x7f4ee40c4f50 2023-10-16T19:40:24.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ee40c7bb0 0x7f4ee4070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eea19b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4ee4070ac0 0x7f4ee4155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37550/0 (socket says 172.21.15.29:37550) 2023-10-16T19:40:24.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4eea19b700 1 -- 172.21.15.29:0/508213776 learned_addr learned my addr 172.21.15.29:0/508213776 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:24.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee999a700 1 --2- 172.21.15.29:0/508213776 >> v2:172.21.15.53:3300/0 conn(0x7f4ee40c4f50 0x7f4ee4153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 -- 172.21.15.29:0/508213776 >> v2:172.21.15.53:3300/0 conn(0x7f4ee40c4f50 msgr2=0x7f4ee4153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 --2- 172.21.15.29:0/508213776 >> v2:172.21.15.53:3300/0 conn(0x7f4ee40c4f50 0x7f4ee4153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 -- 172.21.15.29:0/508213776 >> v1:172.21.15.29:6789/0 conn(0x7f4ee4070ac0 legacy=0x7f4ee4155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee8998700 1 -- 172.21.15.29:0/508213776 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834055281 0 0) 0x7f4ee40bd0e0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 -- 172.21.15.29:0/508213776 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40c2a40 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.412+0000 7f4ee9199700 1 --2- 172.21.15.29:0/508213776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee40c7bb0 0x7f4ee4070580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009840 tx=0x7f4ed8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a583674d95db3bde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4ee8998700 1 -- 172.21.15.29:0/508213776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8010a30 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4ee8998700 1 -- 172.21.15.29:0/508213776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8010b90 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4ee8998700 1 -- 172.21.15.29:0/508213776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8018440 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 -- 172.21.15.29:0/508213776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee40c7bb0 msgr2=0x7f4ee4070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/508213776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee40c7bb0 0x7f4ee4070580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009840 tx=0x7f4ed8009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:24.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 -- 172.21.15.29:0/508213776 shutdown_connections 2023-10-16T19:40:24.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/508213776 >> v2:172.21.15.53:3300/0 conn(0x7f4ee40c4f50 0x7f4ee4153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/508213776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee40c7bb0 0x7f4ee4070580 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 -- 172.21.15.29:0/508213776 >> 172.21.15.29:0/508213776 conn(0x7f4ee40a9cd0 msgr2=0x7f4ee40aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 -- 172.21.15.29:0/508213776 shutdown_connections 2023-10-16T19:40:24.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.413+0000 7f4eebbfe700 1 -- 172.21.15.29:0/508213776 wait complete. 2023-10-16T19:40:24.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.414+0000 7f4eebbfe700 1 Processor -- start 2023-10-16T19:40:24.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.414+0000 7f4eebbfe700 1 -- start start 2023-10-16T19:40:24.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ee40c4f50 0x7f4ee40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ee40c7bb0 0x7f4ee41e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4148f70 con 0x7f4ee4070ac0 2023-10-16T19:40:24.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41505b0 con 0x7f4ee40c4f50 2023-10-16T19:40:24.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4eebbfe700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4150890 con 0x7f4ee40c7bb0 2023-10-16T19:40:24.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52108/0 (socket says 172.21.15.29:52108) 2023-10-16T19:40:24.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 -- 172.21.15.29:0/864107111 learned_addr learned my addr 172.21.15.29:0/864107111 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:24.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 -- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ee40c7bb0 msgr2=0x7f4ee41e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ee40c7bb0 0x7f4ee41e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 -- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ee40c4f50 msgr2=0x7f4ee40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee9199700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ee40c4f50 0x7f4ee40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ee40c4f50 0x7f4ee40c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.415+0000 7f4ee999a700 1 -- 172.21.15.29:0/864107111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80094a0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4ee999a700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000e9b0 tx=0x7f4ee000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0009710 con 0x7f4ee4070ac0 2023-10-16T19:40:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee000c850 con 0x7f4ee4070ac0 2023-10-16T19:40:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000cbc0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee4150b70 con 0x7f4ee4070ac0 2023-10-16T19:40:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.416+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee40c6910 con 0x7f4ee4070ac0 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.417+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee41490b0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.417+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ee000cd20 con 0x7f4ee4070ac0 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.417+0000 7f4ed67fc700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 0x7f4ec806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.418+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ee0089930 con 0x7f4ee4070ac0 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.418+0000 7f4ee9199700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 0x7f4ec806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.418+0000 7f4ee9199700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 0x7f4ec806d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ee41e3a60 tx=0x7f4ed8009f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.422+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ee0054780 con 0x7f4ee4070ac0 2023-10-16T19:40:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.625+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ee40ae2c0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.626+0000 7f4ed67fc700 1 -- 172.21.15.29:0/864107111 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f4ee0057da0 con 0x7f4ee4070ac0 2023-10-16T19:40:24.629 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:24.629 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 msgr2=0x7f4ec806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 0x7f4ec806d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ee41e3a60 tx=0x7f4ed8009f90 comp rx=0 tx=0).stop 2023-10-16T19:40:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 msgr2=0x7f4ee4148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000e9b0 tx=0x7f4ee000ed70 comp rx=0 tx=0).stop 2023-10-16T19:40:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 shutdown_connections 2023-10-16T19:40:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ec806af00 0x7f4ec806d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ee40c7bb0 0x7f4ee41e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ee4070ac0 0x7f4ee4148890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 --2- 172.21.15.29:0/864107111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ee40c4f50 0x7f4ee40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.628+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 >> 172.21.15.29:0/864107111 conn(0x7f4ee40a9cd0 msgr2=0x7f4ee40aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.629+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 shutdown_connections 2023-10-16T19:40:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.629+0000 7f4eebbfe700 1 -- 172.21.15.29:0/864107111 wait complete. 2023-10-16T19:40:24.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:24.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.769+0000 7f46d8d9e700 1 Processor -- start 2023-10-16T19:40:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.769+0000 7f46d8d9e700 1 -- start start 2023-10-16T19:40:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d8d9e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46d413dd00 0x7f46d4158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d8d9e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d406e780 con 0x7f46d413d660 2023-10-16T19:40:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d8d9e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d4154f10 con 0x7f46d4154a50 2023-10-16T19:40:24.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d8d9e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d406d320 con 0x7f46d413dd00 2023-10-16T19:40:24.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f46d413d660 0x7f46d406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37560/0 (socket says 172.21.15.29:37560) 2023-10-16T19:40:24.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.770+0000 7f46d259c700 1 -- 172.21.15.29:0/2053492135 learned_addr learned my addr 172.21.15.29:0/2053492135 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:24.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/2053492135 >> v2:172.21.15.53:3300/0 conn(0x7f46d413dd00 0x7f46d4158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107651678 0 0) 0x7f46d406e780 con 0x7f46d413d660 2023-10-16T19:40:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46bc0035b0 con 0x7f46d413d660 2023-10-16T19:40:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070836840 0 0) 0x7f46bc0035b0 con 0x7f46d413d660 2023-10-16T19:40:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 >> v2:172.21.15.53:3300/0 conn(0x7f46d413dd00 msgr2=0x7f46d4158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 --2- 172.21.15.29:0/2053492135 >> v2:172.21.15.53:3300/0 conn(0x7f46d413dd00 0x7f46d4158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 >> v1:172.21.15.53:6789/0 conn(0x7f46d4154a50 legacy=0x7f46d41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d41551f0 con 0x7f46d413d660 2023-10-16T19:40:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f46c8001670 con 0x7f46d413d660 2023-10-16T19:40:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 >> v1:172.21.15.29:6789/0 conn(0x7f46d413d660 legacy=0x7f46d406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc003a00 0x7f46bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46bc004850 0x7f46bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 0x7f46bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d406d320 con 0x7f46bc005210 2023-10-16T19:40:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc00c1b0 con 0x7f46bc004850 2023-10-16T19:40:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc00c370 con 0x7f46bc003a00 2023-10-16T19:40:24.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 0x7f46bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d1d9b700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46bc004850 0x7f46bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d259c700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc003a00 0x7f46bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 -- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc003a00 msgr2=0x7f46bc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc003a00 0x7f46bc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 -- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46bc004850 msgr2=0x7f46bc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46bc004850 0x7f46bc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d2d9d700 1 -- 172.21.15.29:0/2053492135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0035b0 con 0x7f46bc005210 2023-10-16T19:40:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.771+0000 7f46d259c700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc003a00 0x7f46bc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d2d9d700 1 -- 172.21.15.29:0/2053492135 reap_dead start 2023-10-16T19:40:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 0x7f46bc00ba10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009fc0 tx=0x7f46bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6bb16249113af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc003a70 con 0x7f46bc005210 2023-10-16T19:40:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc00f040 con 0x7f46bc005210 2023-10-16T19:40:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d159a700 1 -- 172.21.15.29:0/2053492135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc003e30 con 0x7f46bc005210 2023-10-16T19:40:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 -- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 msgr2=0x7f46bc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 0x7f46bc00ba10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009fc0 tx=0x7f46bc005880 comp rx=0 tx=0).stop 2023-10-16T19:40:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 -- 172.21.15.29:0/2053492135 shutdown_connections 2023-10-16T19:40:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/2053492135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46bc005210 0x7f46bc00ba10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 -- 172.21.15.29:0/2053492135 >> 172.21.15.29:0/2053492135 conn(0x7f46d40c7110 msgr2=0x7f46d40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 -- 172.21.15.29:0/2053492135 shutdown_connections 2023-10-16T19:40:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.772+0000 7f46d8d9e700 1 -- 172.21.15.29:0/2053492135 wait complete. 2023-10-16T19:40:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 Processor -- start 2023-10-16T19:40:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 -- start start 2023-10-16T19:40:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc005210 0x7f46d4154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d413bd10 0x7f46d4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41ed330 con 0x7f46d413c160 2023-10-16T19:40:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d412c770 con 0x7f46d413bd10 2023-10-16T19:40:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.774+0000 7f46d8d9e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41ed580 con 0x7f46bc005210 2023-10-16T19:40:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52132/0 (socket says 172.21.15.29:52132) 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 -- 172.21.15.29:0/1675962863 learned_addr learned my addr 172.21.15.29:0/1675962863 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d1d9b700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d413bd10 0x7f46d4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d259c700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc005210 0x7f46d4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 -- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc005210 msgr2=0x7f46d4154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc005210 0x7f46d4154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 -- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d413bd10 msgr2=0x7f46d4156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d413bd10 0x7f46d4156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 -- 172.21.15.29:0/1675962863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d41ed860 con 0x7f46d413c160 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d2d9d700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46d40c1380 tx=0x7f46cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc003e40 con 0x7f46d413c160 2023-10-16T19:40:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc004230 con 0x7f46d413c160 2023-10-16T19:40:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0043e0 con 0x7f46d413c160 2023-10-16T19:40:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d41edb40 con 0x7f46d413c160 2023-10-16T19:40:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.775+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41ee100 con 0x7f46d413c160 2023-10-16T19:40:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.776+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d40c3760 con 0x7f46d413c160 2023-10-16T19:40:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.777+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46cc004540 con 0x7f46d413c160 2023-10-16T19:40:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.777+0000 7f46c2ffd700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 0x7f46b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.777+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46cc08ae70 con 0x7f46d413c160 2023-10-16T19:40:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.777+0000 7f46d259c700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 0x7f46b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.778+0000 7f46d259c700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 0x7f46b406d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46c8000c00 tx=0x7f46c8007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:24.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.781+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46cc055d60 con 0x7f46d413c160 2023-10-16T19:40:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.983+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46d404f400 con 0x7f46d413c160 2023-10-16T19:40:24.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.983+0000 7f46c2ffd700 1 -- 172.21.15.29:0/1675962863 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46cc0230a0 con 0x7f46d413c160 2023-10-16T19:40:24.985 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:24.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 msgr2=0x7f46b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 0x7f46b406d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46c8000c00 tx=0x7f46c8007040 comp rx=0 tx=0).stop 2023-10-16T19:40:24.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 msgr2=0x7f46d4157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:24.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46d40c1380 tx=0x7f46cc009750 comp rx=0 tx=0).stop 2023-10-16T19:40:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 shutdown_connections 2023-10-16T19:40:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f46b406af00 0x7f46b406d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46d413c160 0x7f46d4157170 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f46bc005210 0x7f46d4154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 --2- 172.21.15.29:0/1675962863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d413bd10 0x7f46d4156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 >> 172.21.15.29:0/1675962863 conn(0x7f46d40c7110 msgr2=0x7f46d40c25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.985+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 shutdown_connections 2023-10-16T19:40:24.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:24.986+0000 7f46d8d9e700 1 -- 172.21.15.29:0/1675962863 wait complete. 2023-10-16T19:40:25.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:25.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.125+0000 7f91c5f87700 1 Processor -- start 2023-10-16T19:40:25.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.125+0000 7f91c5f87700 1 -- start start 2023-10-16T19:40:25.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91c5f87700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c014ff10 0x7f91c00bc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91c5f87700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91c00a8ed0 0x7f91c0155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91c5f87700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c01568d0 con 0x7f91c00c2ca0 2023-10-16T19:40:25.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91c5f87700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00bcc00 con 0x7f91c00a8ed0 2023-10-16T19:40:25.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91c5f87700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0156b40 con 0x7f91c014ff10 2023-10-16T19:40:25.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91c00a8ed0 0x7f91c0155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91c00a8ed0 0x7f91c0155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52136/0 (socket says 172.21.15.29:52136) 2023-10-16T19:40:25.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bffff700 1 -- 172.21.15.29:0/1542131452 learned_addr learned my addr 172.21.15.29:0/1542131452 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:25.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bf7fe700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c014ff10 0x7f91c00bc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bffff700 1 -- 172.21.15.29:0/1542131452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c014ff10 msgr2=0x7f91c00bc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.126+0000 7f91bffff700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c014ff10 0x7f91c00bc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91bffff700 1 -- 172.21.15.29:0/1542131452 >> v1:172.21.15.53:6789/0 conn(0x7f91c00c2ca0 legacy=0x7f91c006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91bffff700 1 -- 172.21.15.29:0/1542131452 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c01502f0 con 0x7f91c00a8ed0 2023-10-16T19:40:25.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91bffff700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c00a8ed0 0x7f91c0155e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4b7b6ca3fae292 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91be7fc700 1 -- 172.21.15.29:0/1542131452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800e070 con 0x7f91c00a8ed0 2023-10-16T19:40:25.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91be7fc700 1 -- 172.21.15.29:0/1542131452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8003a20 con 0x7f91c00a8ed0 2023-10-16T19:40:25.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91be7fc700 1 -- 172.21.15.29:0/1542131452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8003dd0 con 0x7f91c00a8ed0 2023-10-16T19:40:25.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 -- 172.21.15.29:0/1542131452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c00a8ed0 msgr2=0x7f91c0155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c00a8ed0 0x7f91c0155e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e50 tx=0x7f91b800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:25.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 -- 172.21.15.29:0/1542131452 shutdown_connections 2023-10-16T19:40:25.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c00a8ed0 0x7f91c0155e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 --2- 172.21.15.29:0/1542131452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c014ff10 0x7f91c00bc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.127+0000 7f91c5f87700 1 -- 172.21.15.29:0/1542131452 >> 172.21.15.29:0/1542131452 conn(0x7f91c00c30c0 msgr2=0x7f91c00c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.128+0000 7f91c5f87700 1 -- 172.21.15.29:0/1542131452 shutdown_connections 2023-10-16T19:40:25.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.128+0000 7f91c5f87700 1 -- 172.21.15.29:0/1542131452 wait complete. 2023-10-16T19:40:25.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.129+0000 7f91c5f87700 1 Processor -- start 2023-10-16T19:40:25.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.129+0000 7f91c5f87700 1 -- start start 2023-10-16T19:40:25.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c00a8ed0 0x7f91c0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c0150720 0x7f91c00bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00c5fb0 con 0x7f91c014ff10 2023-10-16T19:40:25.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00c0280 con 0x7f91c0150720 2023-10-16T19:40:25.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0153c20 con 0x7f91c00a8ed0 2023-10-16T19:40:25.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52140/0 (socket says 172.21.15.29:52140) 2023-10-16T19:40:25.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 -- 172.21.15.29:0/738510768 learned_addr learned my addr 172.21.15.29:0/738510768 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:25.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91bffff700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c0150720 0x7f91c00bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91bf7fe700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c00a8ed0 0x7f91c0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 -- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c00a8ed0 msgr2=0x7f91c0152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c00a8ed0 0x7f91c0152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 -- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c0150720 msgr2=0x7f91c00bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c0150720 0x7f91c00bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 -- 172.21.15.29:0/738510768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009b30 con 0x7f91c014ff10 2023-10-16T19:40:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91beffd700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c500 tx=0x7f91a800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011790 con 0x7f91c014ff10 2023-10-16T19:40:25.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80118f0 con 0x7f91c014ff10 2023-10-16T19:40:25.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c0151800 con 0x7f91c014ff10 2023-10-16T19:40:25.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011ca0 con 0x7f91c014ff10 2023-10-16T19:40:25.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.130+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c0151dc0 con 0x7f91c014ff10 2023-10-16T19:40:25.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.131+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c004f400 con 0x7f91c014ff10 2023-10-16T19:40:25.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.132+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91a801c460 con 0x7f91c014ff10 2023-10-16T19:40:25.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.132+0000 7f91b7fff700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 0x7f91a006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.132+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91a8089550 con 0x7f91c014ff10 2023-10-16T19:40:25.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.132+0000 7f91bf7fe700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 0x7f91a006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.133+0000 7f91bf7fe700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 0x7f91a006d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.137+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91a8054310 con 0x7f91c014ff10 2023-10-16T19:40:25.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.335+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91c0153d60 con 0x7f91c014ff10 2023-10-16T19:40:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.335+0000 7f91b7fff700 1 -- 172.21.15.29:0/738510768 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91a805ce60 con 0x7f91c014ff10 2023-10-16T19:40:25.338 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 msgr2=0x7f91a006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 0x7f91a006d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0008040 comp rx=0 tx=0).stop 2023-10-16T19:40:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 msgr2=0x7f91c00bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c500 tx=0x7f91a800c810 comp rx=0 tx=0).stop 2023-10-16T19:40:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 shutdown_connections 2023-10-16T19:40:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f91a006af30 0x7f91a006d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c0150720 0x7f91c00bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91c00a8ed0 0x7f91c0152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 --2- 172.21.15.29:0/738510768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91c014ff10 0x7f91c00bf800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.337+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 >> 172.21.15.29:0/738510768 conn(0x7f91c00c30c0 msgr2=0x7f91c006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.338+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 shutdown_connections 2023-10-16T19:40:25.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.338+0000 7f91c5f87700 1 -- 172.21.15.29:0/738510768 wait complete. 2023-10-16T19:40:25.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:25.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.478+0000 7f05c5c8d700 1 Processor -- start 2023-10-16T19:40:25.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.478+0000 7f05c5c8d700 1 -- start start 2023-10-16T19:40:25.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05c5c8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05c0153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05c5c8d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f05c00c7bb0 0x7f05c0070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05c5c8d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00bd0e0 con 0x7f05c0070ac0 2023-10-16T19:40:25.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05c5c8d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00c3000 con 0x7f05c00c7bb0 2023-10-16T19:40:25.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05c5c8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c5330 con 0x7f05c00c4f50 2023-10-16T19:40:25.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05bffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f05c0070ac0 0x7f05c0155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37594/0 (socket says 172.21.15.29:37594) 2023-10-16T19:40:25.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.479+0000 7f05bffff700 1 -- 172.21.15.29:0/863233415 learned_addr learned my addr 172.21.15.29:0/863233415 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:25.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05c0153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05beffd700 1 --2- 172.21.15.29:0/863233415 >> v2:172.21.15.53:3300/0 conn(0x7f05c00c7bb0 0x7f05c0070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798207658 0 0) 0x7f05c00bd0e0 con 0x7f05c0070ac0 2023-10-16T19:40:25.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a80035b0 con 0x7f05c0070ac0 2023-10-16T19:40:25.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835336913 0 0) 0x7f05a80035b0 con 0x7f05c0070ac0 2023-10-16T19:40:25.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 msgr2=0x7f05c0153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05c0153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 >> v2:172.21.15.53:3300/0 conn(0x7f05c00c7bb0 msgr2=0x7f05c0070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 --2- 172.21.15.29:0/863233415 >> v2:172.21.15.53:3300/0 conn(0x7f05c00c7bb0 0x7f05c0070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00c2a40 con 0x7f05c0070ac0 2023-10-16T19:40:25.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f05b80019f0 con 0x7f05c0070ac0 2023-10-16T19:40:25.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 >> v1:172.21.15.29:6789/0 conn(0x7f05c0070ac0 legacy=0x7f05c0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8003a00 0x7f05a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8004850 0x7f05a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c3000 con 0x7f05a8004850 2023-10-16T19:40:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c5330 con 0x7f05a8003a00 2023-10-16T19:40:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a800ba10 con 0x7f05c00c4f50 2023-10-16T19:40:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05beffd700 1 --2- 172.21.15.29:0/863233415 >> v2:172.21.15.53:3300/0 conn(0x7f05c00c7bb0 0x7f05c0070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8003a00 0x7f05a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05beffd700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8004850 0x7f05a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.480+0000 7f05bffff700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 -- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 msgr2=0x7f05a8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c00c4f50 0x7f05a8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 -- 172.21.15.29:0/863233415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8004850 msgr2=0x7f05a8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8004850 0x7f05a8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 -- 172.21.15.29:0/863233415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a80035b0 con 0x7f05a8003a00 2023-10-16T19:40:25.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8003a00 0x7f05a8003e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009b60 tx=0x7f05a8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6df05ca3c92cda server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000e6c0 con 0x7f05a8003a00 2023-10-16T19:40:25.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000e820 con 0x7f05a8003a00 2023-10-16T19:40:25.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05be7fc700 1 -- 172.21.15.29:0/863233415 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000eb90 con 0x7f05a8003a00 2023-10-16T19:40:25.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05c5c8d700 1 -- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8003a00 msgr2=0x7f05a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/863233415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a8003a00 0x7f05a8003e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009b60 tx=0x7f05a8005880 comp rx=0 tx=0).stop 2023-10-16T19:40:25.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05bffff700 1 -- 172.21.15.29:0/863233415 reap_dead start 2023-10-16T19:40:25.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.481+0000 7f05c5c8d700 1 -- 172.21.15.29:0/863233415 shutdown_connections 2023-10-16T19:40:25.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.482+0000 7f05c5c8d700 1 -- 172.21.15.29:0/863233415 >> 172.21.15.29:0/863233415 conn(0x7f05c00a9cd0 msgr2=0x7f05c00aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.482+0000 7f05c5c8d700 1 -- 172.21.15.29:0/863233415 shutdown_connections 2023-10-16T19:40:25.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.482+0000 7f05c5c8d700 1 -- 172.21.15.29:0/863233415 wait complete. 2023-10-16T19:40:25.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.483+0000 7f05c5c8d700 1 Processor -- start 2023-10-16T19:40:25.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.483+0000 7f05c5c8d700 1 -- start start 2023-10-16T19:40:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05c00a6650 0x7f05c0151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c006bfe0 0x7f05c014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c006cf40 con 0x7f05a8003a00 2023-10-16T19:40:25.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c006d9f0 con 0x7f05c00a6650 2023-10-16T19:40:25.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05c5c8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c006d120 con 0x7f05c006bfe0 2023-10-16T19:40:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05bf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05bf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52158/0 (socket says 172.21.15.29:52158) 2023-10-16T19:40:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.484+0000 7f05bf7fe700 1 -- 172.21.15.29:0/2776011902 learned_addr learned my addr 172.21.15.29:0/2776011902 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05beffd700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05c00a6650 0x7f05c0151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bffff700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c006bfe0 0x7f05c014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 -- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c006bfe0 msgr2=0x7f05c014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c006bfe0 0x7f05c014b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 -- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05c00a6650 msgr2=0x7f05c0151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05c00a6650 0x7f05c0151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 -- 172.21.15.29:0/2776011902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c006d430 con 0x7f05a8003a00 2023-10-16T19:40:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05bf7fe700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e4b0 tx=0x7f05b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000e6c0 con 0x7f05a8003a00 2023-10-16T19:40:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0003ad0 con 0x7f05a8003a00 2023-10-16T19:40:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0003e80 con 0x7f05a8003a00 2023-10-16T19:40:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c006d710 con 0x7f05a8003a00 2023-10-16T19:40:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.485+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c01523b0 con 0x7f05a8003a00 2023-10-16T19:40:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.486+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c006be30 con 0x7f05a8003a00 2023-10-16T19:40:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.487+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f05b0013470 con 0x7f05a8003a00 2023-10-16T19:40:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.487+0000 7f05a7fff700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 0x7f05ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.487+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05b008b110 con 0x7f05a8003a00 2023-10-16T19:40:25.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.487+0000 7f05beffd700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 0x7f05ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.488+0000 7f05beffd700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 0x7f05ac06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f05c006cd00 tx=0x7f05b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.491+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05b0056080 con 0x7f05a8003a00 2023-10-16T19:40:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.693+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05c004f400 con 0x7f05a8003a00 2023-10-16T19:40:25.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.694+0000 7f05a7fff700 1 -- 172.21.15.29:0/2776011902 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05b00596a0 con 0x7f05a8003a00 2023-10-16T19:40:25.697 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 msgr2=0x7f05ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 0x7f05ac06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f05c006cd00 tx=0x7f05b4008040 comp rx=0 tx=0).stop 2023-10-16T19:40:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 msgr2=0x7f05c006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e4b0 tx=0x7f05b00047c0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 shutdown_connections 2023-10-16T19:40:25.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f05ac06af00 0x7f05ac06d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f05c006bfe0 0x7f05c014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05a8003a00 0x7f05c006c7c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 --2- 172.21.15.29:0/2776011902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05c00a6650 0x7f05c0151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 >> 172.21.15.29:0/2776011902 conn(0x7f05c00a9cd0 msgr2=0x7f05c00c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 shutdown_connections 2023-10-16T19:40:25.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.696+0000 7f05c5c8d700 1 -- 172.21.15.29:0/2776011902 wait complete. 2023-10-16T19:40:25.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.839+0000 7fe48b677700 1 Processor -- start 2023-10-16T19:40:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.839+0000 7fe48b677700 1 -- start start 2023-10-16T19:40:25.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe48b677700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4840c5a90 0x7fe484152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe48b677700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4840b9520 0x7fe484152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe48b677700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4840aba00 con 0x7fe4840c67f0 2023-10-16T19:40:25.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe48b677700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe484153410 con 0x7fe4840c5a90 2023-10-16T19:40:25.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe48b677700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe484156d60 con 0x7fe4840b9520 2023-10-16T19:40:25.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4840c5a90 0x7fe484152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe489413700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe4840c67f0 0x7fe4840c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37610/0 (socket says 172.21.15.29:37610) 2023-10-16T19:40:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe489413700 1 -- 172.21.15.29:0/3264629309 learned_addr learned my addr 172.21.15.29:0/3264629309 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 -- 172.21.15.29:0/3264629309 >> v2:172.21.15.53:3300/0 conn(0x7fe4840b9520 msgr2=0x7fe484152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe489c14700 1 --2- 172.21.15.29:0/3264629309 >> v2:172.21.15.53:3300/0 conn(0x7fe4840b9520 0x7fe484152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 --2- 172.21.15.29:0/3264629309 >> v2:172.21.15.53:3300/0 conn(0x7fe4840b9520 0x7fe484152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 -- 172.21.15.29:0/3264629309 >> v1:172.21.15.29:6789/0 conn(0x7fe4840c67f0 legacy=0x7fe4840c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe47bfff700 1 -- 172.21.15.29:0/3264629309 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725828141 0 0) 0x7fe4840aba00 con 0x7fe4840c67f0 2023-10-16T19:40:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 -- 172.21.15.29:0/3264629309 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484155fa0 con 0x7fe4840c5a90 2023-10-16T19:40:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe488c12700 1 --2- 172.21.15.29:0/3264629309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe484152990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe4840c1150 tx=0x7fe474009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043fa8c5cdf662c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe47bfff700 1 -- 172.21.15.29:0/3264629309 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474011830 con 0x7fe4840c5a90 2023-10-16T19:40:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe47bfff700 1 -- 172.21.15.29:0/3264629309 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474011990 con 0x7fe4840c5a90 2023-10-16T19:40:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.840+0000 7fe47bfff700 1 -- 172.21.15.29:0/3264629309 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474011d20 con 0x7fe4840c5a90 2023-10-16T19:40:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 -- 172.21.15.29:0/3264629309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 msgr2=0x7fe484152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 --2- 172.21.15.29:0/3264629309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe484152990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe4840c1150 tx=0x7fe474009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 -- 172.21.15.29:0/3264629309 shutdown_connections 2023-10-16T19:40:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 --2- 172.21.15.29:0/3264629309 >> v2:172.21.15.53:3300/0 conn(0x7fe4840b9520 0x7fe484152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 --2- 172.21.15.29:0/3264629309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe484152990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 -- 172.21.15.29:0/3264629309 >> 172.21.15.29:0/3264629309 conn(0x7fe4840a8070 msgr2=0x7fe4840c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 -- 172.21.15.29:0/3264629309 shutdown_connections 2023-10-16T19:40:25.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.841+0000 7fe48b677700 1 -- 172.21.15.29:0/3264629309 wait complete. 2023-10-16T19:40:25.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.842+0000 7fe48b677700 1 Processor -- start 2023-10-16T19:40:25.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.842+0000 7fe48b677700 1 -- start start 2023-10-16T19:40:25.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 0x7fe484152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 0x7fe484070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484150e30 con 0x7fe4840c5a90 2023-10-16T19:40:25.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484152ba0 con 0x7fe4840b9520 2023-10-16T19:40:25.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe48b677700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840be670 con 0x7fe4840c67f0 2023-10-16T19:40:25.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52174/0 (socket says 172.21.15.29:52174) 2023-10-16T19:40:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 -- 172.21.15.29:0/2830899845 learned_addr learned my addr 172.21.15.29:0/2830899845 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe489c14700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 0x7fe484070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe489413700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 0x7fe484152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 -- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 msgr2=0x7fe484070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 0x7fe484070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 -- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 msgr2=0x7fe484152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 0x7fe484152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe488c12700 1 -- 172.21.15.29:0/2830899845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740094a0 con 0x7fe4840c5a90 2023-10-16T19:40:25.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe489c14700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 0x7fe484070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:25.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.843+0000 7fe489413700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 0x7fe484152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:25.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe488c12700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe474000c00 tx=0x7fe474004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740038a0 con 0x7fe4840c5a90 2023-10-16T19:40:25.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47401f070 con 0x7fe4840c5a90 2023-10-16T19:40:25.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4841edcb0 con 0x7fe4840c5a90 2023-10-16T19:40:25.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474003c40 con 0x7fe4840c5a90 2023-10-16T19:40:25.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.844+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe484150870 con 0x7fe4840c5a90 2023-10-16T19:40:25.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.845+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48404f400 con 0x7fe4840c5a90 2023-10-16T19:40:25.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.845+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe474026480 con 0x7fe4840c5a90 2023-10-16T19:40:25.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.846+0000 7fe479ffb700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 0x7fe46806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:25.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.846+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe474021070 con 0x7fe4840c5a90 2023-10-16T19:40:25.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.846+0000 7fe489413700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 0x7fe46806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:25.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.847+0000 7fe489413700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 0x7fe46806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ab2f0 tx=0x7fe480009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:25.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:25.850+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe474056080 con 0x7fe4840c5a90 2023-10-16T19:40:26.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.047+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe48406d520 con 0x7fe4840c5a90 2023-10-16T19:40:26.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.048+0000 7fe479ffb700 1 -- 172.21.15.29:0/2830899845 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe474015020 con 0x7fe4840c5a90 2023-10-16T19:40:26.050 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:26.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.049+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 msgr2=0x7fe46806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.049+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 0x7fe46806d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ab2f0 tx=0x7fe480009040 comp rx=0 tx=0).stop 2023-10-16T19:40:26.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 msgr2=0x7fe4840c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe474000c00 tx=0x7fe474004750 comp rx=0 tx=0).stop 2023-10-16T19:40:26.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 shutdown_connections 2023-10-16T19:40:26.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe46806af00 0x7fe46806d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe4840c67f0 0x7fe484070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4840b9520 0x7fe484152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 --2- 172.21.15.29:0/2830899845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4840c5a90 0x7fe4840c4020 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 >> 172.21.15.29:0/2830899845 conn(0x7fe4840a8070 msgr2=0x7fe4840c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 shutdown_connections 2023-10-16T19:40:26.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.050+0000 7fe48b677700 1 -- 172.21.15.29:0/2830899845 wait complete. 2023-10-16T19:40:26.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.186+0000 7fa7e6209700 1 Processor -- start 2023-10-16T19:40:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.186+0000 7fa7e6209700 1 -- start start 2023-10-16T19:40:26.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7e6209700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7e014e460 0x7fa7e006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7e6209700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7e00c2d10 0x7fa7e0070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7e6209700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e0154e10 con 0x7fa7e006df10 2023-10-16T19:40:26.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7e6209700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e0150e10 con 0x7fa7e00c2d10 2023-10-16T19:40:26.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7e6209700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00c28c0 con 0x7fa7e014e460 2023-10-16T19:40:26.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7deffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7e00c2d10 0x7fa7e0070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7dffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa7e006df10 0x7fa7e006a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37628/0 (socket says 172.21.15.29:37628) 2023-10-16T19:40:26.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7dffff700 1 -- 172.21.15.29:0/3743300397 learned_addr learned my addr 172.21.15.29:0/3743300397 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:26.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.187+0000 7fa7df7fe700 1 --2- 172.21.15.29:0/3743300397 >> v2:172.21.15.53:3300/0 conn(0x7fa7e014e460 0x7fa7e006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7deffd700 1 -- 172.21.15.29:0/3743300397 >> v2:172.21.15.53:3300/0 conn(0x7fa7e014e460 msgr2=0x7fa7e006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:26.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7deffd700 1 --2- 172.21.15.29:0/3743300397 >> v2:172.21.15.53:3300/0 conn(0x7fa7e014e460 0x7fa7e006d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7deffd700 1 -- 172.21.15.29:0/3743300397 >> v1:172.21.15.29:6789/0 conn(0x7fa7e006df10 legacy=0x7fa7e006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7de7fc700 1 -- 172.21.15.29:0/3743300397 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538267323 0 0) 0x7fa7e0154e10 con 0x7fa7e006df10 2023-10-16T19:40:26.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7deffd700 1 -- 172.21.15.29:0/3743300397 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0155340 con 0x7fa7e00c2d10 2023-10-16T19:40:26.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7deffd700 1 --2- 172.21.15.29:0/3743300397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e00c2d10 0x7fa7e0070e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00c11e0 tx=0x7fa7c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6528b95d14a1dbe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7de7fc700 1 -- 172.21.15.29:0/3743300397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011830 con 0x7fa7e00c2d10 2023-10-16T19:40:26.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7de7fc700 1 -- 172.21.15.29:0/3743300397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8011990 con 0x7fa7e00c2d10 2023-10-16T19:40:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7de7fc700 1 -- 172.21.15.29:0/3743300397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011d20 con 0x7fa7e00c2d10 2023-10-16T19:40:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 -- 172.21.15.29:0/3743300397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e00c2d10 msgr2=0x7fa7e0070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 --2- 172.21.15.29:0/3743300397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e00c2d10 0x7fa7e0070e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00c11e0 tx=0x7fa7c8009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 -- 172.21.15.29:0/3743300397 shutdown_connections 2023-10-16T19:40:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 --2- 172.21.15.29:0/3743300397 >> v2:172.21.15.53:3300/0 conn(0x7fa7e014e460 0x7fa7e006d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 --2- 172.21.15.29:0/3743300397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e00c2d10 0x7fa7e0070e60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 -- 172.21.15.29:0/3743300397 >> 172.21.15.29:0/3743300397 conn(0x7fa7e00c66d0 msgr2=0x7fa7e00c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.188+0000 7fa7e6209700 1 -- 172.21.15.29:0/3743300397 shutdown_connections 2023-10-16T19:40:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.189+0000 7fa7e6209700 1 -- 172.21.15.29:0/3743300397 wait complete. 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.190+0000 7fa7e6209700 1 Processor -- start 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.190+0000 7fa7e6209700 1 -- start start 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 0x7fa7e01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 0x7fa7e0152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00ac2f0 con 0x7fa7e006df10 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00ab100 con 0x7fa7e014e460 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7e6209700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00ab6e0 con 0x7fa7e00c2d10 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52186/0 (socket says 172.21.15.29:52186) 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7df7fe700 1 -- 172.21.15.29:0/2703131161 learned_addr learned my addr 172.21.15.29:0/2703131161 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7dffff700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 0x7fa7e0152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.191+0000 7fa7deffd700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 0x7fa7e01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 -- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 msgr2=0x7fa7e01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 0x7fa7e01522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 -- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 msgr2=0x7fa7e0152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 0x7fa7e0152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 -- 172.21.15.29:0/2703131161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80094a0 con 0x7fa7e006df10 2023-10-16T19:40:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7deffd700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 0x7fa7e01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7dffff700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 0x7fa7e0152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7df7fe700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e840 tx=0x7fa7d000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0013610 con 0x7fa7e006df10 2023-10-16T19:40:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0013770 con 0x7fa7e006df10 2023-10-16T19:40:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e00ab9c0 con 0x7fa7e006df10 2023-10-16T19:40:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0013b20 con 0x7fa7e006df10 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.192+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e00abf80 con 0x7fa7e006df10 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.193+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e004f400 con 0x7fa7e006df10 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.193+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7d0013c80 con 0x7fa7e006df10 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.194+0000 7fa7d7fff700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 0x7fa7c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.194+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7d0089520 con 0x7fa7e006df10 2023-10-16T19:40:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.194+0000 7fa7deffd700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 0x7fa7c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.194+0000 7fa7deffd700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 0x7fa7c006d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00c11e0 tx=0x7fa7c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.198+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7d0054370 con 0x7fa7e006df10 2023-10-16T19:40:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.442+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7e0144d10 con 0x7fa7e006df10 2023-10-16T19:40:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.442+0000 7fa7d7fff700 1 -- 172.21.15.29:0/2703131161 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fa7d0057990 con 0x7fa7e006df10 2023-10-16T19:40:26.445 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:26.445 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.444+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 msgr2=0x7fa7c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 0x7fa7c006d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00c11e0 tx=0x7fa7c8008030 comp rx=0 tx=0).stop 2023-10-16T19:40:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 msgr2=0x7fa7e0153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e840 tx=0x7fa7d000ec00 comp rx=0 tx=0).stop 2023-10-16T19:40:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 shutdown_connections 2023-10-16T19:40:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa7c006af00 0x7fa7c006d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7e014e460 0x7fa7e0152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e006df10 0x7fa7e0153d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 --2- 172.21.15.29:0/2703131161 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa7e00c2d10 0x7fa7e01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 >> 172.21.15.29:0/2703131161 conn(0x7fa7e00c66d0 msgr2=0x7fa7e00c1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 shutdown_connections 2023-10-16T19:40:26.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.445+0000 7fa7e6209700 1 -- 172.21.15.29:0/2703131161 wait complete. 2023-10-16T19:40:26.449 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:26.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:26.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.582+0000 7f0631a4c700 1 Processor -- start 2023-10-16T19:40:26.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.582+0000 7f0631a4c700 1 -- start start 2023-10-16T19:40:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0631a4c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 0x7f062c0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0631a4c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 0x7f062c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0631a4c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c0ca540 con 0x7f062c0bd8c0 2023-10-16T19:40:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0631a4c700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c158c80 con 0x7f062c0c8130 2023-10-16T19:40:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0631a4c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0ca790 con 0x7f062c151ea0 2023-10-16T19:40:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f062b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f062c0bd8c0 0x7f062c155090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37642/0 (socket says 172.21.15.29:37642) 2023-10-16T19:40:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f062b7fe700 1 -- 172.21.15.29:0/3875663722 learned_addr learned my addr 172.21.15.29:0/3875663722 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f062a7fc700 1 --2- 172.21.15.29:0/3875663722 >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 0x7f062c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f062affd700 1 --2- 172.21.15.29:0/3875663722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 0x7f062c0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0629ffb700 1 -- 172.21.15.29:0/3875663722 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20507734 0 0) 0x7f062c0ca540 con 0x7f062c0bd8c0 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.583+0000 7f0629ffb700 1 -- 172.21.15.29:0/3875663722 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06140035b0 con 0x7f062c0bd8c0 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062affd700 1 -- 172.21.15.29:0/3875663722 >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 msgr2=0x7f062c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062affd700 1 --2- 172.21.15.29:0/3875663722 >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 0x7f062c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062affd700 1 -- 172.21.15.29:0/3875663722 >> v1:172.21.15.29:6789/0 conn(0x7f062c0bd8c0 legacy=0x7f062c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062affd700 1 -- 172.21.15.29:0/3875663722 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0caa70 con 0x7f062c151ea0 2023-10-16T19:40:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062a7fc700 1 --2- 172.21.15.29:0/3875663722 >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 0x7f062c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f062affd700 1 --2- 172.21.15.29:0/3875663722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 0x7f062c0c4bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0620009840 tx=0x7f0620009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92d394a2b6780d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f0629ffb700 1 -- 172.21.15.29:0/3875663722 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011830 con 0x7f062c151ea0 2023-10-16T19:40:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f0629ffb700 1 -- 172.21.15.29:0/3875663722 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620011990 con 0x7f062c151ea0 2023-10-16T19:40:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.584+0000 7f0629ffb700 1 -- 172.21.15.29:0/3875663722 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011d00 con 0x7f062c151ea0 2023-10-16T19:40:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 -- 172.21.15.29:0/3875663722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 msgr2=0x7f062c0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 --2- 172.21.15.29:0/3875663722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 0x7f062c0c4bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0620009840 tx=0x7f0620009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 -- 172.21.15.29:0/3875663722 shutdown_connections 2023-10-16T19:40:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 --2- 172.21.15.29:0/3875663722 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c151ea0 0x7f062c0c4bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 --2- 172.21.15.29:0/3875663722 >> v2:172.21.15.53:3300/0 conn(0x7f062c0c8130 0x7f062c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 -- 172.21.15.29:0/3875663722 >> 172.21.15.29:0/3875663722 conn(0x7f062c072190 msgr2=0x7f062c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 -- 172.21.15.29:0/3875663722 shutdown_connections 2023-10-16T19:40:26.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.585+0000 7f0631a4c700 1 -- 172.21.15.29:0/3875663722 wait complete. 2023-10-16T19:40:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.586+0000 7f0631a4c700 1 Processor -- start 2023-10-16T19:40:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.586+0000 7f0631a4c700 1 -- start start 2023-10-16T19:40:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c0bd8c0 0x7f062c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062c0c8130 0x7f062c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1ed610 con 0x7f062c151ea0 2023-10-16T19:40:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1ecd00 con 0x7f062c0c8130 2023-10-16T19:40:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c148cb0 con 0x7f062c0bd8c0 2023-10-16T19:40:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52204/0 (socket says 172.21.15.29:52204) 2023-10-16T19:40:26.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 -- 172.21.15.29:0/2249128041 learned_addr learned my addr 172.21.15.29:0/2249128041 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:26.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062affd700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c0bd8c0 0x7f062c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062a7fc700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062c0c8130 0x7f062c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 -- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c0bd8c0 msgr2=0x7f062c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c0bd8c0 0x7f062c1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 -- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062c0c8130 msgr2=0x7f062c1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062c0c8130 0x7f062c1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 -- 172.21.15.29:0/2249128041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0094a0 con 0x7f062c151ea0 2023-10-16T19:40:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f062b7fe700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f062400caa0 tx=0x7f062400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400a9e0 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062400ab40 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200094a0 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.587+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624012400 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.588+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c1ed230 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.589+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c1ed750 con 0x7f062c151ea0 2023-10-16T19:40:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.589+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f062401b3b0 con 0x7f062c151ea0 2023-10-16T19:40:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.589+0000 7f0613fff700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 0x7f061806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.589+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0624089480 con 0x7f062c151ea0 2023-10-16T19:40:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.590+0000 7f062affd700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 0x7f061806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.590+0000 7f062affd700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 0x7f061806d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.594+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f062c1ed750 con 0x7f062c151ea0 2023-10-16T19:40:26.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.796+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f062c1ed750 con 0x7f062c151ea0 2023-10-16T19:40:26.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.797+0000 7f0613fff700 1 -- 172.21.15.29:0/2249128041 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f062c1ed750 con 0x7f062c151ea0 2023-10-16T19:40:26.799 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:26.799 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 msgr2=0x7f061806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 0x7f061806d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620008030 comp rx=0 tx=0).stop 2023-10-16T19:40:26.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 msgr2=0x7f062c146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f062400caa0 tx=0x7f062400cdb0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 shutdown_connections 2023-10-16T19:40:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f061806af00 0x7f061806d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c151ea0 0x7f062c146500 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f062c0bd8c0 0x7f062c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 --2- 172.21.15.29:0/2249128041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062c0c8130 0x7f062c1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 >> 172.21.15.29:0/2249128041 conn(0x7f062c072190 msgr2=0x7f062c150560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 shutdown_connections 2023-10-16T19:40:26.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.799+0000 7f0631a4c700 1 -- 172.21.15.29:0/2249128041 wait complete. 2023-10-16T19:40:26.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:26.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:26.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.940+0000 7f69021fa700 1 Processor -- start 2023-10-16T19:40:26.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.940+0000 7f69021fa700 1 -- start start 2023-10-16T19:40:26.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f69021fa700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f69021fa700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68fc06db00 0x7f68fc06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f69021fa700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc155af0 con 0x7f68fc0c3350 2023-10-16T19:40:26.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f69021fa700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc152300 con 0x7f68fc06db00 2023-10-16T19:40:26.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f69021fa700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c2e40 con 0x7f68fc14ec50 2023-10-16T19:40:26.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f68fbfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68fc06db00 0x7f68fc06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44662/0 (socket says 172.21.15.29:44662) 2023-10-16T19:40:26.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.941+0000 7f68fb7fe700 1 -- 172.21.15.29:0/3304368636 learned_addr learned my addr 172.21.15.29:0/3304368636 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:26.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fbfff700 1 -- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 msgr2=0x7f68fc1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:26.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fbfff700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fbfff700 1 -- 172.21.15.29:0/3304368636 >> v1:172.21.15.53:6789/0 conn(0x7f68fc0c3350 legacy=0x7f68fc071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fbfff700 1 -- 172.21.15.29:0/3304368636 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc14f030 con 0x7f68fc06db00 2023-10-16T19:40:26.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fb7fe700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:26.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fbfff700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc06df90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68f400bfa0 tx=0x7f68f400d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76797b52693a9f1e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fa7fc700 1 -- 172.21.15.29:0/3304368636 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4010070 con 0x7f68fc06db00 2023-10-16T19:40:26.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fa7fc700 1 -- 172.21.15.29:0/3304368636 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400b2e0 con 0x7f68fc06db00 2023-10-16T19:40:26.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f68fa7fc700 1 -- 172.21.15.29:0/3304368636 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400dc40 con 0x7f68fc06db00 2023-10-16T19:40:26.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f69021fa700 1 -- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 msgr2=0x7f68fc06df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.942+0000 7f69021fa700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc06df90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68f400bfa0 tx=0x7f68f400d330 comp rx=0 tx=0).stop 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 -- 172.21.15.29:0/3304368636 shutdown_connections 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc06df90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 --2- 172.21.15.29:0/3304368636 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc14ec50 0x7f68fc1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 -- 172.21.15.29:0/3304368636 >> 172.21.15.29:0/3304368636 conn(0x7f68fc0c7110 msgr2=0x7f68fc0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:26.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 -- 172.21.15.29:0/3304368636 shutdown_connections 2023-10-16T19:40:26.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.943+0000 7f69021fa700 1 -- 172.21.15.29:0/3304368636 wait complete. 2023-10-16T19:40:26.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.944+0000 7f69021fa700 1 Processor -- start 2023-10-16T19:40:26.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.944+0000 7f69021fa700 1 -- start start 2023-10-16T19:40:26.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc1ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc0c3350 0x7f68fc14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc1e9e30 con 0x7f68fc14ec50 2023-10-16T19:40:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c0fb0 con 0x7f68fc06db00 2023-10-16T19:40:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c1290 con 0x7f68fc0c3350 2023-10-16T19:40:26.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc1ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52218/0 (socket says 172.21.15.29:52218) 2023-10-16T19:40:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 -- 172.21.15.29:0/3841158068 learned_addr learned my addr 172.21.15.29:0/3841158068 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68faffd700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc0c3350 0x7f68fc14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 -- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc0c3350 msgr2=0x7f68fc14da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc0c3350 0x7f68fc14da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 -- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 msgr2=0x7f68fc1ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc1ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 -- 172.21.15.29:0/3841158068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009550 con 0x7f68fc14ec50 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fb7fe700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc1ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68fbfff700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68fc072170 tx=0x7f68f4004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4009300 con 0x7f68fc14ec50 2023-10-16T19:40:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4009950 con 0x7f68fc14ec50 2023-10-16T19:40:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f400bc80 con 0x7f68fc14ec50 2023-10-16T19:40:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4009d00 con 0x7f68fc14ec50 2023-10-16T19:40:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.945+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc1ea3d0 con 0x7f68fc14ec50 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.946+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc04f400 con 0x7f68fc14ec50 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.947+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f68f4009050 con 0x7f68fc14ec50 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.947+0000 7f68f3fff700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 0x7f68dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.947+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68f408ad70 con 0x7f68fc14ec50 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.947+0000 7f68fb7fe700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 0x7f68dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.948+0000 7f68fb7fe700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 0x7f68dc06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68fc151540 tx=0x7f68e40092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:26.952+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68f4055bc0 con 0x7f68fc14ec50 2023-10-16T19:40:27.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.151+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68fc0c79e0 con 0x7f68fc14ec50 2023-10-16T19:40:27.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.152+0000 7f68f3fff700 1 -- 172.21.15.29:0/3841158068 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68f40210a0 con 0x7f68fc14ec50 2023-10-16T19:40:27.155 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:27.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 msgr2=0x7f68dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 0x7f68dc06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68fc151540 tx=0x7f68e40092c0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 msgr2=0x7f68fc1ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68fc072170 tx=0x7f68f4004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:27.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 shutdown_connections 2023-10-16T19:40:27.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f68dc06af00 0x7f68dc06d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68fc14ec50 0x7f68fc1ed420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc06db00 0x7f68fc1ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 --2- 172.21.15.29:0/3841158068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f68fc0c3350 0x7f68fc14da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 >> 172.21.15.29:0/3841158068 conn(0x7f68fc0c7110 msgr2=0x7f68fc06dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 shutdown_connections 2023-10-16T19:40:27.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.154+0000 7f69021fa700 1 -- 172.21.15.29:0/3841158068 wait complete. 2023-10-16T19:40:27.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:27.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:27.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.296+0000 7f79103e6700 1 Processor -- start 2023-10-16T19:40:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.296+0000 7f79103e6700 1 -- start start 2023-10-16T19:40:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f79103e6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f790813d660 0x7f790806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f79103e6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790806e780 con 0x7f790806adc0 2023-10-16T19:40:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f79103e6700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7908154f10 con 0x7f7908154a50 2023-10-16T19:40:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f79103e6700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790806d320 con 0x7f790813d660 2023-10-16T19:40:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f790e182700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f790813d660 0x7f790806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f790e983700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f790806adc0 0x7f790815f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37670/0 (socket says 172.21.15.29:37670) 2023-10-16T19:40:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.297+0000 7f790e983700 1 -- 172.21.15.29:0/1781140996 learned_addr learned my addr 172.21.15.29:0/1781140996 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790e182700 1 -- 172.21.15.29:0/1781140996 >> v1:172.21.15.53:6789/0 conn(0x7f7908154a50 legacy=0x7f79081583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790e182700 1 -- 172.21.15.29:0/1781140996 >> v1:172.21.15.29:6789/0 conn(0x7f790806adc0 legacy=0x7f790815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790d180700 1 -- 172.21.15.29:0/1781140996 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801758608 0 0) 0x7f790806e780 con 0x7f790806adc0 2023-10-16T19:40:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790e182700 1 -- 172.21.15.29:0/1781140996 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79081551f0 con 0x7f790813d660 2023-10-16T19:40:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790e182700 1 --2- 172.21.15.29:0/1781140996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f790806a880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7904009840 tx=0x7f7904009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdd0e39b42fe83b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790d180700 1 -- 172.21.15.29:0/1781140996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904011830 con 0x7f790813d660 2023-10-16T19:40:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790d180700 1 -- 172.21.15.29:0/1781140996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7904011990 con 0x7f790813d660 2023-10-16T19:40:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f790d180700 1 -- 172.21.15.29:0/1781140996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904011d20 con 0x7f790813d660 2023-10-16T19:40:27.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f79103e6700 1 -- 172.21.15.29:0/1781140996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 msgr2=0x7f790806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.298+0000 7f79103e6700 1 --2- 172.21.15.29:0/1781140996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f790806a880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7904009840 tx=0x7f7904009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:27.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.299+0000 7f79103e6700 1 -- 172.21.15.29:0/1781140996 shutdown_connections 2023-10-16T19:40:27.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.299+0000 7f79103e6700 1 --2- 172.21.15.29:0/1781140996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f790806a880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.299+0000 7f79103e6700 1 -- 172.21.15.29:0/1781140996 >> 172.21.15.29:0/1781140996 conn(0x7f79080c7110 msgr2=0x7f79080c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.299+0000 7f79103e6700 1 -- 172.21.15.29:0/1781140996 shutdown_connections 2023-10-16T19:40:27.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.299+0000 7f79103e6700 1 -- 172.21.15.29:0/1781140996 wait complete. 2023-10-16T19:40:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 Processor -- start 2023-10-16T19:40:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 -- start start 2023-10-16T19:40:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 0x7f79080ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 0x7f79081ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080aa170 con 0x7f790813d660 2023-10-16T19:40:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081ea9c0 con 0x7f7908154a50 2023-10-16T19:40:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.300+0000 7f79103e6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080ac370 con 0x7f790806adc0 2023-10-16T19:40:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52230/0 (socket says 172.21.15.29:52230) 2023-10-16T19:40:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 -- 172.21.15.29:0/4011768177 learned_addr learned my addr 172.21.15.29:0/4011768177 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790e983700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 0x7f79081ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790e182700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 0x7f79080ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 -- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 msgr2=0x7f79080ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 0x7f79080ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 -- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 msgr2=0x7f79081ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 0x7f79081ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 -- 172.21.15.29:0/4011768177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040094a0 con 0x7f790813d660 2023-10-16T19:40:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790e182700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 0x7f79080ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790e983700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 0x7f79081ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f790d981700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c480 tx=0x7f78f800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80052d0 con 0x7f790813d660 2023-10-16T19:40:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8005430 con 0x7f790813d660 2023-10-16T19:40:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80038c0 con 0x7f790813d660 2023-10-16T19:40:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79080ac090 con 0x7f790813d660 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.301+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7908157870 con 0x7f790813d660 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.302+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79081e9c60 con 0x7f790813d660 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.303+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78f8003a20 con 0x7f790813d660 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.303+0000 7f78feffd700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.303+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78f8088cd0 con 0x7f790813d660 2023-10-16T19:40:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.303+0000 7f790e182700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.304+0000 7f790e182700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 0x7f78ec06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79080c1f50 tx=0x7f790401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.308+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79081e9c60 con 0x7f790813d660 2023-10-16T19:40:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.508+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79081e9c60 con 0x7f790813d660 2023-10-16T19:40:27.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.508+0000 7f78feffd700 1 -- 172.21.15.29:0/4011768177 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78f8017020 con 0x7f790813d660 2023-10-16T19:40:27.511 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:27.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 msgr2=0x7f78ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 0x7f78ec06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79080c1f50 tx=0x7f790401c040 comp rx=0 tx=0).stop 2023-10-16T19:40:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 msgr2=0x7f79081e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c480 tx=0x7f78f800c840 comp rx=0 tx=0).stop 2023-10-16T19:40:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 shutdown_connections 2023-10-16T19:40:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7908154a50 0x7f79081ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f790806adc0 0x7f79080ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 --2- 172.21.15.29:0/4011768177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f790813d660 0x7f79081e9f40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 >> 172.21.15.29:0/4011768177 conn(0x7f79080c7110 msgr2=0x7f79080c27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 shutdown_connections 2023-10-16T19:40:27.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.510+0000 7f79103e6700 1 -- 172.21.15.29:0/4011768177 wait complete. 2023-10-16T19:40:27.524 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:27.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.651+0000 7fb9f57c9700 1 Processor -- start 2023-10-16T19:40:27.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.651+0000 7fb9f57c9700 1 -- start start 2023-10-16T19:40:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9f57c9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f013d660 0x7fb9f006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9f57c9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9f0154a50 0x7fb9f01583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9f57c9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006e780 con 0x7fb9f006adc0 2023-10-16T19:40:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9f57c9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f006d320 con 0x7fb9f0154a50 2023-10-16T19:40:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9f57c9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0154f10 con 0x7fb9f013d660 2023-10-16T19:40:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9ee7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9f0154a50 0x7fb9f01583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9ef7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb9f006adc0 0x7fb9f0158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37684/0 (socket says 172.21.15.29:37684) 2023-10-16T19:40:27.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.652+0000 7fb9ef7fe700 1 -- 172.21.15.29:0/2180949745 learned_addr learned my addr 172.21.15.29:0/2180949745 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9ee7fc700 1 -- 172.21.15.29:0/2180949745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f013d660 msgr2=0x7fb9f006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/2180949745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f013d660 0x7fb9f006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9ee7fc700 1 -- 172.21.15.29:0/2180949745 >> v1:172.21.15.29:6789/0 conn(0x7fb9f006adc0 legacy=0x7fb9f0158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9edffb700 1 -- 172.21.15.29:0/2180949745 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653703161 0 0) 0x7fb9f006e780 con 0x7fb9f006adc0 2023-10-16T19:40:27.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9ee7fc700 1 -- 172.21.15.29:0/2180949745 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f01551f0 con 0x7fb9f0154a50 2023-10-16T19:40:27.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/2180949745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f0154a50 0x7fb9f01583c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009840 tx=0x7fb9e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274c2648539a946b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9edffb700 1 -- 172.21.15.29:0/2180949745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0011830 con 0x7fb9f0154a50 2023-10-16T19:40:27.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9edffb700 1 -- 172.21.15.29:0/2180949745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0011990 con 0x7fb9f0154a50 2023-10-16T19:40:27.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.653+0000 7fb9edffb700 1 -- 172.21.15.29:0/2180949745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0011d20 con 0x7fb9f0154a50 2023-10-16T19:40:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 -- 172.21.15.29:0/2180949745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f0154a50 msgr2=0x7fb9f01583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/2180949745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f0154a50 0x7fb9f01583c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009840 tx=0x7fb9e0009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 -- 172.21.15.29:0/2180949745 shutdown_connections 2023-10-16T19:40:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/2180949745 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f013d660 0x7fb9f006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/2180949745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f0154a50 0x7fb9f01583c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 -- 172.21.15.29:0/2180949745 >> 172.21.15.29:0/2180949745 conn(0x7fb9f00c7110 msgr2=0x7fb9f00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 -- 172.21.15.29:0/2180949745 shutdown_connections 2023-10-16T19:40:27.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.654+0000 7fb9f57c9700 1 -- 172.21.15.29:0/2180949745 wait complete. 2023-10-16T19:40:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.655+0000 7fb9f57c9700 1 Processor -- start 2023-10-16T19:40:27.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.655+0000 7fb9f57c9700 1 -- start start 2023-10-16T19:40:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 0x7fb9f00c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f0154a50 0x7fb9f0151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0157990 con 0x7fb9f006adc0 2023-10-16T19:40:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f013ace0 con 0x7fb9f013d660 2023-10-16T19:40:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9f57c9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00c6b70 con 0x7fb9f0154a50 2023-10-16T19:40:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52242/0 (socket says 172.21.15.29:52242) 2023-10-16T19:40:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.656+0000 7fb9eeffd700 1 -- 172.21.15.29:0/3689345362 learned_addr learned my addr 172.21.15.29:0/3689345362 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9ef7fe700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f0154a50 0x7fb9f0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 0x7fb9f00c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 -- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f0154a50 msgr2=0x7fb9f0151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f0154a50 0x7fb9f0151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 -- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 msgr2=0x7fb9f00c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 0x7fb9f00c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 -- 172.21.15.29:0/3689345362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00094a0 con 0x7fb9f006adc0 2023-10-16T19:40:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 0x7fb9f00c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9eeffd700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b530 tx=0x7fb9e400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011830 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e40119b0 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0156230 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011d60 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.657+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f01567f0 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.658+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0074a70 con 0x7fb9f006adc0 2023-10-16T19:40:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.659+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9e401a400 con 0x7fb9f006adc0 2023-10-16T19:40:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.659+0000 7fb9d77fe700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 0x7fb9dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.659+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9e40899e0 con 0x7fb9f006adc0 2023-10-16T19:40:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.659+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 0x7fb9dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.660+0000 7fb9ee7fc700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 0x7fb9dc06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00090b0 tx=0x7fb9e001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:27.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.663+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9e40547a0 con 0x7fb9f006adc0 2023-10-16T19:40:27.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.863+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9f00c3760 con 0x7fb9f006adc0 2023-10-16T19:40:27.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.864+0000 7fb9d77fe700 1 -- 172.21.15.29:0/3689345362 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9e4015020 con 0x7fb9f006adc0 2023-10-16T19:40:27.866 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 msgr2=0x7fb9dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 0x7fb9dc06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00090b0 tx=0x7fb9e001c040 comp rx=0 tx=0).stop 2023-10-16T19:40:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 msgr2=0x7fb9f0155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b530 tx=0x7fb9e400b8f0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 shutdown_connections 2023-10-16T19:40:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb9dc06af00 0x7fb9dc06d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb9f0154a50 0x7fb9f0151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9f006adc0 0x7fb9f0155c50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 --2- 172.21.15.29:0/3689345362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9f013d660 0x7fb9f00c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:27.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 >> 172.21.15.29:0/3689345362 conn(0x7fb9f00c7110 msgr2=0x7fb9f00c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:27.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 shutdown_connections 2023-10-16T19:40:27.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:27.866+0000 7fb9f57c9700 1 -- 172.21.15.29:0/3689345362 wait complete. 2023-10-16T19:40:27.880 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:28.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.006+0000 7fc3c6d0e700 1 Processor -- start 2023-10-16T19:40:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.006+0000 7fc3c6d0e700 1 -- start start 2023-10-16T19:40:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c6d0e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 0x7fc3c0153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c6d0e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c6d0e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00bd0e0 con 0x7fc3c00c7bb0 2023-10-16T19:40:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c6d0e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c00c3000 con 0x7fc3c00c4f50 2023-10-16T19:40:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c6d0e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00c5330 con 0x7fc3c0155e00 2023-10-16T19:40:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c52ab700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c4aaa700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 0x7fc3c0153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c52ab700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44708/0 (socket says 172.21.15.29:44708) 2023-10-16T19:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.007+0000 7fc3c52ab700 1 -- 172.21.15.29:0/1574460467 learned_addr learned my addr 172.21.15.29:0/1574460467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c52ab700 1 -- 172.21.15.29:0/1574460467 >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 msgr2=0x7fc3c0153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c52ab700 1 --2- 172.21.15.29:0/1574460467 >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 0x7fc3c0153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c52ab700 1 -- 172.21.15.29:0/1574460467 >> v1:172.21.15.53:6789/0 conn(0x7fc3c00c7bb0 legacy=0x7fc3c0070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c52ab700 1 -- 172.21.15.29:0/1574460467 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00c2a40 con 0x7fc3c0155e00 2023-10-16T19:40:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c4aaa700 1 --2- 172.21.15.29:0/1574460467 >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 0x7fc3c0153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3c52ab700 1 --2- 172.21.15.29:0/1574460467 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e80 tx=0x7fc3b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58bf52e68ebb4bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3bf7fe700 1 -- 172.21.15.29:0/1574460467 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3c0155e00 2023-10-16T19:40:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3bf7fe700 1 -- 172.21.15.29:0/1574460467 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800b8d0 con 0x7fc3c0155e00 2023-10-16T19:40:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.008+0000 7fc3bf7fe700 1 -- 172.21.15.29:0/1574460467 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800bc80 con 0x7fc3c0155e00 2023-10-16T19:40:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/1574460467 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 msgr2=0x7fc3c0156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/1574460467 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e80 tx=0x7fc3b800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/1574460467 shutdown_connections 2023-10-16T19:40:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/1574460467 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c0155e00 0x7fc3c0156290 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/1574460467 >> v2:172.21.15.53:3300/0 conn(0x7fc3c00c4f50 0x7fc3c0153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/1574460467 >> 172.21.15.29:0/1574460467 conn(0x7fc3c00a9cd0 msgr2=0x7fc3c00aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/1574460467 shutdown_connections 2023-10-16T19:40:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.009+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/1574460467 wait complete. 2023-10-16T19:40:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.010+0000 7fc3c6d0e700 1 Processor -- start 2023-10-16T19:40:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.010+0000 7fc3c6d0e700 1 -- start start 2023-10-16T19:40:28.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c00c7bb0 0x7fc3c014b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c0155e00 0x7fc3c00c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00acd50 con 0x7fc3c00c4f50 2023-10-16T19:40:28.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c014b080 con 0x7fc3c0155e00 2023-10-16T19:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00ad720 con 0x7fc3c00c7bb0 2023-10-16T19:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52256/0 (socket says 172.21.15.29:52256) 2023-10-16T19:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 -- 172.21.15.29:0/395269091 learned_addr learned my addr 172.21.15.29:0/395269091 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3bffff700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c00c7bb0 0x7fc3c014b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c52ab700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c0155e00 0x7fc3c00c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 -- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c00c7bb0 msgr2=0x7fc3c014b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c00c7bb0 0x7fc3c014b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 -- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c0155e00 msgr2=0x7fc3c00c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c0155e00 0x7fc3c00c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 -- 172.21.15.29:0/395269091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40094a0 con 0x7fc3c00c4f50 2023-10-16T19:40:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c4aaa700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400ebe0 tx=0x7fc3b400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400c850 con 0x7fc3c00c4f50 2023-10-16T19:40:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400c9b0 con 0x7fc3c00c4f50 2023-10-16T19:40:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b8009b30 con 0x7fc3c00c4f50 2023-10-16T19:40:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.011+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400cd40 con 0x7fc3c00c4f50 2023-10-16T19:40:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.012+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c00adce0 con 0x7fc3c00c4f50 2023-10-16T19:40:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.013+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c014b670 con 0x7fc3c00c4f50 2023-10-16T19:40:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.013+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3b4013470 con 0x7fc3c00c4f50 2023-10-16T19:40:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.013+0000 7fc3bd7fa700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 0x7fc3a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.013+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3b4089960 con 0x7fc3c00c4f50 2023-10-16T19:40:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.013+0000 7fc3bffff700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 0x7fc3a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.014+0000 7fc3bffff700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 0x7fc3a406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3c014e930 tx=0x7fc3ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.018+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3b4054710 con 0x7fc3c00c4f50 2023-10-16T19:40:28.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.217+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3c004f400 con 0x7fc3c00c4f50 2023-10-16T19:40:28.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.217+0000 7fc3bd7fa700 1 -- 172.21.15.29:0/395269091 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3b400cea0 con 0x7fc3c00c4f50 2023-10-16T19:40:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:28.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 msgr2=0x7fc3a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 0x7fc3a406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3c014e930 tx=0x7fc3ac009040 comp rx=0 tx=0).stop 2023-10-16T19:40:28.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 msgr2=0x7fc3c01e7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400ebe0 tx=0x7fc3b400eef0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 shutdown_connections 2023-10-16T19:40:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc3a406af00 0x7fc3a406d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c0155e00 0x7fc3c00c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3c00c4f50 0x7fc3c01e7bc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.219+0000 7fc3c6d0e700 1 --2- 172.21.15.29:0/395269091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc3c00c7bb0 0x7fc3c014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.220+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 >> 172.21.15.29:0/395269091 conn(0x7fc3c00a9cd0 msgr2=0x7fc3c00c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.220+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 shutdown_connections 2023-10-16T19:40:28.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.220+0000 7fc3c6d0e700 1 -- 172.21.15.29:0/395269091 wait complete. 2023-10-16T19:40:28.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:28.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.356+0000 7fb1a6ed8700 1 Processor -- start 2023-10-16T19:40:28.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.356+0000 7fb1a6ed8700 1 -- start start 2023-10-16T19:40:28.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.357+0000 7fb1a6ed8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb1a01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.357+0000 7fb1a6ed8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0155af0 con 0x7fb1a00c3350 2023-10-16T19:40:28.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.357+0000 7fb1a6ed8700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0152300 con 0x7fb1a006db00 2023-10-16T19:40:28.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.357+0000 7fb1a6ed8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c2e40 con 0x7fb1a014ec50 2023-10-16T19:40:28.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.357+0000 7fb19ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb1a00c3350 0x7fb1a0071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37708/0 (socket says 172.21.15.29:37708) 2023-10-16T19:40:28.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19ffff700 1 -- 172.21.15.29:0/2995763270 learned_addr learned my addr 172.21.15.29:0/2995763270 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:28.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb1a4c74700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb1a01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889290165 0 0) 0x7fb18c001110 con 0x7fb1a00c3350 2023-10-16T19:40:28.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1900035b0 con 0x7fb1a00c3350 2023-10-16T19:40:28.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736350622 0 0) 0x7fb1a0152300 con 0x7fb1a006db00 2023-10-16T19:40:28.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18c001110 con 0x7fb1a006db00 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432369493 0 0) 0x7fb1900035b0 con 0x7fb1a00c3350 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 msgr2=0x7fb1a01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb1a01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 >> v1:172.21.15.53:6789/0 conn(0x7fb1a006db00 legacy=0x7fb1a006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a014f030 con 0x7fb1a00c3350 2023-10-16T19:40:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fb18c001800 con 0x7fb1a00c3350 2023-10-16T19:40:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 >> v1:172.21.15.29:6789/0 conn(0x7fb1a00c3350 legacy=0x7fb1a0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190003bc0 0x7fb190003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb190004850 0x7fb190004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb190005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00c2e40 con 0x7fb190004850 2023-10-16T19:40:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000dd30 con 0x7fb190003bc0 2023-10-16T19:40:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000def0 con 0x7fb1a014ec50 2023-10-16T19:40:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb19ffff700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb190004850 0x7fb190004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb1a4c74700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190003bc0 0x7fb190003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.358+0000 7fb1a5475700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb190005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 -- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 msgr2=0x7fb190005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a014ec50 0x7fb190005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 -- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190003bc0 msgr2=0x7fb190003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190003bc0 0x7fb190003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 -- 172.21.15.29:0/2995763270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900035b0 con 0x7fb190004850 2023-10-16T19:40:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19ffff700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb190004850 0x7fb190004cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c190 tx=0x7fb190005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b6e6eac90a70e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00cd30 con 0x7fb190004850 2023-10-16T19:40:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00ce90 con 0x7fb190004850 2023-10-16T19:40:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb19f7fe700 1 -- 172.21.15.29:0/2995763270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c005ba0 con 0x7fb190004850 2023-10-16T19:40:28.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/2995763270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb190004850 msgr2=0x7fb190004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/2995763270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb190004850 0x7fb190004cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c190 tx=0x7fb190005880 comp rx=0 tx=0).stop 2023-10-16T19:40:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a5475700 1 -- 172.21.15.29:0/2995763270 reap_dead start 2023-10-16T19:40:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/2995763270 shutdown_connections 2023-10-16T19:40:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/2995763270 >> 172.21.15.29:0/2995763270 conn(0x7fb1a00c7110 msgr2=0x7fb1a00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.359+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/2995763270 shutdown_connections 2023-10-16T19:40:28.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.360+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/2995763270 wait complete. 2023-10-16T19:40:28.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.361+0000 7fb1a6ed8700 1 Processor -- start 2023-10-16T19:40:28.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.361+0000 7fb1a6ed8700 1 -- start start 2023-10-16T19:40:28.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190004850 0x7fb1a0145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a0153370 0x7fb1a0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a01dd040 con 0x7fb1a00c5d20 2023-10-16T19:40:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a01dd3d0 con 0x7fb190004850 2023-10-16T19:40:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a6ed8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a006ea80 con 0x7fb1a0153370 2023-10-16T19:40:28.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb19ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb19ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52278/0 (socket says 172.21.15.29:52278) 2023-10-16T19:40:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb19ffff700 1 -- 172.21.15.29:0/219350380 learned_addr learned my addr 172.21.15.29:0/219350380 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a4c74700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190004850 0x7fb1a0145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.362+0000 7fb1a5475700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a0153370 0x7fb1a0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 -- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a0153370 msgr2=0x7fb1a0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a0153370 0x7fb1a0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 -- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190004850 msgr2=0x7fb1a0145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190004850 0x7fb1a0145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 -- 172.21.15.29:0/219350380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00c4ca0 con 0x7fb1a00c5d20 2023-10-16T19:40:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19ffff700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb19000dd00 tx=0x7fb18c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0072d0 con 0x7fb1a00c5d20 2023-10-16T19:40:28.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c007450 con 0x7fb1a00c5d20 2023-10-16T19:40:28.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00c4f80 con 0x7fb1a00c5d20 2023-10-16T19:40:28.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c007800 con 0x7fb1a00c5d20 2023-10-16T19:40:28.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.363+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a01dd900 con 0x7fb1a00c5d20 2023-10-16T19:40:28.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.364+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a01dda90 con 0x7fb1a00c5d20 2023-10-16T19:40:28.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.365+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb18c019030 con 0x7fb1a00c5d20 2023-10-16T19:40:28.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.365+0000 7fb19d7fa700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 0x7fb18406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.365+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb18c08ab30 con 0x7fb1a00c5d20 2023-10-16T19:40:28.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.365+0000 7fb1a4c74700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 0x7fb18406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.366+0000 7fb1a4c74700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 0x7fb18406d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c6f00 tx=0x7fb194009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.370+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb18c055aa0 con 0x7fb1a00c5d20 2023-10-16T19:40:28.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.614+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1a00c5170 con 0x7fb1a00c5d20 2023-10-16T19:40:28.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.615+0000 7fb19d7fa700 1 -- 172.21.15.29:0/219350380 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fb1a00c5170 con 0x7fb1a00c5d20 2023-10-16T19:40:28.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:28.618 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:28.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 msgr2=0x7fb18406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 0x7fb18406d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c6f00 tx=0x7fb194009210 comp rx=0 tx=0).stop 2023-10-16T19:40:28.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 msgr2=0x7fb1a0145680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb19000dd00 tx=0x7fb18c001b10 comp rx=0 tx=0).stop 2023-10-16T19:40:28.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 shutdown_connections 2023-10-16T19:40:28.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb18406af30 0x7fb18406d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1a0153370 0x7fb1a0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb190004850 0x7fb1a0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 --2- 172.21.15.29:0/219350380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1a00c5d20 0x7fb1a0145680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 >> 172.21.15.29:0/219350380 conn(0x7fb1a00c7110 msgr2=0x7fb1a01472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 shutdown_connections 2023-10-16T19:40:28.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.617+0000 7fb1a6ed8700 1 -- 172.21.15.29:0/219350380 wait complete. 2023-10-16T19:40:28.622 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:28.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:28.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 Processor -- start 2023-10-16T19:40:28.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 -- start start 2023-10-16T19:40:28.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45d40c3350 0x7f45d41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4155af0 con 0x7f45d406db00 2023-10-16T19:40:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d4152300 con 0x7f45d414ec50 2023-10-16T19:40:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d9405700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d40c2e40 con 0x7f45d40c3350 2023-10-16T19:40:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.755+0000 7f45d27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45d40c3350 0x7f45d41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f45d406db00 0x7f45d406df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37732/0 (socket says 172.21.15.29:37732) 2023-10-16T19:40:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45d40c3350 0x7f45d41555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52286/0 (socket says 172.21.15.29:52286) 2023-10-16T19:40:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d37fe700 1 -- 172.21.15.29:0/256992488 learned_addr learned my addr 172.21.15.29:0/256992488 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d27fc700 1 -- 172.21.15.29:0/256992488 >> v1:172.21.15.53:6789/0 conn(0x7f45d414ec50 legacy=0x7f45d4071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d27fc700 1 -- 172.21.15.29:0/256992488 >> v1:172.21.15.29:6789/0 conn(0x7f45d406db00 legacy=0x7f45d406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d27fc700 1 -- 172.21.15.29:0/256992488 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d414f030 con 0x7f45d40c3350 2023-10-16T19:40:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d27fc700 1 --2- 172.21.15.29:0/256992488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d40c3350 0x7f45d41555b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009840 tx=0x7f45bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4099de97698e7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d1ffb700 1 -- 172.21.15.29:0/256992488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc011830 con 0x7f45d40c3350 2023-10-16T19:40:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d1ffb700 1 -- 172.21.15.29:0/256992488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc011990 con 0x7f45d40c3350 2023-10-16T19:40:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.756+0000 7f45d1ffb700 1 -- 172.21.15.29:0/256992488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc011d20 con 0x7f45d40c3350 2023-10-16T19:40:28.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 -- 172.21.15.29:0/256992488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d40c3350 msgr2=0x7f45d41555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 --2- 172.21.15.29:0/256992488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d40c3350 0x7f45d41555b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009840 tx=0x7f45bc009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 -- 172.21.15.29:0/256992488 shutdown_connections 2023-10-16T19:40:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 --2- 172.21.15.29:0/256992488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d40c3350 0x7f45d41555b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 -- 172.21.15.29:0/256992488 >> 172.21.15.29:0/256992488 conn(0x7f45d40c7110 msgr2=0x7f45d40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 -- 172.21.15.29:0/256992488 shutdown_connections 2023-10-16T19:40:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.757+0000 7f45d9405700 1 -- 172.21.15.29:0/256992488 wait complete. 2023-10-16T19:40:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.758+0000 7f45d9405700 1 Processor -- start 2023-10-16T19:40:28.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.758+0000 7f45d9405700 1 -- start start 2023-10-16T19:40:28.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f45d406db00 0x7f45d41ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45d40c3350 0x7f45d41ea870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d4150890 con 0x7f45d414ec50 2023-10-16T19:40:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d41edad0 con 0x7f45d40c3350 2023-10-16T19:40:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d41ee460 con 0x7f45d406db00 2023-10-16T19:40:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52294/0 (socket says 172.21.15.29:52294) 2023-10-16T19:40:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 -- 172.21.15.29:0/398857649 learned_addr learned my addr 172.21.15.29:0/398857649 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d27fc700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45d40c3350 0x7f45d41ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d2ffd700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f45d406db00 0x7f45d41ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 -- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f45d406db00 msgr2=0x7f45d41ed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f45d406db00 0x7f45d41ed590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 -- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45d40c3350 msgr2=0x7f45d41ea870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45d40c3350 0x7f45d41ea870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 -- 172.21.15.29:0/398857649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0094a0 con 0x7f45d414ec50 2023-10-16T19:40:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d37fe700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00cb10 tx=0x7f45cc00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00a9e0 con 0x7f45d414ec50 2023-10-16T19:40:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc00ab40 con 0x7f45d414ec50 2023-10-16T19:40:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d41ea0b0 con 0x7f45d414ec50 2023-10-16T19:40:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.759+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc012400 con 0x7f45d414ec50 2023-10-16T19:40:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.760+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d41ea350 con 0x7f45d414ec50 2023-10-16T19:40:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.761+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d404f400 con 0x7f45d414ec50 2023-10-16T19:40:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.761+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45cc007d50 con 0x7f45d414ec50 2023-10-16T19:40:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.761+0000 7f45cb7fe700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 0x7f45b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:28.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.761+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45cc088f50 con 0x7f45d414ec50 2023-10-16T19:40:28.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.761+0000 7f45d2ffd700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 0x7f45b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:28.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.762+0000 7f45d2ffd700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 0x7f45b406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007fd0 tx=0x7f45c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:28.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.766+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45cc053da0 con 0x7f45d414ec50 2023-10-16T19:40:28.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.967+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45d40a88d0 con 0x7f45d414ec50 2023-10-16T19:40:28.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.968+0000 7f45cb7fe700 1 -- 172.21.15.29:0/398857649 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f45cc017090 con 0x7f45d414ec50 2023-10-16T19:40:28.971 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:28.971 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:28.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 msgr2=0x7f45b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 0x7f45b406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007fd0 tx=0x7f45c4009040 comp rx=0 tx=0).stop 2023-10-16T19:40:28.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 msgr2=0x7f45d414cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00cb10 tx=0x7f45cc00ce20 comp rx=0 tx=0).stop 2023-10-16T19:40:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 shutdown_connections 2023-10-16T19:40:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f45b406af00 0x7f45b406d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45d414ec50 0x7f45d414cb60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f45d406db00 0x7f45d41ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 --2- 172.21.15.29:0/398857649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45d40c3350 0x7f45d41ea870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 >> 172.21.15.29:0/398857649 conn(0x7f45d40c7110 msgr2=0x7f45d40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 shutdown_connections 2023-10-16T19:40:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:28.970+0000 7f45d9405700 1 -- 172.21.15.29:0/398857649 wait complete. 2023-10-16T19:40:28.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.110+0000 7f25b2cb7700 1 Processor -- start 2023-10-16T19:40:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.110+0000 7f25b2cb7700 1 -- start start 2023-10-16T19:40:29.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b2cb7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 0x7f25ac06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b2cb7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac0c6b50 con 0x7f25ac152190 2023-10-16T19:40:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b2cb7700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac158ae0 con 0x7f25ac0c7b00 2023-10-16T19:40:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b2cb7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c6e10 con 0x7f25ac0a77e0 2023-10-16T19:40:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b0a53700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f25ac152190 0x7f25ac0bcf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37742/0 (socket says 172.21.15.29:37742) 2023-10-16T19:40:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25b0a53700 1 -- 172.21.15.29:0/3766402285 learned_addr learned my addr 172.21.15.29:0/3766402285 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.111+0000 7f25abfff700 1 --2- 172.21.15.29:0/3766402285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 0x7f25ac06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057677532 0 0) 0x7f25ac0c6b50 con 0x7f25ac152190 2023-10-16T19:40:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f259c0035b0 con 0x7f25ac152190 2023-10-16T19:40:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604945650 0 0) 0x7f25ac158ae0 con 0x7f25ac0c7b00 2023-10-16T19:40:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25ac0c6b50 con 0x7f25ac0c7b00 2023-10-16T19:40:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674130565 0 0) 0x7f259c0035b0 con 0x7f25ac152190 2023-10-16T19:40:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25abfff700 1 -- 172.21.15.29:0/3766402285 >> v1:172.21.15.53:6789/0 conn(0x7f25ac0c7b00 legacy=0x7f25ac157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25abfff700 1 -- 172.21.15.29:0/3766402285 >> v1:172.21.15.29:6789/0 conn(0x7f25ac152190 legacy=0x7f25ac0bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25abfff700 1 -- 172.21.15.29:0/3766402285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0bd650 con 0x7f25ac0a77e0 2023-10-16T19:40:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25abfff700 1 --2- 172.21.15.29:0/3766402285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 0x7f25ac06bd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2598009870 tx=0x7f2598009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95d4cdbe34ce59cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0001670 con 0x7f25ac0a77e0 2023-10-16T19:40:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598004030 con 0x7f25ac0a77e0 2023-10-16T19:40:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.112+0000 7f25ab7fe700 1 -- 172.21.15.29:0/3766402285 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980043c0 con 0x7f25ac0a77e0 2023-10-16T19:40:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 -- 172.21.15.29:0/3766402285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 msgr2=0x7f25ac06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/3766402285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 0x7f25ac06bd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2598009870 tx=0x7f2598009b80 comp rx=0 tx=0).stop 2023-10-16T19:40:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 -- 172.21.15.29:0/3766402285 shutdown_connections 2023-10-16T19:40:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/3766402285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0a77e0 0x7f25ac06bd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 -- 172.21.15.29:0/3766402285 >> 172.21.15.29:0/3766402285 conn(0x7f25ac0a9cd0 msgr2=0x7f25ac0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 -- 172.21.15.29:0/3766402285 shutdown_connections 2023-10-16T19:40:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.113+0000 7f25b2cb7700 1 -- 172.21.15.29:0/3766402285 wait complete. 2023-10-16T19:40:29.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.114+0000 7f25b2cb7700 1 Processor -- start 2023-10-16T19:40:29.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.114+0000 7f25b2cb7700 1 -- start start 2023-10-16T19:40:29.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0c7b00 0x7f25ac14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 0x7f25ac14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac14ef40 con 0x7f25ac0a77e0 2023-10-16T19:40:29.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1eaf60 con 0x7f25ac152190 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b2cb7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1ed7a0 con 0x7f25ac0c7b00 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52304/0 (socket says 172.21.15.29:52304) 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 -- 172.21.15.29:0/109764499 learned_addr learned my addr 172.21.15.29:0/109764499 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b1254700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 0x7f25ac14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25abfff700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0c7b00 0x7f25ac14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 -- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0c7b00 msgr2=0x7f25ac14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0c7b00 0x7f25ac14dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 -- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 msgr2=0x7f25ac14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 0x7f25ac14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 -- 172.21.15.29:0/109764499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980094a0 con 0x7f25ac0a77e0 2023-10-16T19:40:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b1254700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 0x7f25ac14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.115+0000 7f25b0a53700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c6d0 tx=0x7f25a000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.116+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004c80 con 0x7f25ac0a77e0 2023-10-16T19:40:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.116+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0004de0 con 0x7f25ac0a77e0 2023-10-16T19:40:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.116+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0007310 con 0x7f25ac0a77e0 2023-10-16T19:40:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.116+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac1eda80 con 0x7f25ac0a77e0 2023-10-16T19:40:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.116+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac157e00 con 0x7f25ac0a77e0 2023-10-16T19:40:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.117+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac04f400 con 0x7f25ac0a77e0 2023-10-16T19:40:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.117+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25a0007470 con 0x7f25ac0a77e0 2023-10-16T19:40:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.118+0000 7f25a97fa700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 0x7f259006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.118+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25a0089770 con 0x7f25ac0a77e0 2023-10-16T19:40:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.118+0000 7f25abfff700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 0x7f259006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.118+0000 7f25abfff700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 0x7f259006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0a7be0 tx=0x7f2598008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.122+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25a0054490 con 0x7f25ac0a77e0 2023-10-16T19:40:29.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.367+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25ac0c78e0 con 0x7f25ac0a77e0 2023-10-16T19:40:29.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.368+0000 7f25a97fa700 1 -- 172.21.15.29:0/109764499 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7f25a0057ab0 con 0x7f25ac0a77e0 2023-10-16T19:40:29.371 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:29.372 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 msgr2=0x7f259006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 0x7f259006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0a7be0 tx=0x7f2598008030 comp rx=0 tx=0).stop 2023-10-16T19:40:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 msgr2=0x7f25ac1ecf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c6d0 tx=0x7f25a000ca90 comp rx=0 tx=0).stop 2023-10-16T19:40:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 shutdown_connections 2023-10-16T19:40:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f259006af00 0x7f259006d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ac152190 0x7f25ac14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25ac0a77e0 0x7f25ac1ecf10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 --2- 172.21.15.29:0/109764499 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f25ac0c7b00 0x7f25ac14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 >> 172.21.15.29:0/109764499 conn(0x7f25ac0a9cd0 msgr2=0x7f25ac0a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 shutdown_connections 2023-10-16T19:40:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.370+0000 7f25b2cb7700 1 -- 172.21.15.29:0/109764499 wait complete. 2023-10-16T19:40:29.376 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:29.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:39:52.363895+0000', 'modified': '2023-10-16T19:40:16.827052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/1712057273', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 1712057273}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1712057273}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T19:40:29.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T19:40:29.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-16T19:40:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.918+0000 7f2a37ebd700 1 Processor -- start 2023-10-16T19:40:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.918+0000 7f2a37ebd700 1 -- start start 2023-10-16T19:40:29.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a37ebd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a301583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a37ebd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a3013dd00 0x7f2a30158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a37ebd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a30158e40 con 0x7f2a3013d660 2023-10-16T19:40:29.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a37ebd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3006d320 con 0x7f2a3013dd00 2023-10-16T19:40:29.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a37ebd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3006e780 con 0x7f2a30154a50 2023-10-16T19:40:29.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a3013dd00 0x7f2a30158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a35c59700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2a3013d660 0x7f2a3006a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37756/0 (socket says 172.21.15.29:37756) 2023-10-16T19:40:29.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a35c59700 1 -- 172.21.15.29:0/2640521389 learned_addr learned my addr 172.21.15.29:0/2640521389 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:29.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a35458700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a301583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 -- 172.21.15.29:0/2640521389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 msgr2=0x7f2a301583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a301583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 -- 172.21.15.29:0/2640521389 >> v1:172.21.15.29:6789/0 conn(0x7f2a3013d660 legacy=0x7f2a3006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 -- 172.21.15.29:0/2640521389 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30154f10 con 0x7f2a3013dd00 2023-10-16T19:40:29.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a35458700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a301583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:29.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a30158900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009d90 tx=0x7f2a2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d073e8e794d0f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a34c57700 1 -- 172.21.15.29:0/2640521389 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800e070 con 0x7f2a3013dd00 2023-10-16T19:40:29.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a34c57700 1 -- 172.21.15.29:0/2640521389 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2800bbd0 con 0x7f2a3013dd00 2023-10-16T19:40:29.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.919+0000 7f2a34c57700 1 -- 172.21.15.29:0/2640521389 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28012430 con 0x7f2a3013dd00 2023-10-16T19:40:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 -- 172.21.15.29:0/2640521389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 msgr2=0x7f2a30158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a30158900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009d90 tx=0x7f2a2800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 -- 172.21.15.29:0/2640521389 shutdown_connections 2023-10-16T19:40:29.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a30158900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/2640521389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a301583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 -- 172.21.15.29:0/2640521389 >> 172.21.15.29:0/2640521389 conn(0x7f2a300c7110 msgr2=0x7f2a300c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 -- 172.21.15.29:0/2640521389 shutdown_connections 2023-10-16T19:40:29.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.920+0000 7f2a37ebd700 1 -- 172.21.15.29:0/2640521389 wait complete. 2023-10-16T19:40:29.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.921+0000 7f2a37ebd700 1 Processor -- start 2023-10-16T19:40:29.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.921+0000 7f2a37ebd700 1 -- start start 2023-10-16T19:40:29.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 0x7f2a3013cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a30156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a301382b0 con 0x7f2a3013dd00 2023-10-16T19:40:29.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30158060 con 0x7f2a3013d660 2023-10-16T19:40:29.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a37ebd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30157b10 con 0x7f2a30154a50 2023-10-16T19:40:29.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52320/0 (socket says 172.21.15.29:52320) 2023-10-16T19:40:29.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 -- 172.21.15.29:0/3455267725 learned_addr learned my addr 172.21.15.29:0/3455267725 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35c59700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 0x7f2a3013cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a3645a700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a30156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 -- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 msgr2=0x7f2a30156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a30156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 -- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 msgr2=0x7f2a3013cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 0x7f2a3013cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 -- 172.21.15.29:0/3455267725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009a70 con 0x7f2a3013dd00 2023-10-16T19:40:29.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35c59700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 0x7f2a3013cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:29.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a3645a700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a30156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:29.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.922+0000 7f2a35458700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e840 tx=0x7f2a2000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.923+0000 7f2a267fc700 1 -- 172.21.15.29:0/3455267725 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20004230 con 0x7f2a3013dd00 2023-10-16T19:40:29.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.923+0000 7f2a267fc700 1 -- 172.21.15.29:0/3455267725 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20004390 con 0x7f2a3013dd00 2023-10-16T19:40:29.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.923+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300c4ba0 con 0x7f2a3013dd00 2023-10-16T19:40:29.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.923+0000 7f2a267fc700 1 -- 172.21.15.29:0/3455267725 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a200036a0 con 0x7f2a3013dd00 2023-10-16T19:40:29.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.923+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a300c4e40 con 0x7f2a3013dd00 2023-10-16T19:40:29.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.924+0000 7f2a267fc700 1 -- 172.21.15.29:0/3455267725 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2a20003800 con 0x7f2a3013dd00 2023-10-16T19:40:29.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.925+0000 7f2a267fc700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 0x7f2a1406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.925+0000 7f2a267fc700 1 -- 172.21.15.29:0/3455267725 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a200893a0 con 0x7f2a3013dd00 2023-10-16T19:40:29.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.925+0000 7f2a35c59700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 0x7f2a1406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.925+0000 7f2a35c59700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 0x7f2a1406d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c007fd0 tx=0x7f2a2c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.927+0000 7f2a440a7b80 1 Processor -- start 2023-10-16T19:40:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.927+0000 7f2a440a7b80 1 -- start start 2023-10-16T19:40:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f3915aa90 0x560f39198b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f39154c90 0x560f391788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f390cec20 con 0x560f3915a6b0 2023-10-16T19:40:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f390b3c10 con 0x560f39154c90 2023-10-16T19:40:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f390b1530 con 0x560f3915aa90 2023-10-16T19:40:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52326/0 (socket says 172.21.15.29:52326) 2023-10-16T19:40:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 -- 172.21.15.29:0/1652478180 learned_addr learned my addr 172.21.15.29:0/1652478180 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35458700 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f3915aa90 0x560f39198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a3645a700 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f39154c90 0x560f391788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 -- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f3915aa90 msgr2=0x560f39198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f3915aa90 0x560f39198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 -- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f39154c90 msgr2=0x560f391788a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f39154c90 0x560f391788a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 -- 172.21.15.29:0/1652478180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f3906a3a0 con 0x560f3915a6b0 2023-10-16T19:40:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a35c59700 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c005990 tx=0x7f2a2c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59506b69f860b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.928+0000 7f2a137fe700 1 -- 172.21.15.29:0/1652478180 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c007560 con 0x560f3915a6b0 2023-10-16T19:40:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a137fe700 1 -- 172.21.15.29:0/1652478180 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0076c0 con 0x560f3915a6b0 2023-10-16T19:40:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a137fe700 1 -- 172.21.15.29:0/1652478180 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00e820 con 0x560f3915a6b0 2023-10-16T19:40:29.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 -- 172.21.15.29:0/1652478180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 msgr2=0x560f39198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c005990 tx=0x7f2a2c011000 comp rx=0 tx=0).stop 2023-10-16T19:40:29.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 -- 172.21.15.29:0/1652478180 shutdown_connections 2023-10-16T19:40:29.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f39154c90 0x560f391788a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f39198620 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/1652478180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f3915aa90 0x560f39198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 -- 172.21.15.29:0/1652478180 >> 172.21.15.29:0/1652478180 conn(0x560f39087d80 msgr2=0x560f391583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 -- 172.21.15.29:0/1652478180 shutdown_connections 2023-10-16T19:40:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.929+0000 7f2a440a7b80 1 -- 172.21.15.29:0/1652478180 wait complete. 2023-10-16T19:40:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.930+0000 7f2a440a7b80 1 -- start start 2023-10-16T19:40:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.930+0000 7f2a440a7b80 1 Processor -- start 2023-10-16T19:40:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39196f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f390ace20 con 0x560f3915a6b0 2023-10-16T19:40:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f390496c0 con 0x560f3915aa90 2023-10-16T19:40:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f39049360 con 0x560f39154c90 2023-10-16T19:40:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a440a7b80 10 client.0 _ll_register_callbacks cb 0x560f38ea67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:40:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.931+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52334/0 (socket says 172.21.15.29:52334) 2023-10-16T19:40:29.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 -- 172.21.15.29:0/2390404095 learned_addr learned my addr 172.21.15.29:0/2390404095 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 -- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 msgr2=0x560f39196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 -- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 msgr2=0x560f391a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 -- 172.21.15.29:0/2390404095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c00f040 con 0x560f3915a6b0 2023-10-16T19:40:29.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a35458700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2a20057b10 tx=0x7f2a2005e190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b1869f2b37ad84 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:40:29.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20057500 con 0x560f3915a6b0 2023-10-16T19:40:29.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a2005bf60 con 0x560f3915a6b0 2023-10-16T19:40:29.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f3914d5b0 con 0x560f3915a6b0 2023-10-16T19:40:29.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a20060110 con 0x560f3915a6b0 2023-10-16T19:40:29.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a440a7b80 10 client.4830 fetch_fsmap learned FSMap version 9 2023-10-16T19:40:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x560f38ed7d90 con 0x560f3915a6b0 2023-10-16T19:40:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.932+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f3914d5b0 con 0x560f3915a6b0 2023-10-16T19:40:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2a2005fc80 con 0x560f3915a6b0 2023-10-16T19:40:29.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T19:40:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 10 client.4830 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:40:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 20 client.4830 populate_metadata read hostname 'smithi029' 2023-10-16T19:40:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f39176f40 0x560f39179580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 4 client.4830 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:40:29.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 --> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f390a5e00 con 0x560f39176f40 2023-10-16T19:40:29.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f39176f40 0x560f39179580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a10ff9700 10 client.4830 ms_handle_connect on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:29.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.933+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f39176f40 0x560f39179580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c88a2c74ad71db server_cookie=52a7761c15d9d379 in_seq=0 out_seq=0 2023-10-16T19:40:29.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2390404095 <== mds.0 v2:172.21.15.29:6833/1712057273 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560f390a5e00 con 0x560f39176f40 2023-10-16T19:40:29.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a10ff9700 10 client.4830 handle_command_reply: tid=0 2023-10-16T19:40:29.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 client.4830 shutdown 2023-10-16T19:40:29.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 msgr2=0x560f391a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2a20057b10 tx=0x7f2a2005e190 comp rx=0 tx=0).stop 2023-10-16T19:40:29.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 shutdown_connections 2023-10-16T19:40:29.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f39176f40 0x560f39179580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2390404095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391a6a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a10ff9700 0 client.4830 ms_handle_reset on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:29.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 >> 172.21.15.29:0/2390404095 conn(0x560f39087d80 msgr2=0x560f3914f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 shutdown_connections 2023-10-16T19:40:29.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2390404095 wait complete. 2023-10-16T19:40:29.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.934+0000 7f2a440a7b80 20 client.4830 trim_cache size 0 max 16384 2023-10-16T19:40:29.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 Processor -- start 2023-10-16T19:40:29.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 -- start start 2023-10-16T19:40:29.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f391767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915a6b0 0x560f39197620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f38f2d8d0 con 0x560f3915aa90 2023-10-16T19:40:29.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f391374c0 con 0x560f3915a6b0 2023-10-16T19:40:29.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.952+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f39196940 con 0x560f39154c90 2023-10-16T19:40:29.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52344/0 (socket says 172.21.15.29:52344) 2023-10-16T19:40:29.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 -- 172.21.15.29:0/2243523378 learned_addr learned my addr 172.21.15.29:0/2243523378 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f391767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a35458700 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915a6b0 0x560f39197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 -- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 msgr2=0x560f391767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f391767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 -- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915a6b0 msgr2=0x560f39197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915a6b0 0x560f39197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 -- 172.21.15.29:0/2243523378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f38ec0c10 con 0x560f3915aa90 2023-10-16T19:40:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a28013000 tx=0x7f2a28011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9241d275f5bb99ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a13fff700 1 -- 172.21.15.29:0/2243523378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2802b070 con 0x560f3915aa90 2023-10-16T19:40:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a13fff700 1 -- 172.21.15.29:0/2243523378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a28021040 con 0x560f3915aa90 2023-10-16T19:40:29.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.953+0000 7f2a13fff700 1 -- 172.21.15.29:0/2243523378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28020050 con 0x560f3915aa90 2023-10-16T19:40:29.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2243523378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 msgr2=0x560f3915b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a28013000 tx=0x7f2a28011000 comp rx=0 tx=0).stop 2023-10-16T19:40:29.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2243523378 shutdown_connections 2023-10-16T19:40:29.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915aa90 0x560f3915b100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f391767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2243523378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915a6b0 0x560f39197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2243523378 >> 172.21.15.29:0/2243523378 conn(0x560f39087d80 msgr2=0x560f391a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2243523378 shutdown_connections 2023-10-16T19:40:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2243523378 wait complete. 2023-10-16T19:40:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 -- start start 2023-10-16T19:40:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.954+0000 7f2a440a7b80 1 Processor -- start 2023-10-16T19:40:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39197a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391e6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f3915b520 con 0x560f3915a6b0 2023-10-16T19:40:29.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f3915b770 con 0x560f3915aa90 2023-10-16T19:40:29.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f39192800 con 0x560f39154c90 2023-10-16T19:40:29.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 10 client.0 _ll_register_callbacks cb 0x7f2a200094c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52348/0 (socket says 172.21.15.29:52348) 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 -- 172.21.15.29:0/2903714415 learned_addr learned my addr 172.21.15.29:0/2903714415 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a3645a700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 -- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 msgr2=0x560f39197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 -- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 msgr2=0x560f391e6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:29.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391e6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 -- 172.21.15.29:0/2903714415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a30154f10 con 0x560f3915a6b0 2023-10-16T19:40:29.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:29.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a35458700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a200586c0 tx=0x7f2a200874a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce2da952f707ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:29.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:40:29.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20060110 con 0x560f3915a6b0 2023-10-16T19:40:29.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a2c0076c0 con 0x560f3915a6b0 2023-10-16T19:40:29.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.956+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a2005bf60 con 0x560f3915a6b0 2023-10-16T19:40:29.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a20057950 con 0x560f3915a6b0 2023-10-16T19:40:29.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 10 client.4836 fetch_fsmap learned FSMap version 9 2023-10-16T19:40:29.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x560f38efe200 con 0x560f3915a6b0 2023-10-16T19:40:29.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0076c0 con 0x560f3915a6b0 2023-10-16T19:40:29.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2a20053c00 con 0x560f3915a6b0 2023-10-16T19:40:29.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T19:40:29.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 10 client.4836 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-16T19:40:29.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 20 client.4836 populate_metadata read hostname 'smithi029' 2023-10-16T19:40:29.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f391e6aa0 0x560f39201a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:29.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 4 client.4836 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:40:29.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 --> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560f390a5b20 con 0x560f391e6aa0 2023-10-16T19:40:29.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f391e6aa0 0x560f39201a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:29.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a10ff9700 10 client.4836 ms_handle_connect on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:29.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.957+0000 7f2a35c59700 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f391e6aa0 0x560f39201a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acbf36dec85c7633 server_cookie=c1357b06b76d3a0d in_seq=0 out_seq=0 2023-10-16T19:40:29.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a10ff9700 1 -- 172.21.15.29:0/2903714415 <== mds.0 v2:172.21.15.29:6833/1712057273 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x560f390a5b20 con 0x560f391e6aa0 2023-10-16T19:40:29.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a10ff9700 10 client.4836 handle_command_reply: tid=0 2023-10-16T19:40:29.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 client.4836 shutdown 2023-10-16T19:40:29.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 msgr2=0x560f391fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:29.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a200586c0 tx=0x7f2a200874a0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 shutdown_connections 2023-10-16T19:40:29.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560f3915aa90 0x560f391e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x560f39154c90 0x560f39197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:6833/1712057273,v1:172.21.15.29:6835/1712057273] conn(0x560f391e6aa0 0x560f39201a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 --2- 172.21.15.29:0/2903714415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560f3915a6b0 0x560f391fe860 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:29.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a10ff9700 0 client.4836 ms_handle_reset on v2:172.21.15.29:6833/1712057273 2023-10-16T19:40:29.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 >> 172.21.15.29:0/2903714415 conn(0x560f39087d80 msgr2=0x560f39155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:29.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 shutdown_connections 2023-10-16T19:40:29.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 1 -- 172.21.15.29:0/2903714415 wait complete. 2023-10-16T19:40:29.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a440a7b80 20 client.4836 trim_cache size 0 max 16384 2023-10-16T19:40:29.991 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:40:29.991 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "b5b71d99-0d95-4cc7-b379-31b38eac533d", 2023-10-16T19:40:29.991 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-16T19:40:29.992 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4251, 2023-10-16T19:40:29.992 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-16T19:40:29.992 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-16T19:40:29.992 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-16T19:40:29.993 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 36.996913065000001, 2023-10-16T19:40:29.993 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 9, 2023-10-16T19:40:29.993 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 25, 2023-10-16T19:40:29.994 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 25, 2023-10-16T19:40:29.994 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 44.231137459999999 2023-10-16T19:40:29.994 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:40:30.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 msgr2=0x7f2a1406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 0x7f2a1406d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c007fd0 tx=0x7f2a2c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:30.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 msgr2=0x7f2a300c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e840 tx=0x7f2a2000ec00 comp rx=0 tx=0).stop 2023-10-16T19:40:30.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 shutdown_connections 2023-10-16T19:40:30.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2a1406af30 0x7f2a1406d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2a30154a50 0x7f2a30156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3013d660 0x7f2a3013cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 --2- 172.21.15.29:0/3455267725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3013dd00 0x7f2a300c5490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.958+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 >> 172.21.15.29:0/3455267725 conn(0x7f2a300c7110 msgr2=0x7f2a300c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:30.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.959+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 shutdown_connections 2023-10-16T19:40:30.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:29.959+0000 7f2a37ebd700 1 -- 172.21.15.29:0/3455267725 wait complete. 2023-10-16T19:40:30.005 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T19:40:30.019 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T19:40:30.020 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-10-16T19:40:30.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.021 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-16T19:40:30.039 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-16T19:40:30.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T19:40:30.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-16T19:40:30.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.243 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-10-16T19:40:30.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-10-16T19:40:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-10-16T19:40:30.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:40:30.342 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-16T19:40:30.343 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:40:30.343 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:40:30.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:40:30.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 Processor -- start 2023-10-16T19:40:30.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 -- start start 2023-10-16T19:40:30.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1cc0c6850 0x7fe1cc0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 0x7fe1cc0a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc155360 con 0x7fe1cc154df0 2023-10-16T19:40:30.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc070880 con 0x7fe1cc0c6850 2023-10-16T19:40:30.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.469+0000 7fe1d1792700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1519f0 con 0x7fe1cc152520 2023-10-16T19:40:30.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1cc0c6850 0x7fe1cc0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1ca7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe1cc154df0 0x7fe1cc151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37800/0 (socket says 172.21.15.29:37800) 2023-10-16T19:40:30.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1ca7fc700 1 -- 172.21.15.29:0/1406706714 learned_addr learned my addr 172.21.15.29:0/1406706714 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:30.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1cb7fe700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 0x7fe1cc0a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 -- 172.21.15.29:0/1406706714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 msgr2=0x7fe1cc0a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:30.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1c9ffb700 1 -- 172.21.15.29:0/1406706714 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384604287 0 0) 0x7fe1cc155360 con 0x7fe1cc154df0 2023-10-16T19:40:30.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 0x7fe1cc0a53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 -- 172.21.15.29:0/1406706714 >> v1:172.21.15.29:6789/0 conn(0x7fe1cc154df0 legacy=0x7fe1cc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 -- 172.21.15.29:0/1406706714 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc155640 con 0x7fe1cc0c6850 2023-10-16T19:40:30.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1cb7fe700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 0x7fe1cc0a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:30.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1caffd700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc0c6850 0x7fe1cc0a4ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009850 tx=0x7fe1bc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e236b266611d7da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:30.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1c9ffb700 1 -- 172.21.15.29:0/1406706714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc005e30 con 0x7fe1cc0c6850 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1c9ffb700 1 -- 172.21.15.29:0/1406706714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc006030 con 0x7fe1cc0c6850 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.470+0000 7fe1c9ffb700 1 -- 172.21.15.29:0/1406706714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0063c0 con 0x7fe1cc0c6850 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 -- 172.21.15.29:0/1406706714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc0c6850 msgr2=0x7fe1cc0a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc0c6850 0x7fe1cc0a4ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009850 tx=0x7fe1bc009b60 comp rx=0 tx=0).stop 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 -- 172.21.15.29:0/1406706714 shutdown_connections 2023-10-16T19:40:30.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc152520 0x7fe1cc0a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1406706714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc0c6850 0x7fe1cc0a4ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 -- 172.21.15.29:0/1406706714 >> 172.21.15.29:0/1406706714 conn(0x7fe1cc0a8070 msgr2=0x7fe1cc0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:30.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 -- 172.21.15.29:0/1406706714 shutdown_connections 2023-10-16T19:40:30.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.471+0000 7fe1d1792700 1 -- 172.21.15.29:0/1406706714 wait complete. 2023-10-16T19:40:30.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.472+0000 7fe1d1792700 1 Processor -- start 2023-10-16T19:40:30.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.472+0000 7fe1d1792700 1 -- start start 2023-10-16T19:40:30.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc0c6850 0x7fe1cc06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc152520 0x7fe1cc14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0a76a0 con 0x7fe1cc154df0 2023-10-16T19:40:30.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0a72e0 con 0x7fe1cc152520 2023-10-16T19:40:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1d1792700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1e9bb0 con 0x7fe1cc0c6850 2023-10-16T19:40:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52364/0 (socket says 172.21.15.29:52364) 2023-10-16T19:40:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 -- 172.21.15.29:0/1286494099 learned_addr learned my addr 172.21.15.29:0/1286494099 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:30.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1caffd700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc0c6850 0x7fe1cc06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1ca7fc700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc152520 0x7fe1cc14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 -- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc0c6850 msgr2=0x7fe1cc06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc0c6850 0x7fe1cc06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 -- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc152520 msgr2=0x7fe1cc14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc152520 0x7fe1cc14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.473+0000 7fe1cb7fe700 1 -- 172.21.15.29:0/1286494099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc009430 con 0x7fe1cc154df0 2023-10-16T19:40:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1cb7fe700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400cef0 tx=0x7fe1c400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400ad00 con 0x7fe1cc154df0 2023-10-16T19:40:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400ae60 con 0x7fe1cc154df0 2023-10-16T19:40:30.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc1e9e90 con 0x7fe1cc154df0 2023-10-16T19:40:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4015680 con 0x7fe1cc154df0 2023-10-16T19:40:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.474+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc06cbf0 con 0x7fe1cc154df0 2023-10-16T19:40:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.475+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc1ea0d0 con 0x7fe1cc154df0 2023-10-16T19:40:30.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.475+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1c400d430 con 0x7fe1cc154df0 2023-10-16T19:40:30.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.476+0000 7fe1b37fe700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 0x7fe1b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:30.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.476+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1c4089d00 con 0x7fe1cc154df0 2023-10-16T19:40:30.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.476+0000 7fe1caffd700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 0x7fe1b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:30.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.476+0000 7fe1caffd700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 0x7fe1b806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000c00 tx=0x7fe1bc008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:30.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.480+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1c4054b50 con 0x7fe1cc154df0 2023-10-16T19:40:30.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.726+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1cc0c5560 con 0x7fe1cc154df0 2023-10-16T19:40:30.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.727+0000 7fe1b37fe700 1 -- 172.21.15.29:0/1286494099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe1c4058170 con 0x7fe1cc154df0 2023-10-16T19:40:30.729 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T19:40:30.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 msgr2=0x7fe1b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 0x7fe1b806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc000c00 tx=0x7fe1bc008070 comp rx=0 tx=0).stop 2023-10-16T19:40:30.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 msgr2=0x7fe1cc14d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:30.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400cef0 tx=0x7fe1c400cf20 comp rx=0 tx=0).stop 2023-10-16T19:40:30.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 shutdown_connections 2023-10-16T19:40:30.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe1b806af00 0x7fe1b806d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1cc154df0 0x7fe1cc14d630 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe1cc0c6850 0x7fe1cc06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 --2- 172.21.15.29:0/1286494099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc152520 0x7fe1cc14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:30.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 >> 172.21.15.29:0/1286494099 conn(0x7fe1cc0a8070 msgr2=0x7fe1cc072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:30.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 shutdown_connections 2023-10-16T19:40:30.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:30.729+0000 7fe1d1792700 1 -- 172.21.15.29:0/1286494099 wait complete. 2023-10-16T19:40:30.743 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:40:30.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:40:30.743 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-16T19:40:30.744 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T19:40:30.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:40:30.744 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:40:30.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:40:30.745 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:40:30.745 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:40:30.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.746 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-16T19:40:30.763 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:40:30.763 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:40:30.763 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:40:30.764 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:30.764 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-16T19:40:30.764 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:30.764 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:30.764 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T19:40:30.765 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-10-16T19:40:30.766 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-16T19:40:30.766 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:30.766 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:30.766 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:30.767 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:40:30.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.767 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:30.768 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:30.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:40:30.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-10-16T19:40:30.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-10-16T19:40:30.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:40:30.769 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:30.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.883 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:40:30.910 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-16T19:40:30.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.911 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-16T19:40:30.972 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-16T19:40:30.972 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:40:30.973 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T19:40:30.973 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T19:40:30.973 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:40:30.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:30.975 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:30.976 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:30.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T19:40:30.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T19:40:30.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T19:40:30.977 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:31.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.081 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-16T19:40:31.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.099 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-16T19:40:31.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.157 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:31.157 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:31.157 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:40:31.158 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T19:40:31.158 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:31.251 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T19:40:31.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.252 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:31.253 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:31.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T19:40:31.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:40:31.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T19:40:31.254 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T19:40:31.254 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T19:40:31.254 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:31.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.488 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:40:31.488 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:40:31.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-16T19:40:31.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:40:31.489 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:40:31.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:31.608 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T19:40:31.638 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:40:31.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:31.639 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:40:31.696 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T19:40:31.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:31.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:31.783 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:31.783 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:31.963 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:31.964 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:31.964 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:40:31.965 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:40:31.965 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:40:31.965 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:40:31.966 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:40:31.966 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:40:32.040 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:32.040 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:32.041 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:40:32.041 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:40:32.041 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:40:32.041 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:40:32.041 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:40:32.042 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:40:32.042 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790" 2023-10-16T19:40:32.042 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790:/ 2023-10-16T19:40:32.042 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b5b71d99-0d95-4cc7-b379-31b38eac533d" will pass to kernel 2023-10-16T19:40:32.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:40:32.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:40:32.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.071 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:32.145 INFO:teuthology.orchestra.run.smithi029.stdout:client4613 2023-10-16T19:40:32.145 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:32.146 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:32.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.203 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:32.275 INFO:teuthology.orchestra.run.smithi029.stdout:client4613 2023-10-16T19:40:32.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.276 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:32.348 INFO:teuthology.orchestra.run.smithi029.stdout:client4613 2023-10-16T19:40:32.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.349 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b5b71d99-0d95-4cc7-b379-31b38eac533d.client4613/status') 2023-10-16T19:40:32.430 INFO:teuthology.orchestra.run.smithi029.stdout:instance: client.4613 (3)172.21.15.29:0/1897315397 2023-10-16T19:40:32.430 INFO:teuthology.orchestra.run.smithi029.stdout:blocklisted: false 2023-10-16T19:40:32.431 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records in 2023-10-16T19:40:32.431 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records out 2023-10-16T19:40:32.432 INFO:teuthology.orchestra.run.smithi029.stderr:70 bytes copied, 2.6518e-05 s, 2.6 MB/s 2023-10-16T19:40:32.432 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-16T19:40:32.432 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:40:32.433 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T19:40:32.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:40:32.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.594+0000 7f0aedd76700 1 Processor -- start 2023-10-16T19:40:32.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.594+0000 7f0aedd76700 1 -- start start 2023-10-16T19:40:32.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0aedd76700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ae806f6e0 0x7f0ae8156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0aedd76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80c18b0 0x7f0ae814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0aedd76700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae80724a0 con 0x7f0ae814ff30 2023-10-16T19:40:32.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0aedd76700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae8152780 con 0x7f0ae806f6e0 2023-10-16T19:40:32.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0aedd76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81503c0 con 0x7f0ae80c18b0 2023-10-16T19:40:32.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0ae814ff30 0x7f0ae8152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37820/0 (socket says 172.21.15.29:37820) 2023-10-16T19:40:32.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae7fff700 1 -- 172.21.15.29:0/3009354082 learned_addr learned my addr 172.21.15.29:0/3009354082 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:32.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/3009354082 >> v2:172.21.15.53:3300/0 conn(0x7f0ae806f6e0 0x7f0ae8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80c18b0 0x7f0ae814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968356793 0 0) 0x7f0ae80724a0 con 0x7f0ae814ff30 2023-10-16T19:40:32.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad40035b0 con 0x7f0ae814ff30 2023-10-16T19:40:32.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.595+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443097567 0 0) 0x7f0ad40035b0 con 0x7f0ae814ff30 2023-10-16T19:40:32.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80c18b0 msgr2=0x7f0ae814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80c18b0 0x7f0ae814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 >> v2:172.21.15.53:3300/0 conn(0x7f0ae806f6e0 msgr2=0x7f0ae8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 --2- 172.21.15.29:0/3009354082 >> v2:172.21.15.53:3300/0 conn(0x7f0ae806f6e0 0x7f0ae8156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80c2660 con 0x7f0ae814ff30 2023-10-16T19:40:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f0ae0001a40 con 0x7f0ae814ff30 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 >> v1:172.21.15.29:6789/0 conn(0x7f0ae814ff30 legacy=0x7f0ae8152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ad4003a00 0x7f0ad4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ad40043f0 0x7f0ad40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ad4004fe0 0x7f0ad400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8152780 con 0x7f0ad4004fe0 2023-10-16T19:40:32.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad400bf50 con 0x7f0ad40043f0 2023-10-16T19:40:32.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad400c0c0 con 0x7f0ad4003a00 2023-10-16T19:40:32.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80c18b0 0x7f0ae814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:32.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/3009354082 >> v2:172.21.15.53:3300/0 conn(0x7f0ae806f6e0 0x7f0ae8156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:32.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ad4004fe0 0x7f0ad400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 -- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ad4003a00 msgr2=0x7f0ad4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:32.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ad40043f0 0x7f0ad40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ad4003a00 0x7f0ad4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ad4003a00 0x7f0ad4003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 -- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ad40043f0 msgr2=0x7f0ad40048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:32.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ad40043f0 0x7f0ad40048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 -- 172.21.15.29:0/3009354082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40035b0 con 0x7f0ad4004fe0 2023-10-16T19:40:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae7fff700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ad4004fe0 0x7f0ad400ba10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a7f0 tx=0x7f0ad4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9aa7693e60d5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000a2b0 con 0x7f0ad4004fe0 2023-10-16T19:40:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0012620 con 0x7f0ad4004fe0 2023-10-16T19:40:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.596+0000 7f0ae67fc700 1 -- 172.21.15.29:0/3009354082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00129d0 con 0x7f0ad4004fe0 2023-10-16T19:40:32.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 -- 172.21.15.29:0/3009354082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ad4004fe0 msgr2=0x7f0ad400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 --2- 172.21.15.29:0/3009354082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ad4004fe0 0x7f0ad400ba10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a7f0 tx=0x7f0ad4005880 comp rx=0 tx=0).stop 2023-10-16T19:40:32.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0ae7fff700 1 -- 172.21.15.29:0/3009354082 reap_dead start 2023-10-16T19:40:32.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 -- 172.21.15.29:0/3009354082 shutdown_connections 2023-10-16T19:40:32.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 -- 172.21.15.29:0/3009354082 >> 172.21.15.29:0/3009354082 conn(0x7f0ae80c7110 msgr2=0x7f0ae80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:32.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 -- 172.21.15.29:0/3009354082 shutdown_connections 2023-10-16T19:40:32.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.597+0000 7f0aedd76700 1 -- 172.21.15.29:0/3009354082 wait complete. 2023-10-16T19:40:32.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.598+0000 7f0aedd76700 1 Processor -- start 2023-10-16T19:40:32.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.599+0000 7f0aedd76700 1 -- start start 2023-10-16T19:40:32.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80ab900 0x7f0ae80c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ae813dd00 0x7f0ae81e7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81565b0 con 0x7f0ae81544a0 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae813e180 con 0x7f0ae813dd00 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8156a40 con 0x7f0ae80ab900 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52386/0 (socket says 172.21.15.29:52386) 2023-10-16T19:40:32.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 -- 172.21.15.29:0/2725087419 learned_addr learned my addr 172.21.15.29:0/2725087419 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:32.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80ab900 0x7f0ae80c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae7fff700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ae813dd00 0x7f0ae81e7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 -- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80ab900 msgr2=0x7f0ae80c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80ab900 0x7f0ae80c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 -- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ae813dd00 msgr2=0x7f0ae81e7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ae813dd00 0x7f0ae81e7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 -- 172.21.15.29:0/2725087419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80c6af0 con 0x7f0ae81544a0 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0ae6ffd700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8010930 tx=0x7f0ad8010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8014800 con 0x7f0ae81544a0 2023-10-16T19:40:32.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8014960 con 0x7f0ae81544a0 2023-10-16T19:40:32.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8155c80 con 0x7f0ae81544a0 2023-10-16T19:40:32.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8014cf0 con 0x7f0ae81544a0 2023-10-16T19:40:32.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.600+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae8156240 con 0x7f0ae81544a0 2023-10-16T19:40:32.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.601+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8156720 con 0x7f0ae81544a0 2023-10-16T19:40:32.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.602+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ad801c400 con 0x7f0ae81544a0 2023-10-16T19:40:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.602+0000 7f0adffff700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 0x7f0ac806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.602+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ad8089b10 con 0x7f0ae81544a0 2023-10-16T19:40:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.603+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 0x7f0ac806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.603+0000 7f0ae77fe700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 0x7f0ac806d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009d70 tx=0x7f0ad0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.607+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ad8054a10 con 0x7f0ae81544a0 2023-10-16T19:40:32.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.854+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ae804f400 con 0x7f0ae81544a0 2023-10-16T19:40:32.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.854+0000 7f0adffff700 1 -- 172.21.15.29:0/2725087419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0ad8089070 con 0x7f0ae81544a0 2023-10-16T19:40:32.857 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T19:40:32.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.856+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 msgr2=0x7f0ac806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.856+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 0x7f0ac806d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009d70 tx=0x7f0ad0008040 comp rx=0 tx=0).stop 2023-10-16T19:40:32.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.856+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 msgr2=0x7f0ae813d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:32.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.856+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8010930 tx=0x7f0ad8010c40 comp rx=0 tx=0).stop 2023-10-16T19:40:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.856+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 shutdown_connections 2023-10-16T19:40:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0ac806af30 0x7f0ac806d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ae813dd00 0x7f0ae81e7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ae80ab900 0x7f0ae80c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 --2- 172.21.15.29:0/2725087419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ae81544a0 0x7f0ae813d7c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 >> 172.21.15.29:0/2725087419 conn(0x7f0ae80c7110 msgr2=0x7f0ae8149470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 shutdown_connections 2023-10-16T19:40:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:32.857+0000 7f0aedd76700 1 -- 172.21.15.29:0/2725087419 wait complete. 2023-10-16T19:40:32.871 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:40:32.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:40:32.871 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-10-16T19:40:32.872 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T19:40:32.872 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T19:40:32.872 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:40:32.872 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:40:32.873 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:40:32.873 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T19:40:32.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.873 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-10-16T19:40:32.896 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:40:32.896 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:40:32.896 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:40:32.896 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:32.897 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-10-16T19:40:32.897 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:32.897 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:32.897 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:32.897 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:32.898 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:32.898 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:40:32.898 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:32.898 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T19:40:32.898 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-10-16T19:40:32.899 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-10-16T19:40:32.899 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:40:32.899 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:40:32.899 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:40:32.900 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:40:32.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:32.900 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-10-16T19:40:32.901 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-10-16T19:40:32.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:40:32.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-10-16T19:40:32.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-10-16T19:40:32.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:40:32.902 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-10-16T19:40:33.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.078 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:40:33.112 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-10-16T19:40:33.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.114 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-10-16T19:40:33.263 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-10-16T19:40:33.264 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:40:33.264 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T19:40:33.264 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T19:40:33.264 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:40:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.265 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-10-16T19:40:33.265 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-10-16T19:40:33.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T19:40:33.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T19:40:33.267 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T19:40:33.267 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-10-16T19:40:33.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.481 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-10-16T19:40:33.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.504 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-10-16T19:40:33.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.567 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-10-16T19:40:33.567 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-10-16T19:40:33.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T19:40:33.568 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T19:40:33.568 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-10-16T19:40:33.670 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T19:40:33.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.671 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-10-16T19:40:33.671 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-10-16T19:40:33.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T19:40:33.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:40:33.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T19:40:33.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T19:40:33.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T19:40:33.673 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-10-16T19:40:33.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:33.892 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-10-16T19:40:33.892 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-10-16T19:40:33.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-10-16T19:40:33.893 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:40:33.893 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-10-16T19:40:33.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:33.999 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T19:40:34.020 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T19:40:34.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:40:34.021 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T19:40:34.077 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T19:40:34.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:34.192 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:34.192 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:34.321 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:34.321 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:34.321 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:40:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with new device syntax: 1@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:40:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:40:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:40:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:40:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:40:34.395 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:40:34.396 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:40:34.396 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:40:34.396 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with new device syntax: 1@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:40:34.397 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:40:34.397 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:40:34.397 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:40:34.397 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:40:34.398 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790" 2023-10-16T19:40:34.398 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790:/ 2023-10-16T19:40:34.398 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=b5b71d99-0d95-4cc7-b379-31b38eac533d" will pass to kernel 2023-10-16T19:40:34.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:40:34.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T19:40:34.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.428 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:34.503 INFO:teuthology.orchestra.run.smithi053.stdout:client4854 2023-10-16T19:40:34.503 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:40:34.504 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:34.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.560 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:34.633 INFO:teuthology.orchestra.run.smithi053.stdout:client4854 2023-10-16T19:40:34.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.634 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:40:34.707 INFO:teuthology.orchestra.run.smithi053.stdout:client4854 2023-10-16T19:40:34.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:34.708 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b5b71d99-0d95-4cc7-b379-31b38eac533d.client4854/status') 2023-10-16T19:40:34.788 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.4854 (3)172.21.15.53:0/3332411724 2023-10-16T19:40:34.788 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2023-10-16T19:40:34.789 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2023-10-16T19:40:34.790 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2023-10-16T19:40:34.790 INFO:teuthology.orchestra.run.smithi053.stderr:70 bytes copied, 2.3311e-05 s, 3.0 MB/s 2023-10-16T19:40:34.790 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T19:40:34.807 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:34.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 Processor -- start 2023-10-16T19:40:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 -- start start 2023-10-16T19:40:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1781550b0 0x7ff1780c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1780c0d30 0x7ff1780c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 0x7ff178070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780c5260 con 0x7ff1780c0d30 2023-10-16T19:40:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780c4650 con 0x7ff1780c1860 2023-10-16T19:40:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.946+0000 7ff17d7a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c4930 con 0x7ff1781550b0 2023-10-16T19:40:34.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1780c0d30 0x7ff1780c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1780c0d30 0x7ff1780c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52394/0 (socket says 172.21.15.29:52394) 2023-10-16T19:40:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 -- 172.21.15.29:0/3957967770 learned_addr learned my addr 172.21.15.29:0/3957967770 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1777fe700 1 --2- 172.21.15.29:0/3957967770 >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 0x7ff178070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff176ffd700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1781550b0 0x7ff1780c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 -- 172.21.15.29:0/3957967770 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1781550b0 msgr2=0x7ff1780c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1781550b0 0x7ff1780c07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 -- 172.21.15.29:0/3957967770 >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 msgr2=0x7ff178070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:34.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 --2- 172.21.15.29:0/3957967770 >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 0x7ff178070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 -- 172.21.15.29:0/3957967770 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780c4c10 con 0x7ff1780c0d30 2023-10-16T19:40:34.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1777fe700 1 --2- 172.21.15.29:0/3957967770 >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 0x7ff178070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:34.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff1767fc700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1780c0d30 0x7ff1780c1320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1780a4e90 tx=0x7ff16c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739fa2009c0cd47d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:34.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff175ffb700 1 -- 172.21.15.29:0/3957967770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00b870 con 0x7ff1780c0d30 2023-10-16T19:40:34.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff175ffb700 1 -- 172.21.15.29:0/3957967770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00b9d0 con 0x7ff1780c0d30 2023-10-16T19:40:34.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.947+0000 7ff175ffb700 1 -- 172.21.15.29:0/3957967770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00bd60 con 0x7ff1780c0d30 2023-10-16T19:40:34.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 -- 172.21.15.29:0/3957967770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1780c0d30 msgr2=0x7ff1780c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:34.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1780c0d30 0x7ff1780c1320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1780a4e90 tx=0x7ff16c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 -- 172.21.15.29:0/3957967770 shutdown_connections 2023-10-16T19:40:34.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/3957967770 >> v2:172.21.15.53:3300/0 conn(0x7ff1780c1860 0x7ff178070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1781550b0 0x7ff1780c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/3957967770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1780c0d30 0x7ff1780c1320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 -- 172.21.15.29:0/3957967770 >> 172.21.15.29:0/3957967770 conn(0x7ff1780a8070 msgr2=0x7ff1780c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:34.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 -- 172.21.15.29:0/3957967770 shutdown_connections 2023-10-16T19:40:34.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.948+0000 7ff17d7a2700 1 -- 172.21.15.29:0/3957967770 wait complete. 2023-10-16T19:40:34.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.949+0000 7ff17d7a2700 1 Processor -- start 2023-10-16T19:40:34.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.949+0000 7ff17d7a2700 1 -- start start 2023-10-16T19:40:34.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1780c0d30 0x7ff1780b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1780c1860 0x7ff1780b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780b3f30 con 0x7ff1781550b0 2023-10-16T19:40:34.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780b5af0 con 0x7ff1780c0d30 2023-10-16T19:40:34.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff17d7a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780b5db0 con 0x7ff1780c1860 2023-10-16T19:40:34.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52402/0 (socket says 172.21.15.29:52402) 2023-10-16T19:40:34.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 -- 172.21.15.29:0/1668054973 learned_addr learned my addr 172.21.15.29:0/1668054973 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:34.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff176ffd700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1780c0d30 0x7ff1780b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1767fc700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1780c1860 0x7ff1780b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 -- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1780c1860 msgr2=0x7ff1780b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:34.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1780c1860 0x7ff1780b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 -- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1780c0d30 msgr2=0x7ff1780b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:34.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1780c0d30 0x7ff1780b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:34.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.950+0000 7ff1777fe700 1 -- 172.21.15.29:0/1668054973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009550 con 0x7ff1781550b0 2023-10-16T19:40:34.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff1777fe700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff17000cef0 tx=0x7ff17000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:34.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000ac80 con 0x7ff1781550b0 2023-10-16T19:40:34.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17000ade0 con 0x7ff1781550b0 2023-10-16T19:40:34.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1780b3610 con 0x7ff1781550b0 2023-10-16T19:40:34.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170015680 con 0x7ff1781550b0 2023-10-16T19:40:34.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.951+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1780b72f0 con 0x7ff1781550b0 2023-10-16T19:40:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.952+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff178070570 con 0x7ff1781550b0 2023-10-16T19:40:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.952+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff17000d430 con 0x7ff1781550b0 2023-10-16T19:40:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.953+0000 7ff15f7fe700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 0x7ff16406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:34.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.953+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff170089ce0 con 0x7ff1781550b0 2023-10-16T19:40:34.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.953+0000 7ff176ffd700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 0x7ff16406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:34.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.953+0000 7ff176ffd700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 0x7ff16406d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff16800aaa0 tx=0x7ff168008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:34.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:34.957+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff170054a90 con 0x7ff1781550b0 2023-10-16T19:40:35.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.157+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1780c1220 con 0x7ff1781550b0 2023-10-16T19:40:35.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.158+0000 7ff15f7fe700 1 -- 172.21.15.29:0/1668054973 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7ff1700580b0 con 0x7ff1781550b0 2023-10-16T19:40:35.160 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:35.161 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:35.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 msgr2=0x7ff16406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 0x7ff16406d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff16800aaa0 tx=0x7ff168008040 comp rx=0 tx=0).stop 2023-10-16T19:40:35.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 msgr2=0x7ff1780b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff17000cef0 tx=0x7ff17000cf20 comp rx=0 tx=0).stop 2023-10-16T19:40:35.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 shutdown_connections 2023-10-16T19:40:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff16406af30 0x7ff16406d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1781550b0 0x7ff1780b66f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1780c0d30 0x7ff1780b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 --2- 172.21.15.29:0/1668054973 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1780c1860 0x7ff1780b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 >> 172.21.15.29:0/1668054973 conn(0x7ff1780a8070 msgr2=0x7ff17814c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:35.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 shutdown_connections 2023-10-16T19:40:35.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.160+0000 7ff17d7a2700 1 -- 172.21.15.29:0/1668054973 wait complete. 2023-10-16T19:40:35.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:35.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:35.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.301+0000 7f798eb9a700 1 Processor -- start 2023-10-16T19:40:35.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.301+0000 7f798eb9a700 1 -- start start 2023-10-16T19:40:35.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.302+0000 7f798eb9a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.302+0000 7f798eb9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 0x7f7988152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.302+0000 7f798eb9a700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880724a0 con 0x7f798806f6e0 2023-10-16T19:40:35.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.302+0000 7f798eb9a700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7988152780 con 0x7f79880c18b0 2023-10-16T19:40:35.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.302+0000 7f798eb9a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c2660 con 0x7f7988150100 2023-10-16T19:40:35.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f798d137700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 0x7f7988152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f798d137700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 0x7f7988152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:42692/0 (socket says 172.21.15.29:42692) 2023-10-16T19:40:35.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f798d137700 1 -- 172.21.15.29:0/1325035877 learned_addr learned my addr 172.21.15.29:0/1325035877 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:35.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:44860/0 (socket says 172.21.15.29:44860) 2023-10-16T19:40:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 -- 172.21.15.29:0/1325035877 >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 msgr2=0x7f7988152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 --2- 172.21.15.29:0/1325035877 >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 0x7f7988152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 -- 172.21.15.29:0/1325035877 >> v1:172.21.15.53:6789/0 conn(0x7f798806f6e0 legacy=0x7f798814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 -- 172.21.15.29:0/1325035877 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880a8490 con 0x7f7988150100 2023-10-16T19:40:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f7987fff700 1 --2- 172.21.15.29:0/1325035877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7974009840 tx=0x7f7974009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbda9bca4aecc7fb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f79877fe700 1 -- 172.21.15.29:0/1325035877 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011830 con 0x7f7988150100 2023-10-16T19:40:35.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f79877fe700 1 -- 172.21.15.29:0/1325035877 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011990 con 0x7f7988150100 2023-10-16T19:40:35.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.303+0000 7f79877fe700 1 -- 172.21.15.29:0/1325035877 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011d20 con 0x7f7988150100 2023-10-16T19:40:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 -- 172.21.15.29:0/1325035877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 msgr2=0x7f7988156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 --2- 172.21.15.29:0/1325035877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7974009840 tx=0x7f7974009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 -- 172.21.15.29:0/1325035877 shutdown_connections 2023-10-16T19:40:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 --2- 172.21.15.29:0/1325035877 >> v2:172.21.15.53:3300/0 conn(0x7f79880c18b0 0x7f7988152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 --2- 172.21.15.29:0/1325035877 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7988150100 0x7f7988156670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 -- 172.21.15.29:0/1325035877 >> 172.21.15.29:0/1325035877 conn(0x7f79880c7110 msgr2=0x7f79880c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 -- 172.21.15.29:0/1325035877 shutdown_connections 2023-10-16T19:40:35.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.304+0000 7f798eb9a700 1 -- 172.21.15.29:0/1325035877 wait complete. 2023-10-16T19:40:35.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.305+0000 7f798eb9a700 1 Processor -- start 2023-10-16T19:40:35.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.305+0000 7f798eb9a700 1 -- start start 2023-10-16T19:40:35.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f798806f6e0 0x7f79881ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7988150100 0x7f79880c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c3b80 con 0x7f79880c18b0 2023-10-16T19:40:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79881540a0 con 0x7f7988150100 2023-10-16T19:40:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798eb9a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c3e40 con 0x7f798806f6e0 2023-10-16T19:40:35.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52412/0 (socket says 172.21.15.29:52412) 2023-10-16T19:40:35.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 -- 172.21.15.29:0/3111499528 learned_addr learned my addr 172.21.15.29:0/3111499528 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:35.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798c936700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f798806f6e0 0x7f79881ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f798d137700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7988150100 0x7f79880c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 -- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f798806f6e0 msgr2=0x7f79881ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f798806f6e0 0x7f79881ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 -- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7988150100 msgr2=0x7f79880c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7988150100 0x7f79880c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.306+0000 7f7987fff700 1 -- 172.21.15.29:0/3111499528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740094a0 con 0x7f79880c18b0 2023-10-16T19:40:35.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f7987fff700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79740090b0 tx=0x7f7974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740036a0 con 0x7f79880c18b0 2023-10-16T19:40:35.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797401e070 con 0x7f79880c18b0 2023-10-16T19:40:35.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79880c4120 con 0x7f79880c18b0 2023-10-16T19:40:35.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974003a80 con 0x7f79880c18b0 2023-10-16T19:40:35.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.307+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988156950 con 0x7f79880c18b0 2023-10-16T19:40:35.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.308+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798804f400 con 0x7f79880c18b0 2023-10-16T19:40:35.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.308+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7974003be0 con 0x7f79880c18b0 2023-10-16T19:40:35.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.308+0000 7f79857fa700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 0x7f796c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.309+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f797408a7a0 con 0x7f79880c18b0 2023-10-16T19:40:35.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.309+0000 7f798c936700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 0x7f796c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.309+0000 7f798c936700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 0x7f796c06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f797c007fd0 tx=0x7f797c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.313+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79740555f0 con 0x7f79880c18b0 2023-10-16T19:40:35.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.513+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7988149ba0 con 0x7f79880c18b0 2023-10-16T19:40:35.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.514+0000 7f79857fa700 1 -- 172.21.15.29:0/3111499528 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7974020020 con 0x7f79880c18b0 2023-10-16T19:40:35.516 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:35.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 msgr2=0x7f796c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 0x7f796c06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f797c007fd0 tx=0x7f797c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 msgr2=0x7f7988154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79740090b0 tx=0x7f7974004750 comp rx=0 tx=0).stop 2023-10-16T19:40:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 shutdown_connections 2023-10-16T19:40:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f796c06af00 0x7f796c06d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7988150100 0x7f79880c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f798806f6e0 0x7f79881ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 --2- 172.21.15.29:0/3111499528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79880c18b0 0x7f7988154c80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 >> 172.21.15.29:0/3111499528 conn(0x7f79880c7110 msgr2=0x7f798814edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:35.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 shutdown_connections 2023-10-16T19:40:35.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.516+0000 7f798eb9a700 1 -- 172.21.15.29:0/3111499528 wait complete. 2023-10-16T19:40:35.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:35.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.658+0000 7f97cb7c8700 1 Processor -- start 2023-10-16T19:40:35.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.658+0000 7f97cb7c8700 1 -- start start 2023-10-16T19:40:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.659+0000 7f97cb7c8700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97c413d660 0x7f97c406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.659+0000 7f97cb7c8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97c4154a50 0x7f97c41583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.659+0000 7f97cb7c8700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c406e780 con 0x7f97c406adc0 2023-10-16T19:40:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.659+0000 7f97cb7c8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c406d320 con 0x7f97c4154a50 2023-10-16T19:40:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.659+0000 7f97cb7c8700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c4154f10 con 0x7f97c413d660 2023-10-16T19:40:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97c4154a50 0x7f97c41583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97c4154a50 0x7f97c41583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52418/0 (socket says 172.21.15.29:52418) 2023-10-16T19:40:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 -- 172.21.15.29:0/1465146925 learned_addr learned my addr 172.21.15.29:0/1465146925 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c9564700 1 --2- 172.21.15.29:0/1465146925 >> v2:172.21.15.53:3300/0 conn(0x7f97c413d660 0x7f97c406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 -- 172.21.15.29:0/1465146925 >> v2:172.21.15.53:3300/0 conn(0x7f97c413d660 msgr2=0x7f97c406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 --2- 172.21.15.29:0/1465146925 >> v2:172.21.15.53:3300/0 conn(0x7f97c413d660 0x7f97c406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 -- 172.21.15.29:0/1465146925 >> v1:172.21.15.53:6789/0 conn(0x7f97c406adc0 legacy=0x7f97c4158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 -- 172.21.15.29:0/1465146925 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c41551f0 con 0x7f97c4154a50 2023-10-16T19:40:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97c8d63700 1 --2- 172.21.15.29:0/1465146925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c4154a50 0x7f97c41583c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f97c40c15e0 tx=0x7f97c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed67a306a87edde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97bbfff700 1 -- 172.21.15.29:0/1465146925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0004230 con 0x7f97c4154a50 2023-10-16T19:40:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97bbfff700 1 -- 172.21.15.29:0/1465146925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0004390 con 0x7f97c4154a50 2023-10-16T19:40:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.660+0000 7f97bbfff700 1 -- 172.21.15.29:0/1465146925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c00036a0 con 0x7f97c4154a50 2023-10-16T19:40:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 -- 172.21.15.29:0/1465146925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c4154a50 msgr2=0x7f97c41583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/1465146925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c4154a50 0x7f97c41583c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f97c40c15e0 tx=0x7f97c0009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 -- 172.21.15.29:0/1465146925 shutdown_connections 2023-10-16T19:40:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/1465146925 >> v2:172.21.15.53:3300/0 conn(0x7f97c413d660 0x7f97c406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/1465146925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c4154a50 0x7f97c41583c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 -- 172.21.15.29:0/1465146925 >> 172.21.15.29:0/1465146925 conn(0x7f97c40c7110 msgr2=0x7f97c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 -- 172.21.15.29:0/1465146925 shutdown_connections 2023-10-16T19:40:35.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.661+0000 7f97cb7c8700 1 -- 172.21.15.29:0/1465146925 wait complete. 2023-10-16T19:40:35.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.662+0000 7f97cb7c8700 1 Processor -- start 2023-10-16T19:40:35.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.662+0000 7f97cb7c8700 1 -- start start 2023-10-16T19:40:35.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97c413d660 0x7f97c41ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97c4154a50 0x7f97c4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4130cc0 con 0x7f97c406adc0 2023-10-16T19:40:35.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4133690 con 0x7f97c413d660 2023-10-16T19:40:35.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c41eac80 con 0x7f97c4154a50 2023-10-16T19:40:35.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52424/0 (socket says 172.21.15.29:52424) 2023-10-16T19:40:35.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 -- 172.21.15.29:0/82570593 learned_addr learned my addr 172.21.15.29:0/82570593 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:35.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c8d63700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97c413d660 0x7f97c41ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9d65700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97c4154a50 0x7f97c4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 -- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97c4154a50 msgr2=0x7f97c4156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97c4154a50 0x7f97c4156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 -- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97c413d660 msgr2=0x7f97c41ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97c413d660 0x7f97c41ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 -- 172.21.15.29:0/82570593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c0009550 con 0x7f97c406adc0 2023-10-16T19:40:35.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97c9564700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e840 tx=0x7f97b400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4013610 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4013770 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c41eaf60 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.663+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4013b20 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.664+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c4133320 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.665+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c40c3780 con 0x7f97c406adc0 2023-10-16T19:40:35.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.665+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97b4013c80 con 0x7f97c406adc0 2023-10-16T19:40:35.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.665+0000 7f97b9ffb700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 0x7f97a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:35.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.666+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f97b40894c0 con 0x7f97c406adc0 2023-10-16T19:40:35.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.666+0000 7f97c8d63700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 0x7f97a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:35.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.666+0000 7f97c8d63700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 0x7f97a806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009130 tx=0x7f97c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:35.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.670+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97b40541f0 con 0x7f97c406adc0 2023-10-16T19:40:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.869+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97c404f400 con 0x7f97c406adc0 2023-10-16T19:40:35.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.869+0000 7f97b9ffb700 1 -- 172.21.15.29:0/82570593 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97b4057810 con 0x7f97c406adc0 2023-10-16T19:40:35.872 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:35.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 msgr2=0x7f97a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 0x7f97a806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009130 tx=0x7f97c0008030 comp rx=0 tx=0).stop 2023-10-16T19:40:35.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 msgr2=0x7f97c412fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:35.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e840 tx=0x7f97b400eb50 comp rx=0 tx=0).stop 2023-10-16T19:40:35.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 shutdown_connections 2023-10-16T19:40:35.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f97a806af00 0x7f97a806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f97c4154a50 0x7f97c4156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c406adc0 0x7f97c412fbf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 --2- 172.21.15.29:0/82570593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97c413d660 0x7f97c41ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:35.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 >> 172.21.15.29:0/82570593 conn(0x7f97c40c7110 msgr2=0x7f97c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:35.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.871+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 shutdown_connections 2023-10-16T19:40:35.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:35.872+0000 7f97cb7c8700 1 -- 172.21.15.29:0/82570593 wait complete. 2023-10-16T19:40:35.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:36.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.011+0000 7f36e472c700 1 Processor -- start 2023-10-16T19:40:36.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.011+0000 7f36e472c700 1 -- start start 2023-10-16T19:40:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.012+0000 7f36e472c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36dc154f70 0x7f36dc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.012+0000 7f36e472c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc155a60 0x7f36dc14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.012+0000 7f36e472c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36dc0a8530 con 0x7f36dc0c1ef0 2023-10-16T19:40:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.012+0000 7f36e472c700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36dc0a91e0 con 0x7f36dc154f70 2023-10-16T19:40:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.012+0000 7f36e472c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc0a87d0 con 0x7f36dc155a60 2023-10-16T19:40:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e1cc7700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f36dc0c1ef0 0x7f36dc155350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37876/0 (socket says 172.21.15.29:37876) 2023-10-16T19:40:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e1cc7700 1 -- 172.21.15.29:0/3201531367 learned_addr learned my addr 172.21.15.29:0/3201531367 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3201531367 >> v2:172.21.15.53:3300/0 conn(0x7f36dc154f70 0x7f36dc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e2cc9700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc155a60 0x7f36dc14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e14c6700 1 -- 172.21.15.29:0/3201531367 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188414226 0 0) 0x7f36dc0a8530 con 0x7f36dc0c1ef0 2023-10-16T19:40:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e14c6700 1 -- 172.21.15.29:0/3201531367 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c80035b0 con 0x7f36dc0c1ef0 2023-10-16T19:40:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 -- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc155a60 msgr2=0x7f36dc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc155a60 0x7f36dc14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 -- 172.21.15.29:0/3201531367 >> v1:172.21.15.29:6789/0 conn(0x7f36dc0c1ef0 legacy=0x7f36dc155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 -- 172.21.15.29:0/3201531367 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc06f0f0 con 0x7f36dc154f70 2023-10-16T19:40:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc0c19b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009840 tx=0x7f36d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77d31f37ac2c3e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e14c6700 1 -- 172.21.15.29:0/3201531367 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8011830 con 0x7f36dc154f70 2023-10-16T19:40:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e14c6700 1 -- 172.21.15.29:0/3201531367 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8011990 con 0x7f36dc154f70 2023-10-16T19:40:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.013+0000 7f36e14c6700 1 -- 172.21.15.29:0/3201531367 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8011d00 con 0x7f36dc154f70 2023-10-16T19:40:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 -- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 msgr2=0x7f36dc0c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc0c19b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009840 tx=0x7f36d8009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 -- 172.21.15.29:0/3201531367 shutdown_connections 2023-10-16T19:40:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc155a60 0x7f36dc14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 --2- 172.21.15.29:0/3201531367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc0c19b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 -- 172.21.15.29:0/3201531367 >> 172.21.15.29:0/3201531367 conn(0x7f36dc0c3ab0 msgr2=0x7f36dc0c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 -- 172.21.15.29:0/3201531367 shutdown_connections 2023-10-16T19:40:36.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.014+0000 7f36e472c700 1 -- 172.21.15.29:0/3201531367 wait complete. 2023-10-16T19:40:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.015+0000 7f36e472c700 1 Processor -- start 2023-10-16T19:40:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.015+0000 7f36e472c700 1 -- start start 2023-10-16T19:40:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc0c1ef0 0x7f36dc0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc1dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc148850 con 0x7f36dc143420 2023-10-16T19:40:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc148d80 con 0x7f36dc154f70 2023-10-16T19:40:36.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e472c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc0ab700 con 0x7f36dc0c1ef0 2023-10-16T19:40:36.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52442/0 (socket says 172.21.15.29:52442) 2023-10-16T19:40:36.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 -- 172.21.15.29:0/3223513968 learned_addr learned my addr 172.21.15.29:0/3223513968 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:36.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e1cc7700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc1dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc0c1ef0 0x7f36dc0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 -- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc0c1ef0 msgr2=0x7f36dc0ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc0c1ef0 0x7f36dc0ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 -- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 msgr2=0x7f36dc1dc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc1dc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.016+0000 7f36e2cc9700 1 -- 172.21.15.29:0/3223513968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80094a0 con 0x7f36dc143420 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36e2cc9700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009d30 tx=0x7f36d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4009ba0 con 0x7f36dc143420 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d400f040 con 0x7f36dc143420 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4014480 con 0x7f36dc143420 2023-10-16T19:40:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc148aa0 con 0x7f36dc143420 2023-10-16T19:40:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.017+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36dc1e9b70 con 0x7f36dc143420 2023-10-16T19:40:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.018+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36dc1e9d90 con 0x7f36dc143420 2023-10-16T19:40:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.018+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36d40145e0 con 0x7f36dc143420 2023-10-16T19:40:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.019+0000 7f36ceffd700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 0x7f36c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.019+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36d408a620 con 0x7f36dc143420 2023-10-16T19:40:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.019+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 0x7f36c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.019+0000 7f36e24c8700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 0x7f36c006d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009fd0 tx=0x7f36d8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.023+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36d4055340 con 0x7f36dc143420 2023-10-16T19:40:36.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.223+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36dc04f400 con 0x7f36dc143420 2023-10-16T19:40:36.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.223+0000 7f36ceffd700 1 -- 172.21.15.29:0/3223513968 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36d4058960 con 0x7f36dc143420 2023-10-16T19:40:36.226 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:36.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 msgr2=0x7f36c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 0x7f36c006d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009fd0 tx=0x7f36d8008030 comp rx=0 tx=0).stop 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 msgr2=0x7f36dc1ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009d30 tx=0x7f36d400c3a0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 shutdown_connections 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f36c006af00 0x7f36c006d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36dc143420 0x7f36dc1ea090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36dc0c1ef0 0x7f36dc0ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 --2- 172.21.15.29:0/3223513968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36dc154f70 0x7f36dc1dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 >> 172.21.15.29:0/3223513968 conn(0x7f36dc0c3ab0 msgr2=0x7f36dc06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 shutdown_connections 2023-10-16T19:40:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.226+0000 7f36e472c700 1 -- 172.21.15.29:0/3223513968 wait complete. 2023-10-16T19:40:36.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.365+0000 7f73ab682700 1 Processor -- start 2023-10-16T19:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.365+0000 7f73ab682700 1 -- start start 2023-10-16T19:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73ab682700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73a406af90 0x7f73a415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73ab682700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a4155030 con 0x7f73a414f040 2023-10-16T19:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73ab682700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a4154d50 con 0x7f73a40c18a0 2023-10-16T19:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73ab682700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a4072700 con 0x7f73a406af90 2023-10-16T19:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73a941e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f73a414f040 0x7f73a4071560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37890/0 (socket says 172.21.15.29:37890) 2023-10-16T19:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.366+0000 7f73a941e700 1 -- 172.21.15.29:0/4067966319 learned_addr learned my addr 172.21.15.29:0/4067966319 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/4067966319 >> v2:172.21.15.53:3300/0 conn(0x7f73a406af90 0x7f73a415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178838422 0 0) 0x7f73a4155030 con 0x7f73a414f040 2023-10-16T19:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73900035b0 con 0x7f73a414f040 2023-10-16T19:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104933782 0 0) 0x7f73900035b0 con 0x7f73a414f040 2023-10-16T19:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 >> v2:172.21.15.53:3300/0 conn(0x7f73a406af90 msgr2=0x7f73a415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 --2- 172.21.15.29:0/4067966319 >> v2:172.21.15.53:3300/0 conn(0x7f73a406af90 0x7f73a415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 >> v1:172.21.15.53:6789/0 conn(0x7f73a40c18a0 legacy=0x7f73a406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a41518f0 con 0x7f73a414f040 2023-10-16T19:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f7394001670 con 0x7f73a414f040 2023-10-16T19:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 >> v1:172.21.15.29:6789/0 conn(0x7f73a414f040 legacy=0x7f73a4071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7390003a00 0x7f7390003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7390004850 0x7f7390004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f739000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739000c180 con 0x7f7390005210 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739000c2f0 con 0x7f7390004850 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739000c4b0 con 0x7f7390003a00 2023-10-16T19:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f739000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a8c1d700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7390004850 0x7f7390004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a941e700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7390003a00 0x7f7390003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 -- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7390003a00 msgr2=0x7f7390003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7390003a00 0x7f7390003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 -- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7390004850 msgr2=0x7f7390004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7390004850 0x7f7390004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.367+0000 7f73a9c1f700 1 -- 172.21.15.29:0/4067966319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900035b0 con 0x7f7390005210 2023-10-16T19:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73a9c1f700 1 -- 172.21.15.29:0/4067966319 reap_dead start 2023-10-16T19:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f739000ba10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f739c009fc0 tx=0x7f7390005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b4b58967243f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c003a20 con 0x7f7390005210 2023-10-16T19:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c00f040 con 0x7f7390005210 2023-10-16T19:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f739bfff700 1 -- 172.21.15.29:0/4067966319 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c003de0 con 0x7f7390005210 2023-10-16T19:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 -- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 msgr2=0x7f739000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f739000ba10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f739c009fc0 tx=0x7f7390005880 comp rx=0 tx=0).stop 2023-10-16T19:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 -- 172.21.15.29:0/4067966319 shutdown_connections 2023-10-16T19:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 --2- 172.21.15.29:0/4067966319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f739000ba10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 -- 172.21.15.29:0/4067966319 >> 172.21.15.29:0/4067966319 conn(0x7f73a40c66d0 msgr2=0x7f73a40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 -- 172.21.15.29:0/4067966319 shutdown_connections 2023-10-16T19:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.368+0000 7f73ab682700 1 -- 172.21.15.29:0/4067966319 wait complete. 2023-10-16T19:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.370+0000 7f73ab682700 1 Processor -- start 2023-10-16T19:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.370+0000 7f73ab682700 1 -- start start 2023-10-16T19:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a41eabe0 0x7f73a41eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f73a41db070 0x7f73a41db520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41dcef0 con 0x7f7390005210 2023-10-16T19:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a40bda40 con 0x7f73a41eabe0 2023-10-16T19:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73ab682700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41eb5a0 con 0x7f73a41db070 2023-10-16T19:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52456/0 (socket says 172.21.15.29:52456) 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 -- 172.21.15.29:0/2317724244 learned_addr learned my addr 172.21.15.29:0/2317724244 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a8c1d700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a41eabe0 0x7f73a41eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 -- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f73a41db070 msgr2=0x7f73a41db520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a9c1f700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f73a41db070 0x7f73a41db520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f73a41db070 0x7f73a41db520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 -- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a41eabe0 msgr2=0x7f73a41eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a41eabe0 0x7f73a41eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.371+0000 7f73a941e700 1 -- 172.21.15.29:0/2317724244 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a406e5f0 con 0x7f7390005210 2023-10-16T19:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f73a941e700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7394007290 tx=0x7f73940075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400f660 con 0x7f7390005210 2023-10-16T19:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739400f7c0 con 0x7f7390005210 2023-10-16T19:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a41dcc10 con 0x7f7390005210 2023-10-16T19:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400fb70 con 0x7f7390005210 2023-10-16T19:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.372+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a41eba70 con 0x7f7390005210 2023-10-16T19:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.373+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4066db0 con 0x7f7390005210 2023-10-16T19:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.373+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f739400fcd0 con 0x7f7390005210 2023-10-16T19:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.374+0000 7f7399ffb700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 0x7f738806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.374+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7394089820 con 0x7f7390005210 2023-10-16T19:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.374+0000 7f73a8c1d700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 0x7f738806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.374+0000 7f73a8c1d700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 0x7f738806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000c00 tx=0x7f73a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.378+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7394054670 con 0x7f7390005210 2023-10-16T19:40:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.577+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f73a404f400 con 0x7f7390005210 2023-10-16T19:40:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.577+0000 7f7399ffb700 1 -- 172.21.15.29:0/2317724244 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7394057c90 con 0x7f7390005210 2023-10-16T19:40:36.580 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 msgr2=0x7f738806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 0x7f738806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000c00 tx=0x7f73a0009040 comp rx=0 tx=0).stop 2023-10-16T19:40:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 msgr2=0x7f73a4150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7394007290 tx=0x7f73940075a0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 shutdown_connections 2023-10-16T19:40:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f738806af00 0x7f738806d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f73a41db070 0x7f73a41db520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390005210 0x7f73a4150090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 --2- 172.21.15.29:0/2317724244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a41eabe0 0x7f73a41eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 >> 172.21.15.29:0/2317724244 conn(0x7f73a40c66d0 msgr2=0x7f73a4070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 shutdown_connections 2023-10-16T19:40:36.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.579+0000 7f73ab682700 1 -- 172.21.15.29:0/2317724244 wait complete. 2023-10-16T19:40:36.593 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:36.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.717+0000 7f4ef414f700 1 Processor -- start 2023-10-16T19:40:36.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.717+0000 7f4ef414f700 1 -- start start 2023-10-16T19:40:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.717+0000 7f4ef414f700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4eec1520b0 0x7f4eec06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.717+0000 7f4ef414f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec154da0 con 0x7f4eec0c3240 2023-10-16T19:40:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.717+0000 7f4ef414f700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec155080 con 0x7f4eec0714a0 2023-10-16T19:40:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef414f700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec155b60 con 0x7f4eec1520b0 2023-10-16T19:40:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef26ec700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4eec0c3240 0x7f4eec06e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37910/0 (socket says 172.21.15.29:37910) 2023-10-16T19:40:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef26ec700 1 -- 172.21.15.29:0/3664219350 learned_addr learned my addr 172.21.15.29:0/3664219350 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef16ea700 1 --2- 172.21.15.29:0/3664219350 >> v2:172.21.15.53:3300/0 conn(0x7f4eec1520b0 0x7f4eec06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077108127 0 0) 0x7f4eec154da0 con 0x7f4eec0c3240 2023-10-16T19:40:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed80035b0 con 0x7f4eec0c3240 2023-10-16T19:40:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 901407008 0 0) 0x7f4ed80035b0 con 0x7f4eec0c3240 2023-10-16T19:40:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 >> v2:172.21.15.53:3300/0 conn(0x7f4eec1520b0 msgr2=0x7f4eec06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 --2- 172.21.15.29:0/3664219350 >> v2:172.21.15.53:3300/0 conn(0x7f4eec1520b0 0x7f4eec06ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 >> v1:172.21.15.53:6789/0 conn(0x7f4eec0714a0 legacy=0x7f4eec147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec155360 con 0x7f4eec0c3240 2023-10-16T19:40:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f4ee4001a40 con 0x7f4eec0c3240 2023-10-16T19:40:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 >> v1:172.21.15.29:6789/0 conn(0x7f4eec0c3240 legacy=0x7f4eec06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed8003a00 0x7f4ed8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8004850 0x7f4ed8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 0x7f4ed800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec155b60 con 0x7f4ed8005210 2023-10-16T19:40:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed800c1b0 con 0x7f4ed8003a00 2023-10-16T19:40:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed800c370 con 0x7f4ed8004850 2023-10-16T19:40:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 0x7f4ed800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef1eeb700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed8003a00 0x7f4ed8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.718+0000 7f4ef16ea700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8004850 0x7f4ed8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 -- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8004850 msgr2=0x7f4ed8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8004850 0x7f4ed8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 -- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed8003a00 msgr2=0x7f4ed8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed8003a00 0x7f4ed8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 -- 172.21.15.29:0/3664219350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80035b0 con 0x7f4ed8005210 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 -- 172.21.15.29:0/3664219350 reap_dead start 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 0x7f4ed800ba10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400a7a0 tx=0x7f4ed8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b285dec41bb374f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4010690 con 0x7f4ed8005210 2023-10-16T19:40:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee40107f0 con 0x7f4ed8005210 2023-10-16T19:40:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef0ee9700 1 -- 172.21.15.29:0/3664219350 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4010ba0 con 0x7f4ed8005210 2023-10-16T19:40:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef414f700 1 -- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 msgr2=0x7f4ed800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.719+0000 7f4ef414f700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 0x7f4ed800ba10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400a7a0 tx=0x7f4ed8005880 comp rx=0 tx=0).stop 2023-10-16T19:40:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.720+0000 7f4ef414f700 1 -- 172.21.15.29:0/3664219350 shutdown_connections 2023-10-16T19:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.720+0000 7f4ef414f700 1 --2- 172.21.15.29:0/3664219350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed8005210 0x7f4ed800ba10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.720+0000 7f4ef414f700 1 -- 172.21.15.29:0/3664219350 >> 172.21.15.29:0/3664219350 conn(0x7f4eec0c7100 msgr2=0x7f4eec0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.720+0000 7f4ef414f700 1 -- 172.21.15.29:0/3664219350 shutdown_connections 2023-10-16T19:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.720+0000 7f4ef414f700 1 -- 172.21.15.29:0/3664219350 wait complete. 2023-10-16T19:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.721+0000 7f4ef414f700 1 Processor -- start 2023-10-16T19:40:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.721+0000 7f4ef414f700 1 -- start start 2023-10-16T19:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.721+0000 7f4ef414f700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8005210 0x7f4eec1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.721+0000 7f4ef414f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eec0aa230 0x7f4eec13a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.721+0000 7f4ef414f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef414f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0abef0 con 0x7f4eec0aa690 2023-10-16T19:40:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef414f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ac1d0 con 0x7f4eec0aa230 2023-10-16T19:40:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef414f700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ac4b0 con 0x7f4ed8005210 2023-10-16T19:40:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52480/0 (socket says 172.21.15.29:52480) 2023-10-16T19:40:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 -- 172.21.15.29:0/1133020831 learned_addr learned my addr 172.21.15.29:0/1133020831 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef1eeb700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8005210 0x7f4eec1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef16ea700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eec0aa230 0x7f4eec13a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 -- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8005210 msgr2=0x7f4eec1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8005210 0x7f4eec1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 -- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eec0aa230 msgr2=0x7f4eec13a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eec0aa230 0x7f4eec13a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 -- 172.21.15.29:0/1133020831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0ac790 con 0x7f4eec0aa690 2023-10-16T19:40:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef26ec700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0c2fc0 tx=0x7f4eec0a8f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4020070 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4001a10 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011670 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec0ab6e0 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.722+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec06ef30 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.723+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec06f120 con 0x7f4eec0aa690 2023-10-16T19:40:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.724+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ee4007d50 con 0x7f4eec0aa690 2023-10-16T19:40:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.724+0000 7f4ee27fc700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 0x7f4ed006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.724+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ee408a7a0 con 0x7f4eec0aa690 2023-10-16T19:40:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.725+0000 7f4ef1eeb700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 0x7f4ed006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.725+0000 7f4ef1eeb700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 0x7f4ed006d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007fd0 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.729+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ee4055710 con 0x7f4eec0aa690 2023-10-16T19:40:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.931+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eec074a70 con 0x7f4eec0aa690 2023-10-16T19:40:36.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.932+0000 7f4ee27fc700 1 -- 172.21.15.29:0/1133020831 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f4ee4058d30 con 0x7f4eec0aa690 2023-10-16T19:40:36.934 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:36.934 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 msgr2=0x7f4ed006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 0x7f4ed006d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007fd0 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2023-10-16T19:40:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 msgr2=0x7f4eec13acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0c2fc0 tx=0x7f4eec0a8f30 comp rx=0 tx=0).stop 2023-10-16T19:40:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 shutdown_connections 2023-10-16T19:40:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4ed006af30 0x7f4ed006d3f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eec0aa690 0x7f4eec13acc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4ed8005210 0x7f4eec1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 --2- 172.21.15.29:0/1133020831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eec0aa230 0x7f4eec13a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 >> 172.21.15.29:0/1133020831 conn(0x7f4eec0c7100 msgr2=0x7f4eec0c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 shutdown_connections 2023-10-16T19:40:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:36.934+0000 7f4ef414f700 1 -- 172.21.15.29:0/1133020831 wait complete. 2023-10-16T19:40:36.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:36.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:37.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.078+0000 7f47cd00d700 1 Processor -- start 2023-10-16T19:40:37.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 -- start start 2023-10-16T19:40:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 0x7f47c81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47c80c3350 0x7f47c8071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c8155af0 con 0x7f47c80c3350 2023-10-16T19:40:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c8152300 con 0x7f47c814ec50 2023-10-16T19:40:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47cd00d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c2e40 con 0x7f47c8071840 2023-10-16T19:40:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.079+0000 7f47c659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47c80c3350 0x7f47c8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47c80c3350 0x7f47c8071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52486/0 (socket says 172.21.15.29:52486) 2023-10-16T19:40:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 -- 172.21.15.29:0/4197753861 learned_addr learned my addr 172.21.15.29:0/4197753861 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c759e700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/4197753861 >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 0x7f47c81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 -- 172.21.15.29:0/4197753861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 msgr2=0x7f47c806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c806db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 -- 172.21.15.29:0/4197753861 >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 msgr2=0x7f47c81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 --2- 172.21.15.29:0/4197753861 >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 0x7f47c81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 -- 172.21.15.29:0/4197753861 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c814f030 con 0x7f47c80c3350 2023-10-16T19:40:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/4197753861 >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 0x7f47c81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c759e700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c659c700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c8071300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47c80728d0 tx=0x7f47b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5a8a2bbce1d906 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c5d9b700 1 -- 172.21.15.29:0/4197753861 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000b870 con 0x7f47c80c3350 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c5d9b700 1 -- 172.21.15.29:0/4197753861 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b000b9d0 con 0x7f47c80c3350 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.080+0000 7f47c5d9b700 1 -- 172.21.15.29:0/4197753861 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000bd60 con 0x7f47c80c3350 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 -- 172.21.15.29:0/4197753861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 msgr2=0x7f47c8071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c8071300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47c80728d0 tx=0x7f47b0009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 -- 172.21.15.29:0/4197753861 shutdown_connections 2023-10-16T19:40:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 --2- 172.21.15.29:0/4197753861 >> v2:172.21.15.53:3300/0 conn(0x7f47c814ec50 0x7f47c81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 --2- 172.21.15.29:0/4197753861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c8071300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 -- 172.21.15.29:0/4197753861 >> 172.21.15.29:0/4197753861 conn(0x7f47c80c7110 msgr2=0x7f47c80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 -- 172.21.15.29:0/4197753861 shutdown_connections 2023-10-16T19:40:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.081+0000 7f47cd00d700 1 -- 172.21.15.29:0/4197753861 wait complete. 2023-10-16T19:40:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.082+0000 7f47cd00d700 1 Processor -- start 2023-10-16T19:40:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.082+0000 7f47cd00d700 1 -- start start 2023-10-16T19:40:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c81ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c814ec50 0x7f47c80a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c8145af0 con 0x7f47c80c3350 2023-10-16T19:40:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81eb3e0 con 0x7f47c814ec50 2023-10-16T19:40:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47cd00d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81eb9a0 con 0x7f47c8071840 2023-10-16T19:40:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52492/0 (socket says 172.21.15.29:52492) 2023-10-16T19:40:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 -- 172.21.15.29:0/1173953237 learned_addr learned my addr 172.21.15.29:0/1173953237 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c81ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c759e700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c814ec50 0x7f47c80a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 -- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 msgr2=0x7f47c81ebe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c81ebe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 -- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c814ec50 msgr2=0x7f47c80a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c814ec50 0x7f47c80a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 -- 172.21.15.29:0/1173953237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009550 con 0x7f47c80c3350 2023-10-16T19:40:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c81ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47c659c700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47b0014040 tx=0x7f47b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.083+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004520 con 0x7f47c80c3350 2023-10-16T19:40:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.084+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b001e070 con 0x7f47c80c3350 2023-10-16T19:40:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.084+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00038e0 con 0x7f47c80c3350 2023-10-16T19:40:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.084+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c81ec370 con 0x7f47c80c3350 2023-10-16T19:40:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.084+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c806ad40 con 0x7f47c80c3350 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.085+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c81e8db0 con 0x7f47c80c3350 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.085+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47b0003a40 con 0x7f47c80c3350 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.085+0000 7f47bf7fe700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.085+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47b0020070 con 0x7f47c80c3350 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.086+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.086+0000 7f47c6d9d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 0x7f47a806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006fd0 tx=0x7f47b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.090+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47b0091080 con 0x7f47c80c3350 2023-10-16T19:40:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.289+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47c81ebb10 con 0x7f47c80c3350 2023-10-16T19:40:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.290+0000 7f47bf7fe700 1 -- 172.21.15.29:0/1173953237 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47b00150a0 con 0x7f47c80c3350 2023-10-16T19:40:37.292 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:37.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 msgr2=0x7f47a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 0x7f47a806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006fd0 tx=0x7f47b8008040 comp rx=0 tx=0).stop 2023-10-16T19:40:37.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 msgr2=0x7f47c81e8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47b0014040 tx=0x7f47b0004750 comp rx=0 tx=0).stop 2023-10-16T19:40:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 shutdown_connections 2023-10-16T19:40:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f47a806af00 0x7f47a806d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c814ec50 0x7f47c80a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f47c8071840 0x7f47c81ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 --2- 172.21.15.29:0/1173953237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47c80c3350 0x7f47c81e8870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 >> 172.21.15.29:0/1173953237 conn(0x7f47c80c7110 msgr2=0x7f47c814a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 shutdown_connections 2023-10-16T19:40:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.292+0000 7f47cd00d700 1 -- 172.21.15.29:0/1173953237 wait complete. 2023-10-16T19:40:37.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:37.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.433+0000 7f181c6ca700 1 Processor -- start 2023-10-16T19:40:37.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.433+0000 7f181c6ca700 1 -- start start 2023-10-16T19:40:37.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181c6ca700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f181414c780 0x7f18140ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181c6ca700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814156c60 con 0x7f181406a880 2023-10-16T19:40:37.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181c6ca700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18141536f0 con 0x7f1814153290 2023-10-16T19:40:37.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181c6ca700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140ac7d0 con 0x7f181414c780 2023-10-16T19:40:37.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181ac67700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f181406a880 0x7f181406ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37946/0 (socket says 172.21.15.29:37946) 2023-10-16T19:40:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181ac67700 1 -- 172.21.15.29:0/4230506881 learned_addr learned my addr 172.21.15.29:0/4230506881 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f181a466700 1 --2- 172.21.15.29:0/4230506881 >> v2:172.21.15.53:3300/0 conn(0x7f181414c780 0x7f18140ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399643331 0 0) 0x7f1814156c60 con 0x7f181406a880 2023-10-16T19:40:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18000035b0 con 0x7f181406a880 2023-10-16T19:40:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406334076 0 0) 0x7f18000035b0 con 0x7f181406a880 2023-10-16T19:40:37.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 >> v2:172.21.15.53:3300/0 conn(0x7f181414c780 msgr2=0x7f18140ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 --2- 172.21.15.29:0/4230506881 >> v2:172.21.15.53:3300/0 conn(0x7f181414c780 0x7f18140ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 >> v1:172.21.15.53:6789/0 conn(0x7f1814153290 legacy=0x7f181406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814155ea0 con 0x7f181406a880 2023-10-16T19:40:37.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f180c0019f0 con 0x7f181406a880 2023-10-16T19:40:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 >> v1:172.21.15.29:6789/0 conn(0x7f181406a880 legacy=0x7f181406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1800003a00 0x7f1800003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 0x7f1800004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800005210 0x7f180000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140ac7d0 con 0x7f1800004850 2023-10-16T19:40:37.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180000c1b0 con 0x7f1800003a00 2023-10-16T19:40:37.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.434+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180000c370 con 0x7f1800005210 2023-10-16T19:40:37.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 0x7f1800004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f181a466700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1800003a00 0x7f1800003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f181ac67700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800005210 0x7f180000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 -- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800005210 msgr2=0x7f180000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800005210 0x7f180000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 -- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1800003a00 msgr2=0x7f1800003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1800003a00 0x7f1800003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 -- 172.21.15.29:0/4230506881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000035b0 con 0x7f1800004850 2023-10-16T19:40:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f181ac67700 1 -- 172.21.15.29:0/4230506881 reap_dead start 2023-10-16T19:40:37.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819c65700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 0x7f1800004cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f18040017c0 tx=0x7f1800005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21784b64bb5ade2e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040052d0 con 0x7f1800004850 2023-10-16T19:40:37.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804005430 con 0x7f1800004850 2023-10-16T19:40:37.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.435+0000 7f1819464700 1 -- 172.21.15.29:0/4230506881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040038c0 con 0x7f1800004850 2023-10-16T19:40:37.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 -- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 msgr2=0x7f1800004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 0x7f1800004cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f18040017c0 tx=0x7f1800005880 comp rx=0 tx=0).stop 2023-10-16T19:40:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 -- 172.21.15.29:0/4230506881 shutdown_connections 2023-10-16T19:40:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 --2- 172.21.15.29:0/4230506881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1800004850 0x7f1800004cd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 -- 172.21.15.29:0/4230506881 >> 172.21.15.29:0/4230506881 conn(0x7f18140c66d0 msgr2=0x7f18140c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 -- 172.21.15.29:0/4230506881 shutdown_connections 2023-10-16T19:40:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.436+0000 7f181c6ca700 1 -- 172.21.15.29:0/4230506881 wait complete. 2023-10-16T19:40:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.437+0000 7f181c6ca700 1 Processor -- start 2023-10-16T19:40:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.437+0000 7f181c6ca700 1 -- start start 2023-10-16T19:40:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 0x7f1814147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 0x7f1814142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181414bf70 con 0x7f1814142cc0 2023-10-16T19:40:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814143740 con 0x7f18141455f0 2023-10-16T19:40:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1814147a10 con 0x7f1800004850 2023-10-16T19:40:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52514/0 (socket says 172.21.15.29:52514) 2023-10-16T19:40:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 -- 172.21.15.29:0/3386738136 learned_addr learned my addr 172.21.15.29:0/3386738136 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f1819c65700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 0x7f1814142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181a466700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 0x7f1814147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 -- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 msgr2=0x7f1814147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 0x7f1814147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 -- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 msgr2=0x7f1814142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 0x7f1814142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 -- 172.21.15.29:0/3386738136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18141e9130 con 0x7f1814142cc0 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181a466700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 0x7f1814147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f1819c65700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 0x7f1814142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181ac67700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f80 tx=0x7f180c00a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00ad00 con 0x7f1814142cc0 2023-10-16T19:40:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00ae80 con 0x7f1814142cc0 2023-10-16T19:40:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18141e9410 con 0x7f1814142cc0 2023-10-16T19:40:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c013630 con 0x7f1814142cc0 2023-10-16T19:40:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.438+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814147660 con 0x7f1814142cc0 2023-10-16T19:40:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.439+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1814074a70 con 0x7f1814142cc0 2023-10-16T19:40:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.440+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f180c013790 con 0x7f1814142cc0 2023-10-16T19:40:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.440+0000 7f180affd700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 0x7f17f806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.440+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f180c08a940 con 0x7f1814142cc0 2023-10-16T19:40:37.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.441+0000 7f181a466700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 0x7f17f806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.441+0000 7f181a466700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 0x7f17f806d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1810009c60 tx=0x7f1810008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.444+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f180c055870 con 0x7f1814142cc0 2023-10-16T19:40:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.643+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f181404f400 con 0x7f1814142cc0 2023-10-16T19:40:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.643+0000 7f180affd700 1 -- 172.21.15.29:0/3386738136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f180c058e90 con 0x7f1814142cc0 2023-10-16T19:40:37.646 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 msgr2=0x7f17f806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 0x7f17f806d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1810009c60 tx=0x7f1810008040 comp rx=0 tx=0).stop 2023-10-16T19:40:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 msgr2=0x7f181414a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f80 tx=0x7f180c00a5f0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 shutdown_connections 2023-10-16T19:40:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f17f806af30 0x7f17f806d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1814142cc0 0x7f181414a180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1800004850 0x7f1814147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 --2- 172.21.15.29:0/3386738136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18141455f0 0x7f1814142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 >> 172.21.15.29:0/3386738136 conn(0x7f18140c66d0 msgr2=0x7f18140ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:37.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 shutdown_connections 2023-10-16T19:40:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.645+0000 7f181c6ca700 1 -- 172.21.15.29:0/3386738136 wait complete. 2023-10-16T19:40:37.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:37.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.786+0000 7f0eb35ca700 1 Processor -- start 2023-10-16T19:40:37.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.786+0000 7f0eb35ca700 1 -- start start 2023-10-16T19:40:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb35ca700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0eac06aaf0 0x7f0eac06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb35ca700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0eac152110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb35ca700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac06dcb0 con 0x7f0eac0c2760 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb35ca700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac152650 con 0x7f0eac06aaf0 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb35ca700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c1b60 con 0x7f0eac151cb0 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb0b65700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0eac0c2760 0x7f0eac158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37964/0 (socket says 172.21.15.29:37964) 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb0b65700 1 -- 172.21.15.29:0/1462805716 learned_addr learned my addr 172.21.15.29:0/1462805716 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb1366700 1 --2- 172.21.15.29:0/1462805716 >> v2:172.21.15.53:3300/0 conn(0x7f0eac06aaf0 0x7f0eac06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0eb1b67700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0eac152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561904581 0 0) 0x7f0eac06dcb0 con 0x7f0eac0c2760 2023-10-16T19:40:37.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.787+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e980035b0 con 0x7f0eac0c2760 2023-10-16T19:40:37.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2271075749 0 0) 0x7f0e980035b0 con 0x7f0eac0c2760 2023-10-16T19:40:37.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 msgr2=0x7f0eac152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0eac152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 >> v2:172.21.15.53:3300/0 conn(0x7f0eac06aaf0 msgr2=0x7f0eac06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/1462805716 >> v2:172.21.15.53:3300/0 conn(0x7f0eac06aaf0 0x7f0eac06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0c1e40 con 0x7f0eac0c2760 2023-10-16T19:40:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f0ea8001670 con 0x7f0eac0c2760 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 >> v1:172.21.15.29:6789/0 conn(0x7f0eac0c2760 legacy=0x7f0eac158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98003a00 0x7f0e98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0e98004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98004d90 0x7f0e98005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac152650 con 0x7f0e98003a00 2023-10-16T19:40:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c1b60 con 0x7f0e98004d90 2023-10-16T19:40:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800ba10 con 0x7f0eac151cb0 2023-10-16T19:40:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98003a00 0x7f0e98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb0b65700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0e98004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1b67700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98004d90 0x7f0e98005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 -- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 msgr2=0x7f0e98004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac151cb0 0x7f0e98004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 -- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98004d90 msgr2=0x7f0e98005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98004d90 0x7f0e98005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 -- 172.21.15.29:0/1462805716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980035b0 con 0x7f0e98003a00 2023-10-16T19:40:37.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1b67700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98004d90 0x7f0e98005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:37.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0eb1366700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98003a00 0x7f0e98003e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009b90 tx=0x7f0e98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdb110427099d9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00e6c0 con 0x7f0e98003a00 2023-10-16T19:40:37.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00e820 con 0x7f0e98003a00 2023-10-16T19:40:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.788+0000 7f0ea3fff700 1 -- 172.21.15.29:0/1462805716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00eb90 con 0x7f0e98003a00 2023-10-16T19:40:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 -- 172.21.15.29:0/1462805716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98003a00 msgr2=0x7f0e98003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/1462805716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98003a00 0x7f0e98003e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009b90 tx=0x7f0e98005880 comp rx=0 tx=0).stop 2023-10-16T19:40:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb1b67700 1 -- 172.21.15.29:0/1462805716 reap_dead start 2023-10-16T19:40:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 -- 172.21.15.29:0/1462805716 shutdown_connections 2023-10-16T19:40:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 -- 172.21.15.29:0/1462805716 >> 172.21.15.29:0/1462805716 conn(0x7f0eac0c7100 msgr2=0x7f0eac0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 -- 172.21.15.29:0/1462805716 shutdown_connections 2023-10-16T19:40:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.789+0000 7f0eb35ca700 1 -- 172.21.15.29:0/1462805716 wait complete. 2023-10-16T19:40:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.790+0000 7f0eb35ca700 1 Processor -- start 2023-10-16T19:40:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.790+0000 7f0eb35ca700 1 -- start start 2023-10-16T19:40:37.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98003a00 0x7f0eac144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 0x7f0eac1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1459b0 con 0x7f0eac1e0060 2023-10-16T19:40:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c6c70 con 0x7f0e98003a00 2023-10-16T19:40:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb35ca700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1dfc50 con 0x7f0eac154f00 2023-10-16T19:40:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52532/0 (socket says 172.21.15.29:52532) 2023-10-16T19:40:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 -- 172.21.15.29:0/3369164897 learned_addr learned my addr 172.21.15.29:0/3369164897 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:37.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb1366700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98003a00 0x7f0eac144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb1b67700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 0x7f0eac1ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 -- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 msgr2=0x7f0eac1ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 0x7f0eac1ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 -- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98003a00 msgr2=0x7f0eac144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98003a00 0x7f0eac144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 -- 172.21.15.29:0/3369164897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac145420 con 0x7f0eac1e0060 2023-10-16T19:40:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb1b67700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 0x7f0eac1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.791+0000 7f0eb0b65700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e8f0 tx=0x7f0ea800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.792+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8012590 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.792+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea8012710 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.792+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8012ac0 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.792+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac1456d0 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.792+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac1df8e0 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.793+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac1552e0 con 0x7f0eac1e0060 2023-10-16T19:40:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.793+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ea8012c20 con 0x7f0eac1e0060 2023-10-16T19:40:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.794+0000 7f0ea1ffb700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 0x7f0e9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.794+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ea8089630 con 0x7f0eac1e0060 2023-10-16T19:40:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.794+0000 7f0eb1366700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 0x7f0e9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.794+0000 7f0eb1366700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 0x7f0e9006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0090b0 tx=0x7f0e9c01f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.798+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ea80543e0 con 0x7f0eac1e0060 2023-10-16T19:40:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.997+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eac04f400 con 0x7f0eac1e0060 2023-10-16T19:40:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.997+0000 7f0ea1ffb700 1 -- 172.21.15.29:0/3369164897 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ea8012ed0 con 0x7f0eac1e0060 2023-10-16T19:40:38.000 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:38.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 msgr2=0x7f0e9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 0x7f0e9006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0090b0 tx=0x7f0e9c01f040 comp rx=0 tx=0).stop 2023-10-16T19:40:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 msgr2=0x7f0eac1549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e8f0 tx=0x7f0ea800ec00 comp rx=0 tx=0).stop 2023-10-16T19:40:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 shutdown_connections 2023-10-16T19:40:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e9006af00 0x7f0e9006d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0eac154f00 0x7f0eac1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e98003a00 0x7f0eac144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 --2- 172.21.15.29:0/3369164897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eac1e0060 0x7f0eac1549c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 >> 172.21.15.29:0/3369164897 conn(0x7f0eac0c7100 msgr2=0x7f0eac14de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 shutdown_connections 2023-10-16T19:40:38.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:37.999+0000 7f0eb35ca700 1 -- 172.21.15.29:0/3369164897 wait complete. 2023-10-16T19:40:38.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.140+0000 7f62cb9f8700 1 Processor -- start 2023-10-16T19:40:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.140+0000 7f62cb9f8700 1 -- start start 2023-10-16T19:40:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62cb9f8700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62c40c3350 0x7f62c41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62cb9f8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62c406db00 0x7f62c406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62cb9f8700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c4155af0 con 0x7f62c414ec50 2023-10-16T19:40:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62cb9f8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c4152300 con 0x7f62c406db00 2023-10-16T19:40:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62cb9f8700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40c2e40 con 0x7f62c40c3350 2023-10-16T19:40:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62c406db00 0x7f62c406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62c406db00 0x7f62c406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52542/0 (socket says 172.21.15.29:52542) 2023-10-16T19:40:38.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 -- 172.21.15.29:0/3593995710 learned_addr learned my addr 172.21.15.29:0/3593995710 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:38.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c8f93700 1 --2- 172.21.15.29:0/3593995710 >> v2:172.21.15.53:3300/0 conn(0x7f62c40c3350 0x7f62c41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 -- 172.21.15.29:0/3593995710 >> v2:172.21.15.53:3300/0 conn(0x7f62c40c3350 msgr2=0x7f62c41555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:38.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 --2- 172.21.15.29:0/3593995710 >> v2:172.21.15.53:3300/0 conn(0x7f62c40c3350 0x7f62c41555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 -- 172.21.15.29:0/3593995710 >> v1:172.21.15.53:6789/0 conn(0x7f62c414ec50 legacy=0x7f62c4071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 -- 172.21.15.29:0/3593995710 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c414f030 con 0x7f62c406db00 2023-10-16T19:40:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62c9f95700 1 --2- 172.21.15.29:0/3593995710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c406db00 0x7f62c406df90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c4ab0 tx=0x7f62bc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eb716049169f9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.141+0000 7f62bbfff700 1 -- 172.21.15.29:0/3593995710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc010070 con 0x7f62c406db00 2023-10-16T19:40:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62bbfff700 1 -- 172.21.15.29:0/3593995710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00dce0 con 0x7f62c406db00 2023-10-16T19:40:38.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62bbfff700 1 -- 172.21.15.29:0/3593995710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00b310 con 0x7f62c406db00 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 -- 172.21.15.29:0/3593995710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c406db00 msgr2=0x7f62c406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/3593995710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c406db00 0x7f62c406df90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c4ab0 tx=0x7f62bc00d430 comp rx=0 tx=0).stop 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 -- 172.21.15.29:0/3593995710 shutdown_connections 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/3593995710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c406db00 0x7f62c406df90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/3593995710 >> v2:172.21.15.53:3300/0 conn(0x7f62c40c3350 0x7f62c41555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 -- 172.21.15.29:0/3593995710 >> 172.21.15.29:0/3593995710 conn(0x7f62c40c7110 msgr2=0x7f62c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 -- 172.21.15.29:0/3593995710 shutdown_connections 2023-10-16T19:40:38.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.142+0000 7f62cb9f8700 1 -- 172.21.15.29:0/3593995710 wait complete. 2023-10-16T19:40:38.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.143+0000 7f62cb9f8700 1 Processor -- start 2023-10-16T19:40:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.143+0000 7f62cb9f8700 1 -- start start 2023-10-16T19:40:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 0x7f62c4144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 0x7f62c41ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40a94b0 con 0x7f62c414ec50 2023-10-16T19:40:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c4c80 con 0x7f62c40c3350 2023-10-16T19:40:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62cb9f8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c5ff0 con 0x7f62c406db00 2023-10-16T19:40:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c9f95700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c9f95700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52548/0 (socket says 172.21.15.29:52548) 2023-10-16T19:40:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c9f95700 1 -- 172.21.15.29:0/4103640594 learned_addr learned my addr 172.21.15.29:0/4103640594 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:38.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c9f95700 1 -- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 msgr2=0x7f62c4144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c8f93700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 0x7f62c41ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.144+0000 7f62c9794700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 0x7f62c4144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9f95700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 0x7f62c4144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9f95700 1 -- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 msgr2=0x7f62c41ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9f95700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 0x7f62c41ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9f95700 1 -- 172.21.15.29:0/4103640594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc00bd40 con 0x7f62c414ec50 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c8f93700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 0x7f62c41ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9794700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 0x7f62c4144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62c9f95700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d470 tx=0x7f62bc004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc009a10 con 0x7f62c414ec50 2023-10-16T19:40:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc009b70 con 0x7f62c414ec50 2023-10-16T19:40:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c40c62d0 con 0x7f62c414ec50 2023-10-16T19:40:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc004040 con 0x7f62c414ec50 2023-10-16T19:40:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.145+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c41ee3a0 con 0x7f62c414ec50 2023-10-16T19:40:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.146+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404f400 con 0x7f62c414ec50 2023-10-16T19:40:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.147+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62bc0041a0 con 0x7f62c414ec50 2023-10-16T19:40:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.147+0000 7f62b9ffb700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 0x7f62a806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.147+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62bc08af60 con 0x7f62c414ec50 2023-10-16T19:40:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.147+0000 7f62c9794700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 0x7f62a806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.148+0000 7f62c9794700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 0x7f62a806d410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62c0000f60 tx=0x7f62c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.151+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62bc0bdca0 con 0x7f62c414ec50 2023-10-16T19:40:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.353+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62c4154d90 con 0x7f62c414ec50 2023-10-16T19:40:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.353+0000 7f62b9ffb700 1 -- 172.21.15.29:0/4103640594 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62bc0210a0 con 0x7f62c414ec50 2023-10-16T19:40:38.356 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 msgr2=0x7f62a806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 0x7f62a806d410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62c0000f60 tx=0x7f62c0009040 comp rx=0 tx=0).stop 2023-10-16T19:40:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 msgr2=0x7f62c40c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00d470 tx=0x7f62bc004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 shutdown_connections 2023-10-16T19:40:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f62a806af50 0x7f62a806d410 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62c414ec50 0x7f62c40c02e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62c406db00 0x7f62c4144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 --2- 172.21.15.29:0/4103640594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40c3350 0x7f62c41ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 >> 172.21.15.29:0/4103640594 conn(0x7f62c40c7110 msgr2=0x7f62c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 shutdown_connections 2023-10-16T19:40:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.355+0000 7f62cb9f8700 1 -- 172.21.15.29:0/4103640594 wait complete. 2023-10-16T19:40:38.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:38.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.492+0000 7f89e8449700 1 Processor -- start 2023-10-16T19:40:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.492+0000 7f89e8449700 1 -- start start 2023-10-16T19:40:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e8449700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e00c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e8449700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89e00c0d30 0x7f89e00c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e8449700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00c5260 con 0x7f89e00c1860 2023-10-16T19:40:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e8449700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00c4650 con 0x7f89e00c0d30 2023-10-16T19:40:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e8449700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00c4930 con 0x7f89e01550b0 2023-10-16T19:40:38.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e69e6700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f89e00c1860 0x7f89e0070dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38000/0 (socket says 172.21.15.29:38000) 2023-10-16T19:40:38.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e69e6700 1 -- 172.21.15.29:0/1490459640 learned_addr learned my addr 172.21.15.29:0/1490459640 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:38.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e59e4700 1 --2- 172.21.15.29:0/1490459640 >> v2:172.21.15.53:3300/0 conn(0x7f89e00c0d30 0x7f89e00c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e61e5700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e00c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e51e3700 1 -- 172.21.15.29:0/1490459640 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698271343 0 0) 0x7f89e00c5260 con 0x7f89e00c1860 2023-10-16T19:40:38.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e51e3700 1 -- 172.21.15.29:0/1490459640 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89cc0035b0 con 0x7f89e00c1860 2023-10-16T19:40:38.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e59e4700 1 -- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 msgr2=0x7f89e00c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:38.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e59e4700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e00c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e59e4700 1 -- 172.21.15.29:0/1490459640 >> v1:172.21.15.29:6789/0 conn(0x7f89e00c1860 legacy=0x7f89e0070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.493+0000 7f89e59e4700 1 -- 172.21.15.29:0/1490459640 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00c4c10 con 0x7f89e00c0d30 2023-10-16T19:40:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e59e4700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e00c1320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009840 tx=0x7f89d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9683e0a0fe46bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e51e3700 1 -- 172.21.15.29:0/1490459640 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0011830 con 0x7f89e00c0d30 2023-10-16T19:40:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e51e3700 1 -- 172.21.15.29:0/1490459640 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0011990 con 0x7f89e00c0d30 2023-10-16T19:40:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e51e3700 1 -- 172.21.15.29:0/1490459640 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0011d20 con 0x7f89e00c0d30 2023-10-16T19:40:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e8449700 1 -- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 msgr2=0x7f89e00c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.494+0000 7f89e8449700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e00c1320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009840 tx=0x7f89d0009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 -- 172.21.15.29:0/1490459640 shutdown_connections 2023-10-16T19:40:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e00c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 --2- 172.21.15.29:0/1490459640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e00c1320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 -- 172.21.15.29:0/1490459640 >> 172.21.15.29:0/1490459640 conn(0x7f89e00a8070 msgr2=0x7f89e00c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 -- 172.21.15.29:0/1490459640 shutdown_connections 2023-10-16T19:40:38.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.495+0000 7f89e8449700 1 -- 172.21.15.29:0/1490459640 wait complete. 2023-10-16T19:40:38.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 Processor -- start 2023-10-16T19:40:38.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 -- start start 2023-10-16T19:40:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e0146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e0144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00bbad0 con 0x7f89e00c1860 2023-10-16T19:40:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00a7520 con 0x7f89e00c0d30 2023-10-16T19:40:38.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.496+0000 7f89e8449700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00c31b0 con 0x7f89e01550b0 2023-10-16T19:40:38.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52560/0 (socket says 172.21.15.29:52560) 2023-10-16T19:40:38.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 -- 172.21.15.29:0/4224661488 learned_addr learned my addr 172.21.15.29:0/4224661488 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:38.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e61e5700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e0146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e69e6700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e0144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 -- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 msgr2=0x7f89e0144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e0144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 -- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 msgr2=0x7f89e0146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e0146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 -- 172.21.15.29:0/4224661488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00094a0 con 0x7f89e00c1860 2023-10-16T19:40:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e59e4700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89d00090b0 tx=0x7f89d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0004590 con 0x7f89e00c1860 2023-10-16T19:40:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d001f070 con 0x7f89e00c1860 2023-10-16T19:40:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e00a77c0 con 0x7f89e00c1860 2023-10-16T19:40:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00038e0 con 0x7f89e00c1860 2023-10-16T19:40:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.497+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e01442d0 con 0x7f89e00c1860 2023-10-16T19:40:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.498+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e0070570 con 0x7f89e00c1860 2023-10-16T19:40:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.499+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f89d0003a40 con 0x7f89e00c1860 2023-10-16T19:40:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.499+0000 7f89d6ffd700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 0x7f89c406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.499+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89d0021070 con 0x7f89e00c1860 2023-10-16T19:40:38.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.499+0000 7f89e61e5700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 0x7f89c406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.500+0000 7f89e61e5700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 0x7f89c406d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009b20 tx=0x7f89dc0091c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.504+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89d0055dc0 con 0x7f89e00c1860 2023-10-16T19:40:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.703+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89e004f400 con 0x7f89e00c1860 2023-10-16T19:40:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.704+0000 7f89d6ffd700 1 -- 172.21.15.29:0/4224661488 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f89d00593e0 con 0x7f89e00c1860 2023-10-16T19:40:38.707 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:38.707 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 msgr2=0x7f89c406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 0x7f89c406d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009b20 tx=0x7f89dc0091c0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 msgr2=0x7f89e00a6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89d00090b0 tx=0x7f89d0004750 comp rx=0 tx=0).stop 2023-10-16T19:40:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 shutdown_connections 2023-10-16T19:40:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f89c406af30 0x7f89c406d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f89e01550b0 0x7f89e0144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e00c0d30 0x7f89e0146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 --2- 172.21.15.29:0/4224661488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89e00c1860 0x7f89e00a6ce0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 >> 172.21.15.29:0/4224661488 conn(0x7f89e00a8070 msgr2=0x7f89e00bf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 shutdown_connections 2023-10-16T19:40:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.706+0000 7f89e8449700 1 -- 172.21.15.29:0/4224661488 wait complete. 2023-10-16T19:40:38.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:38.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.847+0000 7f34a7d2c700 1 Processor -- start 2023-10-16T19:40:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.847+0000 7f34a7d2c700 1 -- start start 2023-10-16T19:40:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a7d2c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34a014e460 0x7f34a006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a7d2c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 0x7f34a0070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a7d2c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a0154e10 con 0x7f34a006df10 2023-10-16T19:40:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a7d2c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a0150e10 con 0x7f34a014e460 2023-10-16T19:40:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a7d2c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00c28c0 con 0x7f34a00c2d10 2023-10-16T19:40:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a5ac8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34a014e460 0x7f34a006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a5ac8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34a014e460 0x7f34a006d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52566/0 (socket says 172.21.15.29:52566) 2023-10-16T19:40:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.848+0000 7f34a5ac8700 1 -- 172.21.15.29:0/3574592832 learned_addr learned my addr 172.21.15.29:0/3574592832 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a5ac8700 1 -- 172.21.15.29:0/3574592832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 msgr2=0x7f34a0070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a52c7700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 0x7f34a0070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a5ac8700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 0x7f34a0070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a5ac8700 1 -- 172.21.15.29:0/3574592832 >> v1:172.21.15.53:6789/0 conn(0x7f34a006df10 legacy=0x7f34a006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a5ac8700 1 -- 172.21.15.29:0/3574592832 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0155340 con 0x7f34a014e460 2023-10-16T19:40:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a52c7700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 0x7f34a0070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:38.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a5ac8700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a014e460 0x7f34a006d9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f34900098f0 tx=0x7f3490009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f48317e5c346895 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a4ac6700 1 -- 172.21.15.29:0/3574592832 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000b8a0 con 0x7f34a014e460 2023-10-16T19:40:38.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a4ac6700 1 -- 172.21.15.29:0/3574592832 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000ba00 con 0x7f34a014e460 2023-10-16T19:40:38.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a4ac6700 1 -- 172.21.15.29:0/3574592832 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000bd90 con 0x7f34a014e460 2023-10-16T19:40:38.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 -- 172.21.15.29:0/3574592832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a014e460 msgr2=0x7f34a006d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a014e460 0x7f34a006d9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f34900098f0 tx=0x7f3490009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 -- 172.21.15.29:0/3574592832 shutdown_connections 2023-10-16T19:40:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a014e460 0x7f34a006d9d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/3574592832 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a00c2d10 0x7f34a0070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.849+0000 7f34a7d2c700 1 -- 172.21.15.29:0/3574592832 >> 172.21.15.29:0/3574592832 conn(0x7f34a00c66d0 msgr2=0x7f34a00c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:38.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.850+0000 7f34a7d2c700 1 -- 172.21.15.29:0/3574592832 shutdown_connections 2023-10-16T19:40:38.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.850+0000 7f34a7d2c700 1 -- 172.21.15.29:0/3574592832 wait complete. 2023-10-16T19:40:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 Processor -- start 2023-10-16T19:40:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 -- start start 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a006df10 0x7f34a01eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 0x7f34a00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00aa750 con 0x7f34a00c2d10 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00a9490 con 0x7f34a006df10 2023-10-16T19:40:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a7d2c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00aaca0 con 0x7f34a014e460 2023-10-16T19:40:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.851+0000 7f34a52c7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52574/0 (socket says 172.21.15.29:52574) 2023-10-16T19:40:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 -- 172.21.15.29:0/60571150 learned_addr learned my addr 172.21.15.29:0/60571150 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a5ac8700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a006df10 0x7f34a01eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a62c9700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 0x7f34a00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 -- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 msgr2=0x7f34a00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 0x7f34a00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 -- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a006df10 msgr2=0x7f34a01eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a006df10 0x7f34a01eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 -- 172.21.15.29:0/60571150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009550 con 0x7f34a00c2d10 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a62c9700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 0x7f34a00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a52c7700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c820 tx=0x7f349c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011800 con 0x7f34a00c2d10 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c011960 con 0x7f34a00c2d10 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a01eba10 con 0x7f34a00c2d10 2023-10-16T19:40:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011d10 con 0x7f34a00c2d10 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.852+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00a99c0 con 0x7f34a00c2d10 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.853+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a004f400 con 0x7f34a00c2d10 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.854+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f349c018360 con 0x7f34a00c2d10 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.854+0000 7f34967fc700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 0x7f348406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.854+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f349c0897c0 con 0x7f34a00c2d10 2023-10-16T19:40:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.855+0000 7f34a5ac8700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 0x7f348406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:38.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.855+0000 7f34a5ac8700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 0x7f348406d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3490014040 tx=0x7f3490008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:38.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:38.859+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f349c054610 con 0x7f34a00c2d10 2023-10-16T19:40:39.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.058+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34a00aade0 con 0x7f34a00c2d10 2023-10-16T19:40:39.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.058+0000 7f34967fc700 1 -- 172.21.15.29:0/60571150 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f349c057c30 con 0x7f34a00c2d10 2023-10-16T19:40:39.061 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 msgr2=0x7f348406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 0x7f348406d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3490014040 tx=0x7f3490008030 comp rx=0 tx=0).stop 2023-10-16T19:40:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 msgr2=0x7f34a0147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c820 tx=0x7f349c00cb30 comp rx=0 tx=0).stop 2023-10-16T19:40:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 shutdown_connections 2023-10-16T19:40:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f348406af00 0x7f348406d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34a014e460 0x7f34a00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a006df10 0x7f34a01eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 --2- 172.21.15.29:0/60571150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34a00c2d10 0x7f34a0147340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 >> 172.21.15.29:0/60571150 conn(0x7f34a00c66d0 msgr2=0x7f34a00c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 shutdown_connections 2023-10-16T19:40:39.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.060+0000 7f34a7d2c700 1 -- 172.21.15.29:0/60571150 wait complete. 2023-10-16T19:40:39.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.200+0000 7f112d035700 1 Processor -- start 2023-10-16T19:40:39.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.200+0000 7f112d035700 1 -- start start 2023-10-16T19:40:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.201+0000 7f112d035700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11280cac40 0x7f1128154a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.201+0000 7f112d035700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 0x7f11280bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.201+0000 7f112d035700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11280c6420 con 0x7f1128158670 2023-10-16T19:40:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.201+0000 7f112d035700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11280bff90 con 0x7f11280cac40 2023-10-16T19:40:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.201+0000 7f112d035700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11280c6670 con 0x7f11280c4c40 2023-10-16T19:40:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11280cac40 0x7f1128154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f112759e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1128158670 0x7f1128151b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38028/0 (socket says 172.21.15.29:38028) 2023-10-16T19:40:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11280cac40 0x7f1128154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52580/0 (socket says 172.21.15.29:52580) 2023-10-16T19:40:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f112759e700 1 -- 172.21.15.29:0/333317886 learned_addr learned my addr 172.21.15.29:0/333317886 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:39.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f112659c700 1 --2- 172.21.15.29:0/333317886 >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 0x7f11280bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 -- 172.21.15.29:0/333317886 >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 msgr2=0x7f11280bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:39.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 --2- 172.21.15.29:0/333317886 >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 0x7f11280bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 -- 172.21.15.29:0/333317886 >> v1:172.21.15.29:6789/0 conn(0x7f1128158670 legacy=0x7f1128151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 -- 172.21.15.29:0/333317886 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280c6950 con 0x7f11280cac40 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1125d9b700 1 -- 172.21.15.29:0/333317886 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062495743 0 0) 0x7f11280c6420 con 0x7f1128158670 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f112659c700 1 --2- 172.21.15.29:0/333317886 >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 0x7f11280bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1126d9d700 1 --2- 172.21.15.29:0/333317886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f1128154a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aba03ae09a7c96c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1125d9b700 1 -- 172.21.15.29:0/333317886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011830 con 0x7f11280cac40 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1125d9b700 1 -- 172.21.15.29:0/333317886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011990 con 0x7f11280cac40 2023-10-16T19:40:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.202+0000 7f1125d9b700 1 -- 172.21.15.29:0/333317886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011d20 con 0x7f11280cac40 2023-10-16T19:40:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 -- 172.21.15.29:0/333317886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 msgr2=0x7f1128154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 --2- 172.21.15.29:0/333317886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f1128154a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 -- 172.21.15.29:0/333317886 shutdown_connections 2023-10-16T19:40:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 --2- 172.21.15.29:0/333317886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f1128154a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 --2- 172.21.15.29:0/333317886 >> v2:172.21.15.53:3300/0 conn(0x7f11280c4c40 0x7f11280bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 -- 172.21.15.29:0/333317886 >> 172.21.15.29:0/333317886 conn(0x7f11280ac500 msgr2=0x7f11280ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 -- 172.21.15.29:0/333317886 shutdown_connections 2023-10-16T19:40:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.203+0000 7f112d035700 1 -- 172.21.15.29:0/333317886 wait complete. 2023-10-16T19:40:39.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.204+0000 7f112d035700 1 Processor -- start 2023-10-16T19:40:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.204+0000 7f112d035700 1 -- start start 2023-10-16T19:40:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280c4c40 0x7f11280c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1128158670 0x7f11281ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11281541b0 con 0x7f11280cac40 2023-10-16T19:40:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1128153160 con 0x7f1128158670 2023-10-16T19:40:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112d035700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1128153440 con 0x7f11280c4c40 2023-10-16T19:40:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52588/0 (socket says 172.21.15.29:52588) 2023-10-16T19:40:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 -- 172.21.15.29:0/237866937 learned_addr learned my addr 172.21.15.29:0/237866937 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112759e700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1128158670 0x7f11281ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f1126d9d700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280c4c40 0x7f11280c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 -- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280c4c40 msgr2=0x7f11280c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280c4c40 0x7f11280c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 -- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1128158670 msgr2=0x7f11281ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1128158670 0x7f11281ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 -- 172.21.15.29:0/237866937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0094a0 con 0x7f11280cac40 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.205+0000 7f112659c700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f111800c740 tx=0x7f111800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.206+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118004220 con 0x7f11280cac40 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.206+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1118004380 con 0x7f11280cac40 2023-10-16T19:40:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.206+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1128154400 con 0x7f11280cac40 2023-10-16T19:40:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.206+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180036a0 con 0x7f11280cac40 2023-10-16T19:40:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.206+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11280c8ab0 con 0x7f11280cac40 2023-10-16T19:40:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.207+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1128153600 con 0x7f11280cac40 2023-10-16T19:40:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.207+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1118003800 con 0x7f11280cac40 2023-10-16T19:40:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.208+0000 7f110f7fe700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 0x7f111406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.208+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1118089bd0 con 0x7f11280cac40 2023-10-16T19:40:39.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.208+0000 7f1126d9d700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 0x7f111406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.208+0000 7f1126d9d700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 0x7f111406d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f111c0090b0 tx=0x7f111c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.212+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11180549a0 con 0x7f11280cac40 2023-10-16T19:40:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.412+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1128154920 con 0x7f11280cac40 2023-10-16T19:40:39.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.413+0000 7f110f7fe700 1 -- 172.21.15.29:0/237866937 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1128154920 con 0x7f11280cac40 2023-10-16T19:40:39.415 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 msgr2=0x7f111406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 0x7f111406d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f111c0090b0 tx=0x7f111c008030 comp rx=0 tx=0).stop 2023-10-16T19:40:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 msgr2=0x7f11281ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f111800c740 tx=0x7f111800cb00 comp rx=0 tx=0).stop 2023-10-16T19:40:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 shutdown_connections 2023-10-16T19:40:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f111406af30 0x7f111406d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1128158670 0x7f11281ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f11280c4c40 0x7f11280c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 --2- 172.21.15.29:0/237866937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11280cac40 0x7f11281ecd90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 >> 172.21.15.29:0/237866937 conn(0x7f11280ac500 msgr2=0x7f11280ab250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 shutdown_connections 2023-10-16T19:40:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.415+0000 7f112d035700 1 -- 172.21.15.29:0/237866937 wait complete. 2023-10-16T19:40:39.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:39.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 Processor -- start 2023-10-16T19:40:39.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 -- start start 2023-10-16T19:40:39.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f93541583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f935413dd00 0x7f9354158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9354158e40 con 0x7f935413d660 2023-10-16T19:40:39.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935406d320 con 0x7f935413dd00 2023-10-16T19:40:39.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.556+0000 7f935a3ee700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935406e780 con 0x7f9354154a50 2023-10-16T19:40:39.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f935413dd00 0x7f9354158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f9353fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f935413d660 0x7f935406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38038/0 (socket says 172.21.15.29:38038) 2023-10-16T19:40:39.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f935413dd00 0x7f9354158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52598/0 (socket says 172.21.15.29:52598) 2023-10-16T19:40:39.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f9353fff700 1 -- 172.21.15.29:0/808666579 learned_addr learned my addr 172.21.15.29:0/808666579 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:39.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f93537fe700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f93541583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 -- 172.21.15.29:0/808666579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 msgr2=0x7f93541583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:39.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f93541583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 -- 172.21.15.29:0/808666579 >> v1:172.21.15.29:6789/0 conn(0x7f935413d660 legacy=0x7f935406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 -- 172.21.15.29:0/808666579 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354154f10 con 0x7f935413dd00 2023-10-16T19:40:39.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f935898b700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413dd00 0x7f9354158900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f934c009d90 tx=0x7f934c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94730395c4172f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f9352ffd700 1 -- 172.21.15.29:0/808666579 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00e070 con 0x7f935413dd00 2023-10-16T19:40:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f9352ffd700 1 -- 172.21.15.29:0/808666579 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00bbd0 con 0x7f935413dd00 2023-10-16T19:40:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.557+0000 7f9352ffd700 1 -- 172.21.15.29:0/808666579 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c012430 con 0x7f935413dd00 2023-10-16T19:40:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 -- 172.21.15.29:0/808666579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413dd00 msgr2=0x7f9354158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413dd00 0x7f9354158900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f934c009d90 tx=0x7f934c00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 -- 172.21.15.29:0/808666579 shutdown_connections 2023-10-16T19:40:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413dd00 0x7f9354158900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 --2- 172.21.15.29:0/808666579 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f93541583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 -- 172.21.15.29:0/808666579 >> 172.21.15.29:0/808666579 conn(0x7f93540c7110 msgr2=0x7f93540c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 -- 172.21.15.29:0/808666579 shutdown_connections 2023-10-16T19:40:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.558+0000 7f935a3ee700 1 -- 172.21.15.29:0/808666579 wait complete. 2023-10-16T19:40:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.559+0000 7f935a3ee700 1 Processor -- start 2023-10-16T19:40:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.559+0000 7f935a3ee700 1 -- start start 2023-10-16T19:40:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f935413dd00 0x7f93540c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f9354156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93541382b0 con 0x7f935413d660 2023-10-16T19:40:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354158060 con 0x7f935413dd00 2023-10-16T19:40:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935a3ee700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9354157b10 con 0x7f9354154a50 2023-10-16T19:40:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52600/0 (socket says 172.21.15.29:52600) 2023-10-16T19:40:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 -- 172.21.15.29:0/1607633028 learned_addr learned my addr 172.21.15.29:0/1607633028 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f93537fe700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f935413dd00 0x7f93540c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f935898b700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f9354156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 -- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 msgr2=0x7f9354156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f9354156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 -- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f935413dd00 msgr2=0x7f93540c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f935413dd00 0x7f93540c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 -- 172.21.15.29:0/1607633028 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009a70 con 0x7f935413d660 2023-10-16T19:40:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.560+0000 7f9353fff700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f934400c4b0 tx=0x7f934400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.561+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344005d70 con 0x7f935413d660 2023-10-16T19:40:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.561+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93440070d0 con 0x7f935413d660 2023-10-16T19:40:39.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.561+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93540c4ba0 con 0x7f935413d660 2023-10-16T19:40:39.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.561+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344007440 con 0x7f935413d660 2023-10-16T19:40:39.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.561+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93540c4e40 con 0x7f935413d660 2023-10-16T19:40:39.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.562+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93540c3760 con 0x7f935413d660 2023-10-16T19:40:39.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.562+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93440075a0 con 0x7f935413d660 2023-10-16T19:40:39.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.563+0000 7f9350ff9700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 0x7f934006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.563+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9344088b70 con 0x7f935413d660 2023-10-16T19:40:39.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.563+0000 7f93537fe700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 0x7f934006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.563+0000 7f93537fe700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 0x7f934006d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f93540c3530 tx=0x7f9348008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.567+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9344053a70 con 0x7f935413d660 2023-10-16T19:40:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.768+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f935404f400 con 0x7f935413d660 2023-10-16T19:40:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.769+0000 7f9350ff9700 1 -- 172.21.15.29:0/1607633028 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93440170a0 con 0x7f935413d660 2023-10-16T19:40:39.774 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 msgr2=0x7f934006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 0x7f934006d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f93540c3530 tx=0x7f9348008040 comp rx=0 tx=0).stop 2023-10-16T19:40:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 msgr2=0x7f935413cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f934400c4b0 tx=0x7f934400c870 comp rx=0 tx=0).stop 2023-10-16T19:40:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 shutdown_connections 2023-10-16T19:40:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f934006af30 0x7f934006d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9354154a50 0x7f9354156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935413d660 0x7f935413cb40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 --2- 172.21.15.29:0/1607633028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f935413dd00 0x7f93540c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 >> 172.21.15.29:0/1607633028 conn(0x7f93540c7110 msgr2=0x7f93540c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 shutdown_connections 2023-10-16T19:40:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.771+0000 7f935a3ee700 1 -- 172.21.15.29:0/1607633028 wait complete. 2023-10-16T19:40:39.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:39.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.910+0000 7fbbbce53700 1 Processor -- start 2023-10-16T19:40:39.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.910+0000 7fbbbce53700 1 -- start start 2023-10-16T19:40:39.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbb813d660 0x7fbbb806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbb8154a50 0x7fbbb81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 0x7fbbb8158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb806d320 con 0x7fbbb813d660 2023-10-16T19:40:39.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8158e40 con 0x7fbbb8154a50 2023-10-16T19:40:39.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.911+0000 7fbbbce53700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb806e780 con 0x7fbbb806adc0 2023-10-16T19:40:39.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbb813d660 0x7fbbb806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbb813d660 0x7fbbb806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52608/0 (socket says 172.21.15.29:52608) 2023-10-16T19:40:39.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 -- 172.21.15.29:0/1066972101 learned_addr learned my addr 172.21.15.29:0/1066972101 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:39.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb5d9b700 1 --2- 172.21.15.29:0/1066972101 >> v2:172.21.15.53:3300/0 conn(0x7fbbb8154a50 0x7fbbb81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb6d9d700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 0x7fbbb8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 -- 172.21.15.29:0/1066972101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 msgr2=0x7fbbb8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:39.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 0x7fbbb8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 -- 172.21.15.29:0/1066972101 >> v2:172.21.15.53:3300/0 conn(0x7fbbb8154a50 msgr2=0x7fbbb81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:39.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 --2- 172.21.15.29:0/1066972101 >> v2:172.21.15.53:3300/0 conn(0x7fbbb8154a50 0x7fbbb81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 -- 172.21.15.29:0/1066972101 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8154f10 con 0x7fbbb813d660 2023-10-16T19:40:39.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb6d9d700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 0x7fbbb8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:39.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb659c700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb813d660 0x7fbbb806a880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1780 tx=0x7fbbac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c591030ad07c9bad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb559a700 1 -- 172.21.15.29:0/1066972101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00b870 con 0x7fbbb813d660 2023-10-16T19:40:39.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb559a700 1 -- 172.21.15.29:0/1066972101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00b9d0 con 0x7fbbb813d660 2023-10-16T19:40:39.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.912+0000 7fbbb559a700 1 -- 172.21.15.29:0/1066972101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00bd60 con 0x7fbbb813d660 2023-10-16T19:40:39.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 -- 172.21.15.29:0/1066972101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb813d660 msgr2=0x7fbbb806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb813d660 0x7fbbb806a880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1780 tx=0x7fbbac009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 -- 172.21.15.29:0/1066972101 shutdown_connections 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb813d660 0x7fbbb806a880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 --2- 172.21.15.29:0/1066972101 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb806adc0 0x7fbbb8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 --2- 172.21.15.29:0/1066972101 >> v2:172.21.15.53:3300/0 conn(0x7fbbb8154a50 0x7fbbb81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 -- 172.21.15.29:0/1066972101 >> 172.21.15.29:0/1066972101 conn(0x7fbbb80c7110 msgr2=0x7fbbb80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:39.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 -- 172.21.15.29:0/1066972101 shutdown_connections 2023-10-16T19:40:39.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.913+0000 7fbbbce53700 1 -- 172.21.15.29:0/1066972101 wait complete. 2023-10-16T19:40:39.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.914+0000 7fbbbce53700 1 Processor -- start 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.914+0000 7fbbbce53700 1 -- start start 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb813d660 0x7fbbb8139ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb8154a50 0x7fbbb81ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb813b1d0 con 0x7fbbb806adc0 2023-10-16T19:40:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8156030 con 0x7fbbb813d660 2023-10-16T19:40:39.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbbce53700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81578d0 con 0x7fbbb8154a50 2023-10-16T19:40:39.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52612/0 (socket says 172.21.15.29:52612) 2023-10-16T19:40:39.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 -- 172.21.15.29:0/2988285603 learned_addr learned my addr 172.21.15.29:0/2988285603 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:39.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 -- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb8154a50 msgr2=0x7fbbb81ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb8154a50 0x7fbbb81ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 -- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb813d660 msgr2=0x7fbbb8139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb5d9b700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb813d660 0x7fbbb8139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb813d660 0x7fbbb8139ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.915+0000 7fbbb659c700 1 -- 172.21.15.29:0/2988285603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009550 con 0x7fbbb806adc0 2023-10-16T19:40:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbbb659c700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1750 tx=0x7fbbac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac004540 con 0x7fbbb806adc0 2023-10-16T19:40:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0036a0 con 0x7fbbb806adc0 2023-10-16T19:40:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb8157540 con 0x7fbbb806adc0 2023-10-16T19:40:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac003a50 con 0x7fbbb806adc0 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.916+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8157e00 con 0x7fbbb806adc0 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.917+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb81562a0 con 0x7fbbb806adc0 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.917+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbbac021070 con 0x7fbbb806adc0 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.918+0000 7fbba6ffd700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 0x7fbb9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.918+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbac08afe0 con 0x7fbbb806adc0 2023-10-16T19:40:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.918+0000 7fbbb5d9b700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 0x7fbb9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.918+0000 7fbbb5d9b700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 0x7fbb9806d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8136dc0 tx=0x7fbba8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:39.922+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbbac055dd0 con 0x7fbbb806adc0 2023-10-16T19:40:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.122+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbbb8157f90 con 0x7fbbb806adc0 2023-10-16T19:40:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.122+0000 7fbba6ffd700 1 -- 172.21.15.29:0/2988285603 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbac015020 con 0x7fbbb806adc0 2023-10-16T19:40:40.125 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:40.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 msgr2=0x7fbb9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 0x7fbb9806d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8136dc0 tx=0x7fbba8008040 comp rx=0 tx=0).stop 2023-10-16T19:40:40.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 msgr2=0x7fbbb8156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1750 tx=0x7fbbac004750 comp rx=0 tx=0).stop 2023-10-16T19:40:40.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 shutdown_connections 2023-10-16T19:40:40.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb9806af00 0x7fbb9806d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbbb8154a50 0x7fbbb81ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb806adc0 0x7fbbb8156450 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 --2- 172.21.15.29:0/2988285603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb813d660 0x7fbbb8139ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 >> 172.21.15.29:0/2988285603 conn(0x7fbbb80c7110 msgr2=0x7fbbb80c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 shutdown_connections 2023-10-16T19:40:40.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.124+0000 7fbbbce53700 1 -- 172.21.15.29:0/2988285603 wait complete. 2023-10-16T19:40:40.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:40.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.262+0000 7f7479b68700 1 Processor -- start 2023-10-16T19:40:40.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.262+0000 7f7479b68700 1 -- start start 2023-10-16T19:40:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7479b68700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74740c3380 0x7f74741531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7479b68700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74741562e0 0x7f7474156770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7479b68700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7474156cb0 con 0x7f747406aaf0 2023-10-16T19:40:40.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7479b68700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7474153790 con 0x7f74740c3380 2023-10-16T19:40:40.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7479b68700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747406fbf0 con 0x7f74741562e0 2023-10-16T19:40:40.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7472ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74740c3380 0x7f74741531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f74737fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f747406aaf0 0x7f747414c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38064/0 (socket says 172.21.15.29:38064) 2023-10-16T19:40:40.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f74737fe700 1 -- 172.21.15.29:0/3038011421 learned_addr learned my addr 172.21.15.29:0/3038011421 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:40.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7472ffd700 1 -- 172.21.15.29:0/3038011421 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74741562e0 msgr2=0x7f7474156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:40.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7472ffd700 1 --2- 172.21.15.29:0/3038011421 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74741562e0 0x7f7474156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7472ffd700 1 -- 172.21.15.29:0/3038011421 >> v1:172.21.15.29:6789/0 conn(0x7f747406aaf0 legacy=0x7f747414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f74727fc700 1 -- 172.21.15.29:0/3038011421 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696453367 0 0) 0x7f7474156cb0 con 0x7f747406aaf0 2023-10-16T19:40:40.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.263+0000 7f7472ffd700 1 -- 172.21.15.29:0/3038011421 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747406f630 con 0x7f74740c3380 2023-10-16T19:40:40.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7472ffd700 1 --2- 172.21.15.29:0/3038011421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741531b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f745c009840 tx=0x7f745c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb619f64fef7591 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f74727fc700 1 -- 172.21.15.29:0/3038011421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c011830 con 0x7f74740c3380 2023-10-16T19:40:40.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f74727fc700 1 -- 172.21.15.29:0/3038011421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c011990 con 0x7f74740c3380 2023-10-16T19:40:40.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f74727fc700 1 -- 172.21.15.29:0/3038011421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c011d20 con 0x7f74740c3380 2023-10-16T19:40:40.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 -- 172.21.15.29:0/3038011421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 msgr2=0x7f74741531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 --2- 172.21.15.29:0/3038011421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741531b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f745c009840 tx=0x7f745c009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:40.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 -- 172.21.15.29:0/3038011421 shutdown_connections 2023-10-16T19:40:40.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 --2- 172.21.15.29:0/3038011421 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f74741562e0 0x7f7474156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 --2- 172.21.15.29:0/3038011421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741531b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 -- 172.21.15.29:0/3038011421 >> 172.21.15.29:0/3038011421 conn(0x7f74740c3a10 msgr2=0x7f74740c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 -- 172.21.15.29:0/3038011421 shutdown_connections 2023-10-16T19:40:40.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.264+0000 7f7479b68700 1 -- 172.21.15.29:0/3038011421 wait complete. 2023-10-16T19:40:40.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.265+0000 7f7479b68700 1 Processor -- start 2023-10-16T19:40:40.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 -- start start 2023-10-16T19:40:40.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f747406aaf0 0x7f74740c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 0x7f74740c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747406ec30 con 0x7f74740c3380 2023-10-16T19:40:40.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740aba00 con 0x7f74741562e0 2023-10-16T19:40:40.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7479b68700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747406ee80 con 0x7f747406aaf0 2023-10-16T19:40:40.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7472ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7472ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52626/0 (socket says 172.21.15.29:52626) 2023-10-16T19:40:40.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.266+0000 7f7472ffd700 1 -- 172.21.15.29:0/184007338 learned_addr learned my addr 172.21.15.29:0/184007338 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:40.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7473fff700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 0x7f74740c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f74737fe700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f747406aaf0 0x7f74740c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 -- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f747406aaf0 msgr2=0x7f74740c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f747406aaf0 0x7f74740c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 -- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 msgr2=0x7f74740c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 0x7f74740c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 -- 172.21.15.29:0/184007338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0094a0 con 0x7f74740c3380 2023-10-16T19:40:40.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7473fff700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 0x7f74740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:40.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7472ffd700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f745c014040 tx=0x7f745c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0045f0 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c01e070 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747406f160 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c003b00 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.267+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740ab200 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.268+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747404f400 con 0x7f74740c3380 2023-10-16T19:40:40.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.269+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f745c003c60 con 0x7f74740c3380 2023-10-16T19:40:40.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.269+0000 7f746bfff700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 0x7f745406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.269+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f745c08aa60 con 0x7f74740c3380 2023-10-16T19:40:40.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.269+0000 7f74737fe700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 0x7f745406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.270+0000 7f74737fe700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 0x7f745406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7464000f60 tx=0x7f7464007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.274+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f745c0558b0 con 0x7f74740c3380 2023-10-16T19:40:40.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.473+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74740a8490 con 0x7f74740c3380 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.475+0000 7f746bfff700 1 -- 172.21.15.29:0/184007338 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f745c020070 con 0x7f74740c3380 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:40.477 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:39:57.416441+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:40.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 msgr2=0x7f745406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 0x7f745406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7464000f60 tx=0x7f7464007c90 comp rx=0 tx=0).stop 2023-10-16T19:40:40.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 msgr2=0x7f74741459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f745c014040 tx=0x7f745c004750 comp rx=0 tx=0).stop 2023-10-16T19:40:40.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 shutdown_connections 2023-10-16T19:40:40.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f745406af00 0x7f745406d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74741562e0 0x7f74740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f747406aaf0 0x7f74740c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 --2- 172.21.15.29:0/184007338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74740c3380 0x7f74741459d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 >> 172.21.15.29:0/184007338 conn(0x7f74740c3a10 msgr2=0x7f7474151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 shutdown_connections 2023-10-16T19:40:40.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.477+0000 7f7479b68700 1 -- 172.21.15.29:0/184007338 wait complete. 2023-10-16T19:40:40.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:40.492 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.617+0000 7efe1f04d700 1 Processor -- start 2023-10-16T19:40:40.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.617+0000 7efe1f04d700 1 -- start start 2023-10-16T19:40:40.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe1f04d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe1806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe1f04d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1806dcb0 con 0x7efe180c2760 2023-10-16T19:40:40.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe1f04d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe180c1b60 con 0x7efe18151cb0 2023-10-16T19:40:40.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe1f04d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c1e40 con 0x7efe1806aaf0 2023-10-16T19:40:40.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe17fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efe180c2760 0x7efe18158570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38078/0 (socket says 172.21.15.29:38078) 2023-10-16T19:40:40.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.618+0000 7efe17fff700 1 -- 172.21.15.29:0/1359120888 learned_addr learned my addr 172.21.15.29:0/1359120888 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:40.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe1cde9700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe1806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974725487 0 0) 0x7efe1806dcb0 con 0x7efe180c2760 2023-10-16T19:40:40.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe080035b0 con 0x7efe180c2760 2023-10-16T19:40:40.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076356210 0 0) 0x7efe080035b0 con 0x7efe180c2760 2023-10-16T19:40:40.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 msgr2=0x7efe1806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:40.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe1806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 >> v1:172.21.15.53:6789/0 conn(0x7efe18151cb0 legacy=0x7efe181520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180c2120 con 0x7efe180c2760 2023-10-16T19:40:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7efe04001670 con 0x7efe180c2760 2023-10-16T19:40:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 >> v1:172.21.15.29:6789/0 conn(0x7efe180c2760 legacy=0x7efe18158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe08003a30 0x7efe08003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe08004d90 0x7efe08005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c1e40 con 0x7efe08004d90 2023-10-16T19:40:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0800bac0 con 0x7efe08003a30 2023-10-16T19:40:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0800bc80 con 0x7efe1806aaf0 2023-10-16T19:40:40.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe1d5ea700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe08004d90 0x7efe08005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe1cde9700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe08003a30 0x7efe08003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.619+0000 7efe17fff700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 -- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 msgr2=0x7efe08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:40.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe1806aaf0 0x7efe08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 -- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe08003a30 msgr2=0x7efe08003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:40.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe08003a30 0x7efe08003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 -- 172.21.15.29:0/1359120888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080035b0 con 0x7efe08004d90 2023-10-16T19:40:40.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe08004d90 0x7efe08005210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c0e0 tx=0x7efe08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b5ba2f62ceddb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10001da0 con 0x7efe08004d90 2023-10-16T19:40:40.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe10003c70 con 0x7efe08004d90 2023-10-16T19:40:40.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe177fe700 1 -- 172.21.15.29:0/1359120888 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1000ca20 con 0x7efe08004d90 2023-10-16T19:40:40.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1f04d700 1 -- 172.21.15.29:0/1359120888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe08004d90 msgr2=0x7efe08005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1f04d700 1 --2- 172.21.15.29:0/1359120888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe08004d90 0x7efe08005210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c0e0 tx=0x7efe08005880 comp rx=0 tx=0).stop 2023-10-16T19:40:40.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1d5ea700 1 -- 172.21.15.29:0/1359120888 reap_dead start 2023-10-16T19:40:40.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1f04d700 1 -- 172.21.15.29:0/1359120888 shutdown_connections 2023-10-16T19:40:40.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.620+0000 7efe1f04d700 1 -- 172.21.15.29:0/1359120888 >> 172.21.15.29:0/1359120888 conn(0x7efe180c7100 msgr2=0x7efe180c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.621+0000 7efe1f04d700 1 -- 172.21.15.29:0/1359120888 shutdown_connections 2023-10-16T19:40:40.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.621+0000 7efe1f04d700 1 -- 172.21.15.29:0/1359120888 wait complete. 2023-10-16T19:40:40.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.622+0000 7efe1f04d700 1 Processor -- start 2023-10-16T19:40:40.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.622+0000 7efe1f04d700 1 -- start start 2023-10-16T19:40:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.622+0000 7efe1f04d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe181456c0 0x7efe18157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.622+0000 7efe1f04d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.622+0000 7efe1f04d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe180c5ce0 0x7efe181ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1f04d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c5350 con 0x7efe181563b0 2023-10-16T19:40:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1f04d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c4d20 con 0x7efe181456c0 2023-10-16T19:40:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1f04d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c6b10 con 0x7efe180c5ce0 2023-10-16T19:40:40.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52648/0 (socket says 172.21.15.29:52648) 2023-10-16T19:40:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 -- 172.21.15.29:0/311728379 learned_addr learned my addr 172.21.15.29:0/311728379 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1cde9700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe181456c0 0x7efe18157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1d5ea700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe180c5ce0 0x7efe181ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 -- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe180c5ce0 msgr2=0x7efe181ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe180c5ce0 0x7efe181ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 -- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe181456c0 msgr2=0x7efe18157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe181456c0 0x7efe18157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 -- 172.21.15.29:0/311728379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe181503f0 con 0x7efe181563b0 2023-10-16T19:40:40.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe17fff700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe04007290 tx=0x7efe040075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400f6c0 con 0x7efe181563b0 2023-10-16T19:40:40.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400f840 con 0x7efe181563b0 2023-10-16T19:40:40.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe181506d0 con 0x7efe181563b0 2023-10-16T19:40:40.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400fbf0 con 0x7efe181563b0 2023-10-16T19:40:40.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.623+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe18146340 con 0x7efe181563b0 2023-10-16T19:40:40.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.624+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe180c5490 con 0x7efe181563b0 2023-10-16T19:40:40.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.625+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe0400fd50 con 0x7efe181563b0 2023-10-16T19:40:40.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.625+0000 7efe157fa700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 0x7efdfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.625+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe04089840 con 0x7efe181563b0 2023-10-16T19:40:40.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.625+0000 7efe1cde9700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 0x7efdfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.626+0000 7efe1cde9700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 0x7efdfc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009c60 tx=0x7efe0c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.630+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe180c5490 con 0x7efe181563b0 2023-10-16T19:40:40.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.834+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe180c5490 con 0x7efe181563b0 2023-10-16T19:40:40.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.835+0000 7efe157fa700 1 -- 172.21.15.29:0/311728379 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe180c5490 con 0x7efe181563b0 2023-10-16T19:40:40.837 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 msgr2=0x7efdfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 0x7efdfc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009c60 tx=0x7efe0c009210 comp rx=0 tx=0).stop 2023-10-16T19:40:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 msgr2=0x7efe180c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe04007290 tx=0x7efe040075a0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 shutdown_connections 2023-10-16T19:40:40.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efdfc06af00 0x7efdfc06d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efe180c5ce0 0x7efe181ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe181456c0 0x7efe18157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 --2- 172.21.15.29:0/311728379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe181563b0 0x7efe180c57a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 >> 172.21.15.29:0/311728379 conn(0x7efe180c7100 msgr2=0x7efe18154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 shutdown_connections 2023-10-16T19:40:40.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.837+0000 7efe1f04d700 1 -- 172.21.15.29:0/311728379 wait complete. 2023-10-16T19:40:40.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:40.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.979+0000 7f6c2b4b9700 1 Processor -- start 2023-10-16T19:40:40.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 -- start start 2023-10-16T19:40:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c241550b0 0x7f6c240c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6c240c0d30 0x7f6c240c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240c5260 con 0x7f6c240c1860 2023-10-16T19:40:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240c4650 con 0x7f6c240c0d30 2023-10-16T19:40:40.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c2b4b9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c4930 con 0x7f6c241550b0 2023-10-16T19:40:40.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c28a54700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6c240c0d30 0x7f6c240c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c29a56700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6c240c1860 0x7f6c24070dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38102/0 (socket says 172.21.15.29:38102) 2023-10-16T19:40:40.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.980+0000 7f6c29a56700 1 -- 172.21.15.29:0/1674421114 learned_addr learned my addr 172.21.15.29:0/1674421114 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:40.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c29255700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c241550b0 0x7f6c240c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c28a54700 1 -- 172.21.15.29:0/1674421114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c241550b0 msgr2=0x7f6c240c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:40.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c28a54700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c241550b0 0x7f6c240c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c28a54700 1 -- 172.21.15.29:0/1674421114 >> v1:172.21.15.29:6789/0 conn(0x7f6c240c1860 legacy=0x7f6c24070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c28a54700 1 -- 172.21.15.29:0/1674421114 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240c4c10 con 0x7f6c240c0d30 2023-10-16T19:40:40.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c28a54700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c0d30 0x7f6c240c1320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000a9e0 tx=0x7f6c2000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d1d9dcdd28dd1e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c17fff700 1 -- 172.21.15.29:0/1674421114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000cb70 con 0x7f6c240c0d30 2023-10-16T19:40:40.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c17fff700 1 -- 172.21.15.29:0/1674421114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000ccd0 con 0x7f6c240c0d30 2023-10-16T19:40:40.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.981+0000 7f6c17fff700 1 -- 172.21.15.29:0/1674421114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20010640 con 0x7f6c240c0d30 2023-10-16T19:40:40.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/1674421114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c0d30 msgr2=0x7f6c240c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c0d30 0x7f6c240c1320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000a9e0 tx=0x7f6c2000acf0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/1674421114 shutdown_connections 2023-10-16T19:40:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c241550b0 0x7f6c240c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/1674421114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c0d30 0x7f6c240c1320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/1674421114 >> 172.21.15.29:0/1674421114 conn(0x7f6c240a8070 msgr2=0x7f6c240c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:40.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/1674421114 shutdown_connections 2023-10-16T19:40:40.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.982+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/1674421114 wait complete. 2023-10-16T19:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.983+0000 7f6c2b4b9700 1 Processor -- start 2023-10-16T19:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.983+0000 7f6c2b4b9700 1 -- start start 2023-10-16T19:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c240c0d30 0x7f6c2414e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c241550b0 0x7f6c241502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241464c0 con 0x7f6c240c1860 2023-10-16T19:40:40.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241db690 con 0x7f6c241550b0 2023-10-16T19:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240bfb70 con 0x7f6c240c0d30 2023-10-16T19:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52662/0 (socket says 172.21.15.29:52662) 2023-10-16T19:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 -- 172.21.15.29:0/96420324 learned_addr learned my addr 172.21.15.29:0/96420324 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c29255700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c240c0d30 0x7f6c2414e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c29a56700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c241550b0 0x7f6c241502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 -- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c240c0d30 msgr2=0x7f6c2414e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c240c0d30 0x7f6c2414e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 -- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c241550b0 msgr2=0x7f6c241502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c241550b0 0x7f6c241502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 -- 172.21.15.29:0/96420324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2000a640 con 0x7f6c240c1860 2023-10-16T19:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c28a54700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c20008010 tx=0x7f6c20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001e070 con 0x7f6c240c1860 2023-10-16T19:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c20004020 con 0x7f6c240c1860 2023-10-16T19:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c241edf00 con 0x7f6c240c1860 2023-10-16T19:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.984+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200043b0 con 0x7f6c240c1860 2023-10-16T19:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.985+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c240bf5a0 con 0x7f6c240c1860 2023-10-16T19:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.985+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24070570 con 0x7f6c240c1860 2023-10-16T19:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.986+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c20022070 con 0x7f6c240c1860 2023-10-16T19:40:40.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.986+0000 7f6c15ffb700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 0x7f6c0806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:40.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.986+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c2008a730 con 0x7f6c240c1860 2023-10-16T19:40:40.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.986+0000 7f6c29255700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 0x7f6c0806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.987+0000 7f6c29255700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 0x7f6c0806d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c180099f0 tx=0x7f6c18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:40.991+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c200554b0 con 0x7f6c240c1860 2023-10-16T19:40:41.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.191+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c240bf2c0 con 0x7f6c240c1860 2023-10-16T19:40:41.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.192+0000 7f6c15ffb700 1 -- 172.21.15.29:0/96420324 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c240bf2c0 con 0x7f6c240c1860 2023-10-16T19:40:41.195 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:41.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 msgr2=0x7f6c0806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 0x7f6c0806d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c180099f0 tx=0x7f6c18008040 comp rx=0 tx=0).stop 2023-10-16T19:40:41.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 msgr2=0x7f6c241ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c20008010 tx=0x7f6c20004750 comp rx=0 tx=0).stop 2023-10-16T19:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 shutdown_connections 2023-10-16T19:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6c0806af30 0x7f6c0806d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c241550b0 0x7f6c241502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6c240c0d30 0x7f6c2414e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 --2- 172.21.15.29:0/96420324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c240c1860 0x7f6c241ed4c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 >> 172.21.15.29:0/96420324 conn(0x7f6c240a8070 msgr2=0x7f6c240c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 shutdown_connections 2023-10-16T19:40:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.194+0000 7f6c2b4b9700 1 -- 172.21.15.29:0/96420324 wait complete. 2023-10-16T19:40:41.208 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.334+0000 7f9de82fb700 1 Processor -- start 2023-10-16T19:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.334+0000 7f9de82fb700 1 -- start start 2023-10-16T19:40:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de82fb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9de014ec50 0x7f9de01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de82fb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9de006db00 0x7f9de006df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de82fb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de0155af0 con 0x7f9de00c3350 2023-10-16T19:40:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de82fb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de0152300 con 0x7f9de014ec50 2023-10-16T19:40:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de82fb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de00c2e40 con 0x7f9de006db00 2023-10-16T19:40:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de6097700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9de014ec50 0x7f9de01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de6097700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9de014ec50 0x7f9de01555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52668/0 (socket says 172.21.15.29:52668) 2023-10-16T19:40:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.335+0000 7f9de6097700 1 -- 172.21.15.29:0/1491794022 learned_addr learned my addr 172.21.15.29:0/1491794022 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6898700 1 --2- 172.21.15.29:0/1491794022 >> v2:172.21.15.53:3300/0 conn(0x7f9de006db00 0x7f9de006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6097700 1 -- 172.21.15.29:0/1491794022 >> v2:172.21.15.53:3300/0 conn(0x7f9de006db00 msgr2=0x7f9de006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6097700 1 --2- 172.21.15.29:0/1491794022 >> v2:172.21.15.53:3300/0 conn(0x7f9de006db00 0x7f9de006df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6097700 1 -- 172.21.15.29:0/1491794022 >> v1:172.21.15.53:6789/0 conn(0x7f9de00c3350 legacy=0x7f9de0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6097700 1 -- 172.21.15.29:0/1491794022 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de014f030 con 0x7f9de014ec50 2023-10-16T19:40:41.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de6097700 1 --2- 172.21.15.29:0/1491794022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de014ec50 0x7f9de01555b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9de0068e40 tx=0x7f9dd000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b872914ff17ec8c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de5095700 1 -- 172.21.15.29:0/1491794022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000dcf0 con 0x7f9de014ec50 2023-10-16T19:40:41.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de5095700 1 -- 172.21.15.29:0/1491794022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd000de50 con 0x7f9de014ec50 2023-10-16T19:40:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.336+0000 7f9de5095700 1 -- 172.21.15.29:0/1491794022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004250 con 0x7f9de014ec50 2023-10-16T19:40:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 -- 172.21.15.29:0/1491794022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de014ec50 msgr2=0x7f9de01555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 --2- 172.21.15.29:0/1491794022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de014ec50 0x7f9de01555b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9de0068e40 tx=0x7f9dd000be70 comp rx=0 tx=0).stop 2023-10-16T19:40:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 -- 172.21.15.29:0/1491794022 shutdown_connections 2023-10-16T19:40:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 --2- 172.21.15.29:0/1491794022 >> v2:172.21.15.53:3300/0 conn(0x7f9de006db00 0x7f9de006df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 --2- 172.21.15.29:0/1491794022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de014ec50 0x7f9de01555b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 -- 172.21.15.29:0/1491794022 >> 172.21.15.29:0/1491794022 conn(0x7f9de00c7110 msgr2=0x7f9de00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 -- 172.21.15.29:0/1491794022 shutdown_connections 2023-10-16T19:40:41.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.337+0000 7f9de82fb700 1 -- 172.21.15.29:0/1491794022 wait complete. 2023-10-16T19:40:41.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.338+0000 7f9de82fb700 1 Processor -- start 2023-10-16T19:40:41.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.338+0000 7f9de82fb700 1 -- start start 2023-10-16T19:40:41.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de006db00 0x7f9de01442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9de014ec50 0x7f9de0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00c4ea0 con 0x7f9de00c3350 2023-10-16T19:40:41.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0141400 con 0x7f9de006db00 2023-10-16T19:40:41.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de01e9770 con 0x7f9de014ec50 2023-10-16T19:40:41.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52676/0 (socket says 172.21.15.29:52676) 2023-10-16T19:40:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 -- 172.21.15.29:0/61180058 learned_addr learned my addr 172.21.15.29:0/61180058 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de6097700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de006db00 0x7f9de01442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de6898700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9de014ec50 0x7f9de0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 -- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9de014ec50 msgr2=0x7f9de0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9de014ec50 0x7f9de0155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 -- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de006db00 msgr2=0x7f9de01442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de006db00 0x7f9de01442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 -- 172.21.15.29:0/61180058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd000b7f0 con 0x7f9de00c3350 2023-10-16T19:40:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de5896700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00c4a0 tx=0x7f9ddc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc011790 con 0x7f9de00c3350 2023-10-16T19:40:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0118f0 con 0x7f9de00c3350 2023-10-16T19:40:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de01e9a50 con 0x7f9de00c3350 2023-10-16T19:40:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.339+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc011ca0 con 0x7f9de00c3350 2023-10-16T19:40:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.340+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de014da00 con 0x7f9de00c3350 2023-10-16T19:40:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.340+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de014d560 con 0x7f9de00c3350 2023-10-16T19:40:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.341+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ddc01c460 con 0x7f9de00c3350 2023-10-16T19:40:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.341+0000 7f9dd6ffd700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 0x7f9dc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.341+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ddc0897f0 con 0x7f9de00c3350 2023-10-16T19:40:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.342+0000 7f9de6097700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 0x7f9dc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.342+0000 7f9de6097700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 0x7f9dc406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000b340 tx=0x7f9dd0012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.346+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ddc0544e0 con 0x7f9de00c3350 2023-10-16T19:40:41.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.544+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9de004f400 con 0x7f9de00c3350 2023-10-16T19:40:41.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.544+0000 7f9dd6ffd700 1 -- 172.21.15.29:0/61180058 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ddc057b00 con 0x7f9de00c3350 2023-10-16T19:40:41.547 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:41.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 msgr2=0x7f9dc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 0x7f9dc406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000b340 tx=0x7f9dd0012000 comp rx=0 tx=0).stop 2023-10-16T19:40:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 msgr2=0x7f9de0154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00c4a0 tx=0x7f9ddc00c860 comp rx=0 tx=0).stop 2023-10-16T19:40:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 shutdown_connections 2023-10-16T19:40:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9dc406af00 0x7f9dc406d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9de014ec50 0x7f9de0155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de006db00 0x7f9de01442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 --2- 172.21.15.29:0/61180058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9de00c3350 0x7f9de0154e30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 >> 172.21.15.29:0/61180058 conn(0x7f9de00c7110 msgr2=0x7f9de006ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 shutdown_connections 2023-10-16T19:40:41.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.546+0000 7f9de82fb700 1 -- 172.21.15.29:0/61180058 wait complete. 2023-10-16T19:40:41.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.691+0000 7f51eb812700 1 Processor -- start 2023-10-16T19:40:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.691+0000 7f51eb812700 1 -- start start 2023-10-16T19:40:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51eb812700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51e40c2d10 0x7f51e4070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51eb812700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51e40c15f0 0x7f51e40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51eb812700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e4154e10 con 0x7f51e414e460 2023-10-16T19:40:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51eb812700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e4150e10 con 0x7f51e40c2d10 2023-10-16T19:40:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51eb812700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40c28c0 con 0x7f51e40c15f0 2023-10-16T19:40:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51e40c2d10 0x7f51e4070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51e40c2d10 0x7f51e4070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52684/0 (socket says 172.21.15.29:52684) 2023-10-16T19:40:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 -- 172.21.15.29:0/4288818064 learned_addr learned my addr 172.21.15.29:0/4288818064 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e9daf700 1 --2- 172.21.15.29:0/4288818064 >> v2:172.21.15.53:3300/0 conn(0x7f51e40c15f0 0x7f51e40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 -- 172.21.15.29:0/4288818064 >> v2:172.21.15.53:3300/0 conn(0x7f51e40c15f0 msgr2=0x7f51e40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 --2- 172.21.15.29:0/4288818064 >> v2:172.21.15.53:3300/0 conn(0x7f51e40c15f0 0x7f51e40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 -- 172.21.15.29:0/4288818064 >> v1:172.21.15.53:6789/0 conn(0x7f51e414e460 legacy=0x7f51e406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.692+0000 7f51e8dad700 1 -- 172.21.15.29:0/4288818064 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4155340 con 0x7f51e40c2d10 2023-10-16T19:40:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51e8dad700 1 --2- 172.21.15.29:0/4288818064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e4070e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51e4151f70 tx=0x7f51e000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138c734b85994c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51dbfff700 1 -- 172.21.15.29:0/4288818064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e000dcf0 con 0x7f51e40c2d10 2023-10-16T19:40:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51dbfff700 1 -- 172.21.15.29:0/4288818064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e000de50 con 0x7f51e40c2d10 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51dbfff700 1 -- 172.21.15.29:0/4288818064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004250 con 0x7f51e40c2d10 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 -- 172.21.15.29:0/4288818064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 msgr2=0x7f51e4070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 --2- 172.21.15.29:0/4288818064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e4070e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51e4151f70 tx=0x7f51e000be70 comp rx=0 tx=0).stop 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 -- 172.21.15.29:0/4288818064 shutdown_connections 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 --2- 172.21.15.29:0/4288818064 >> v2:172.21.15.53:3300/0 conn(0x7f51e40c15f0 0x7f51e40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 --2- 172.21.15.29:0/4288818064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e4070e60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 -- 172.21.15.29:0/4288818064 >> 172.21.15.29:0/4288818064 conn(0x7f51e40c66d0 msgr2=0x7f51e40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 -- 172.21.15.29:0/4288818064 shutdown_connections 2023-10-16T19:40:41.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.693+0000 7f51eb812700 1 -- 172.21.15.29:0/4288818064 wait complete. 2023-10-16T19:40:41.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.695+0000 7f51eb812700 1 Processor -- start 2023-10-16T19:40:41.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.695+0000 7f51eb812700 1 -- start start 2023-10-16T19:40:41.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 0x7f51e4147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 0x7f51e4143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e414dcc0 con 0x7f51e40c2d10 2023-10-16T19:40:41.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e406b0e0 con 0x7f51e40c15f0 2023-10-16T19:40:41.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51eb812700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4148bb0 con 0x7f51e414e460 2023-10-16T19:40:41.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52690/0 (socket says 172.21.15.29:52690) 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 -- 172.21.15.29:0/85375490 learned_addr learned my addr 172.21.15.29:0/85375490 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e95ae700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 0x7f51e4147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e9daf700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 0x7f51e4143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 -- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 msgr2=0x7f51e4143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 0x7f51e4143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 -- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 msgr2=0x7f51e4147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 0x7f51e4147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 -- 172.21.15.29:0/85375490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e000b7f0 con 0x7f51e40c2d10 2023-10-16T19:40:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e95ae700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 0x7f51e4147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e9daf700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 0x7f51e4143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.696+0000 7f51e8dad700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51e000beb0 tx=0x7f51e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.697+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0020070 con 0x7f51e40c2d10 2023-10-16T19:40:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.697+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0004030 con 0x7f51e40c2d10 2023-10-16T19:40:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.697+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0010470 con 0x7f51e40c2d10 2023-10-16T19:40:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.697+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4148e90 con 0x7f51e40c2d10 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.697+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e414d7a0 con 0x7f51e40c2d10 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.698+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e414d9c0 con 0x7f51e40c2d10 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.698+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51e002d430 con 0x7f51e40c2d10 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.699+0000 7f51d9ffb700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 0x7f51c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.699+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f51e008cbf0 con 0x7f51e40c2d10 2023-10-16T19:40:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.699+0000 7f51e95ae700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 0x7f51c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.699+0000 7f51e95ae700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 0x7f51c806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51e40c3690 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.703+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e0057970 con 0x7f51e40c2d10 2023-10-16T19:40:41.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.906+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f51e4071eb0 con 0x7f51e40c2d10 2023-10-16T19:40:41.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.906+0000 7f51d9ffb700 1 -- 172.21.15.29:0/85375490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f51e005af90 con 0x7f51e40c2d10 2023-10-16T19:40:41.909 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 msgr2=0x7f51c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 0x7f51c806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51e40c3690 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 msgr2=0x7f51e40c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51e000beb0 tx=0x7f51e0004750 comp rx=0 tx=0).stop 2023-10-16T19:40:41.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 shutdown_connections 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f51c806af00 0x7f51c806d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f51e414e460 0x7f51e4143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51e40c15f0 0x7f51e4147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 --2- 172.21.15.29:0/85375490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51e40c2d10 0x7f51e40c5a70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 >> 172.21.15.29:0/85375490 conn(0x7f51e40c66d0 msgr2=0x7f51e40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:41.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.908+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 shutdown_connections 2023-10-16T19:40:41.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:41.909+0000 7f51eb812700 1 -- 172.21.15.29:0/85375490 wait complete. 2023-10-16T19:40:41.972 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-10-16T19:40:41.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:42.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.096+0000 7f0cbcc95700 1 Processor -- start 2023-10-16T19:40:42.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.096+0000 7f0cbcc95700 1 -- start start 2023-10-16T19:40:42.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cbcc95700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cb8154a50 0x7f0cb81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cbcc95700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb806e780 con 0x7f0cb813dd00 2023-10-16T19:40:42.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cbcc95700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb8154f10 con 0x7f0cb813d660 2023-10-16T19:40:42.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cbcc95700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb806d320 con 0x7f0cb8154a50 2023-10-16T19:40:42.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cb6d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0cb813dd00 0x7f0cb8158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38144/0 (socket says 172.21.15.29:38144) 2023-10-16T19:40:42.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.097+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/122085285 learned_addr learned my addr 172.21.15.29:0/122085285 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:42.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539773424 0 0) 0x7f0cb806e780 con 0x7f0cb813dd00 2023-10-16T19:40:42.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca00035b0 con 0x7f0cb813dd00 2023-10-16T19:40:42.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/122085285 >> v2:172.21.15.53:3300/0 conn(0x7f0cb8154a50 0x7f0cb81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504735669 0 0) 0x7f0ca00035b0 con 0x7f0cb813dd00 2023-10-16T19:40:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 >> v2:172.21.15.53:3300/0 conn(0x7f0cb8154a50 msgr2=0x7f0cb81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 --2- 172.21.15.29:0/122085285 >> v2:172.21.15.53:3300/0 conn(0x7f0cb8154a50 0x7f0cb81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 >> v1:172.21.15.53:6789/0 conn(0x7f0cb813d660 legacy=0x7f0cb806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb81551f0 con 0x7f0cb813dd00 2023-10-16T19:40:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f0cb0001a40 con 0x7f0cb813dd00 2023-10-16T19:40:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 >> v1:172.21.15.29:6789/0 conn(0x7f0cb813dd00 legacy=0x7f0cb8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ca0003a00 0x7f0ca0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 0x7f0ca0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0005210 0x7f0ca000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb806d320 con 0x7f0ca0004850 2023-10-16T19:40:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca000c1b0 con 0x7f0ca0003a00 2023-10-16T19:40:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca000c370 con 0x7f0ca0005210 2023-10-16T19:40:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 0x7f0ca0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb6d9d700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0005210 0x7f0ca000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb659c700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ca0003a00 0x7f0ca0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 -- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0005210 msgr2=0x7f0ca000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0005210 0x7f0ca000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 -- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ca0003a00 msgr2=0x7f0ca0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ca0003a00 0x7f0ca0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb5d9b700 1 -- 172.21.15.29:0/122085285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00035b0 con 0x7f0ca0004850 2023-10-16T19:40:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb659c700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ca0003a00 0x7f0ca0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.098+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/122085285 reap_dead start 2023-10-16T19:40:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 0x7f0ca0004cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009b60 tx=0x7f0ca0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b5893a03b3b32d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00e6c0 con 0x7f0ca0004850 2023-10-16T19:40:42.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00e820 con 0x7f0ca0004850 2023-10-16T19:40:42.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cb559a700 1 -- 172.21.15.29:0/122085285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00ebb0 con 0x7f0ca0004850 2023-10-16T19:40:42.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 -- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 msgr2=0x7f0ca0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 0x7f0ca0004cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009b60 tx=0x7f0ca0005880 comp rx=0 tx=0).stop 2023-10-16T19:40:42.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 -- 172.21.15.29:0/122085285 shutdown_connections 2023-10-16T19:40:42.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/122085285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca0004850 0x7f0ca0004cd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 -- 172.21.15.29:0/122085285 >> 172.21.15.29:0/122085285 conn(0x7f0cb80c7110 msgr2=0x7f0cb80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 -- 172.21.15.29:0/122085285 shutdown_connections 2023-10-16T19:40:42.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.099+0000 7f0cbcc95700 1 -- 172.21.15.29:0/122085285 wait complete. 2023-10-16T19:40:42.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 Processor -- start 2023-10-16T19:40:42.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 -- start start 2023-10-16T19:40:42.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0004850 0x7f0cb812f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 0x7f0cb8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8152450 con 0x7f0cb8151a80 2023-10-16T19:40:42.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8131530 con 0x7f0cb8155dc0 2023-10-16T19:40:42.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cbcc95700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8132ff0 con 0x7f0ca0004850 2023-10-16T19:40:42.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cb6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.101+0000 7f0cb6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52712/0 (socket says 172.21.15.29:52712) 2023-10-16T19:40:42.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/1805779259 learned_addr learned my addr 172.21.15.29:0/1805779259 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb659c700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0004850 0x7f0cb812f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 0x7f0cb8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0004850 msgr2=0x7f0cb812f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0004850 0x7f0cb812f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 msgr2=0x7f0cb8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 0x7f0cb8154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 -- 172.21.15.29:0/1805779259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8130c00 con 0x7f0cb8151a80 2023-10-16T19:40:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb5d9b700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 0x7f0cb8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cb6d9d700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80c1380 tx=0x7f0cb0007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000e830 con 0x7f0cb8151a80 2023-10-16T19:40:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb000e990 con 0x7f0cb8151a80 2023-10-16T19:40:42.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb8130ee0 con 0x7f0cb8151a80 2023-10-16T19:40:42.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000ed40 con 0x7f0cb8151a80 2023-10-16T19:40:42.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.102+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb8154790 con 0x7f0cb8151a80 2023-10-16T19:40:42.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.103+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb80c3780 con 0x7f0cb8151a80 2023-10-16T19:40:42.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.104+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cb0007d50 con 0x7f0cb8151a80 2023-10-16T19:40:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.104+0000 7f0ca6ffd700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 0x7f0c9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.104+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0cb0089920 con 0x7f0cb8151a80 2023-10-16T19:40:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.104+0000 7f0cb659c700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 0x7f0c9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.105+0000 7f0cb659c700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 0x7f0c9806d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8007fd0 tx=0x7f0ca8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.109+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cb00580a0 con 0x7f0cb8151a80 2023-10-16T19:40:42.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.310+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cb804f400 con 0x7f0cb8151a80 2023-10-16T19:40:42.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.312+0000 7f0ca6ffd700 1 -- 172.21.15.29:0/1805779259 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f0cb000eea0 con 0x7f0cb8151a80 2023-10-16T19:40:42.314 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:42.314 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:42.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 msgr2=0x7f0c9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 0x7f0c9806d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8007fd0 tx=0x7f0ca8009040 comp rx=0 tx=0).stop 2023-10-16T19:40:42.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 msgr2=0x7f0cb8151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80c1380 tx=0x7f0cb0007c40 comp rx=0 tx=0).stop 2023-10-16T19:40:42.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 shutdown_connections 2023-10-16T19:40:42.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0c9806af00 0x7f0c9806d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8151a80 0x7f0cb8151f10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0ca0004850 0x7f0cb812f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 --2- 172.21.15.29:0/1805779259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb8155dc0 0x7f0cb8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 >> 172.21.15.29:0/1805779259 conn(0x7f0cb80c7110 msgr2=0x7f0cb806f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 shutdown_connections 2023-10-16T19:40:42.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.314+0000 7f0cbcc95700 1 -- 172.21.15.29:0/1805779259 wait complete. 2023-10-16T19:40:42.328 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:42.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.455+0000 7f7ee82d3700 1 Processor -- start 2023-10-16T19:40:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.455+0000 7f7ee82d3700 1 -- start start 2023-10-16T19:40:42.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee82d3700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ee006f8f0 0x7f7ee00c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee82d3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee00c3e90 con 0x7f7ee01521e0 2023-10-16T19:40:42.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee82d3700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee006fd20 con 0x7f7ee00a7410 2023-10-16T19:40:42.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee82d3700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee0155bc0 con 0x7f7ee006f8f0 2023-10-16T19:40:42.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee606f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7ee01521e0 0x7f7ee00c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38160/0 (socket says 172.21.15.29:38160) 2023-10-16T19:40:42.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee606f700 1 -- 172.21.15.29:0/4093618307 learned_addr learned my addr 172.21.15.29:0/4093618307 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:42.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21128949 0 0) 0x7f7ee00c3e90 con 0x7f7ee01521e0 2023-10-16T19:40:42.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee6870700 1 --2- 172.21.15.29:0/4093618307 >> v2:172.21.15.53:3300/0 conn(0x7f7ee006f8f0 0x7f7ee00c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc0035b0 con 0x7f7ee01521e0 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338749496 0 0) 0x7f7ecc0035b0 con 0x7f7ee01521e0 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 >> v2:172.21.15.53:3300/0 conn(0x7f7ee006f8f0 msgr2=0x7f7ee00c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 --2- 172.21.15.29:0/4093618307 >> v2:172.21.15.53:3300/0 conn(0x7f7ee006f8f0 0x7f7ee00c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 >> v1:172.21.15.53:6789/0 conn(0x7f7ee00a7410 legacy=0x7f7ee00c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0070440 con 0x7f7ee01521e0 2023-10-16T19:40:42.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f7edc001670 con 0x7f7ee01521e0 2023-10-16T19:40:42.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 >> v1:172.21.15.29:6789/0 conn(0x7f7ee01521e0 legacy=0x7f7ee00c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 0x7f7ecc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.456+0000 7f7ee506d700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc004850 0x7f7ecc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ecc005210 0x7f7ecc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0155bc0 con 0x7f7ecc003a00 2023-10-16T19:40:42.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc00c0b0 con 0x7f7ecc005210 2023-10-16T19:40:42.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc00c270 con 0x7f7ecc004850 2023-10-16T19:40:42.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 0x7f7ecc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee586e700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc004850 0x7f7ecc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee6870700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ecc005210 0x7f7ecc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 -- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc004850 msgr2=0x7f7ecc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc004850 0x7f7ecc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 -- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ecc005210 msgr2=0x7f7ecc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ecc005210 0x7f7ecc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee6870700 1 -- 172.21.15.29:0/4093618307 reap_dead start 2023-10-16T19:40:42.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 -- 172.21.15.29:0/4093618307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0035b0 con 0x7f7ecc003a00 2023-10-16T19:40:42.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee606f700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 0x7f7ecc003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c2a0 tx=0x7f7ecc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f326175d46fb6513 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc007c10 con 0x7f7ecc003a00 2023-10-16T19:40:42.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00cd80 con 0x7f7ecc003a00 2023-10-16T19:40:42.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.457+0000 7f7ee506d700 1 -- 172.21.15.29:0/4093618307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc005ba0 con 0x7f7ecc003a00 2023-10-16T19:40:42.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 -- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 msgr2=0x7f7ecc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 0x7f7ecc003e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c2a0 tx=0x7f7ecc005880 comp rx=0 tx=0).stop 2023-10-16T19:40:42.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 -- 172.21.15.29:0/4093618307 shutdown_connections 2023-10-16T19:40:42.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/4093618307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ecc003a00 0x7f7ecc003e20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 -- 172.21.15.29:0/4093618307 >> 172.21.15.29:0/4093618307 conn(0x7f7ee006ac70 msgr2=0x7f7ee006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 -- 172.21.15.29:0/4093618307 shutdown_connections 2023-10-16T19:40:42.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.458+0000 7f7ee82d3700 1 -- 172.21.15.29:0/4093618307 wait complete. 2023-10-16T19:40:42.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.459+0000 7f7ee82d3700 1 Processor -- start 2023-10-16T19:40:42.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.459+0000 7f7ee82d3700 1 -- start start 2023-10-16T19:40:42.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 0x7f7ee01ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 0x7f7ee00bce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01ed9f0 con 0x7f7ee00be920 2023-10-16T19:40:42.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c1af0 con 0x7f7ee014bf70 2023-10-16T19:40:42.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee82d3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c7570 con 0x7f7ecc003a00 2023-10-16T19:40:42.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52730/0 (socket says 172.21.15.29:52730) 2023-10-16T19:40:42.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 -- 172.21.15.29:0/1630753706 learned_addr learned my addr 172.21.15.29:0/1630753706 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:42.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee606f700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 0x7f7ee01ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee6870700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 0x7f7ee00bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 -- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 msgr2=0x7f7ee01ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 0x7f7ee01ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 -- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 msgr2=0x7f7ee00bce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 0x7f7ee00bce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 -- 172.21.15.29:0/1630753706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee01ed750 con 0x7f7ee00be920 2023-10-16T19:40:42.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee606f700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 0x7f7ee01ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:42.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee6870700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 0x7f7ee00bce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ee586e700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000f7f0 tx=0x7f7ed000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.460+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0005320 con 0x7f7ee00be920 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.461+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0005480 con 0x7f7ee00be920 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.461+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0006a60 con 0x7f7ee00be920 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.461+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00c7a70 con 0x7f7ee00be920 2023-10-16T19:40:42.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.461+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee00bc8f0 con 0x7f7ee00be920 2023-10-16T19:40:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.461+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee00c78d0 con 0x7f7ee00be920 2023-10-16T19:40:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.462+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ed0006bc0 con 0x7f7ee00be920 2023-10-16T19:40:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.462+0000 7f7ed6ffd700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 0x7f7ec406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.462+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ed0088e60 con 0x7f7ee00be920 2023-10-16T19:40:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.463+0000 7f7ee606f700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 0x7f7ec406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.463+0000 7f7ee606f700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 0x7f7ec406d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7edc015040 tx=0x7f7edc007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.467+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ee00c78d0 con 0x7f7ee00be920 2023-10-16T19:40:42.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.665+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ee00c78d0 con 0x7f7ee00be920 2023-10-16T19:40:42.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.666+0000 7f7ed6ffd700 1 -- 172.21.15.29:0/1630753706 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ee00c78d0 con 0x7f7ee00be920 2023-10-16T19:40:42.668 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:42.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 msgr2=0x7f7ec406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 0x7f7ec406d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7edc015040 tx=0x7f7edc007000 comp rx=0 tx=0).stop 2023-10-16T19:40:42.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 msgr2=0x7f7ee014ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000f7f0 tx=0x7f7ed000fbb0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 shutdown_connections 2023-10-16T19:40:42.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7ec406af30 0x7f7ec406d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee014bf70 0x7f7ee00bce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7ecc003a00 0x7f7ee01ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 --2- 172.21.15.29:0/1630753706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ee00be920 0x7f7ee014ba30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 >> 172.21.15.29:0/1630753706 conn(0x7f7ee006ac70 msgr2=0x7f7ee006b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 shutdown_connections 2023-10-16T19:40:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.668+0000 7f7ee82d3700 1 -- 172.21.15.29:0/1630753706 wait complete. 2023-10-16T19:40:42.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:42.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 Processor -- start 2023-10-16T19:40:42.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 -- start start 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2b2413d660 0x7f2b2406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b24154a50 0x7f2b241583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2406e780 con 0x7f2b2406adc0 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2406d320 con 0x7f2b24154a50 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.809+0000 7f2b29429700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b24154f10 con 0x7f2b2413d660 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b24154a50 0x7f2b241583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b237fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2b2406adc0 0x7f2b24158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38184/0 (socket says 172.21.15.29:38184) 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b237fe700 1 -- 172.21.15.29:0/1638389215 learned_addr learned my addr 172.21.15.29:0/1638389215 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b22ffd700 1 --2- 172.21.15.29:0/1638389215 >> v2:172.21.15.53:3300/0 conn(0x7f2b2413d660 0x7f2b2406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b21ffb700 1 -- 172.21.15.29:0/1638389215 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760547714 0 0) 0x7f2b2406e780 con 0x7f2b2406adc0 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 -- 172.21.15.29:0/1638389215 >> v2:172.21.15.53:3300/0 conn(0x7f2b2413d660 msgr2=0x7f2b2406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 --2- 172.21.15.29:0/1638389215 >> v2:172.21.15.53:3300/0 conn(0x7f2b2413d660 0x7f2b2406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 -- 172.21.15.29:0/1638389215 >> v1:172.21.15.29:6789/0 conn(0x7f2b2406adc0 legacy=0x7f2b24158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 -- 172.21.15.29:0/1638389215 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b241551f0 con 0x7f2b24154a50 2023-10-16T19:40:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b227fc700 1 --2- 172.21.15.29:0/1638389215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b24154a50 0x7f2b241583c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b240c15e0 tx=0x7f2b18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ee51eccad04da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b21ffb700 1 -- 172.21.15.29:0/1638389215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011830 con 0x7f2b24154a50 2023-10-16T19:40:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b21ffb700 1 -- 172.21.15.29:0/1638389215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18011990 con 0x7f2b24154a50 2023-10-16T19:40:42.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.810+0000 7f2b21ffb700 1 -- 172.21.15.29:0/1638389215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011d20 con 0x7f2b24154a50 2023-10-16T19:40:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 -- 172.21.15.29:0/1638389215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b24154a50 msgr2=0x7f2b241583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 --2- 172.21.15.29:0/1638389215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b24154a50 0x7f2b241583c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b240c15e0 tx=0x7f2b18009b20 comp rx=0 tx=0).stop 2023-10-16T19:40:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 -- 172.21.15.29:0/1638389215 shutdown_connections 2023-10-16T19:40:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 --2- 172.21.15.29:0/1638389215 >> v2:172.21.15.53:3300/0 conn(0x7f2b2413d660 0x7f2b2406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 --2- 172.21.15.29:0/1638389215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b24154a50 0x7f2b241583c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 -- 172.21.15.29:0/1638389215 >> 172.21.15.29:0/1638389215 conn(0x7f2b240c7110 msgr2=0x7f2b240c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 -- 172.21.15.29:0/1638389215 shutdown_connections 2023-10-16T19:40:42.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.811+0000 7f2b29429700 1 -- 172.21.15.29:0/1638389215 wait complete. 2023-10-16T19:40:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.812+0000 7f2b29429700 1 Processor -- start 2023-10-16T19:40:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 -- start start 2023-10-16T19:40:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b2406adc0 0x7f2b24157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b24154a50 0x7f2b24153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241568f0 con 0x7f2b2413d660 2023-10-16T19:40:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24157ef0 con 0x7f2b24154a50 2023-10-16T19:40:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.813+0000 7f2b29429700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24155ce0 con 0x7f2b2406adc0 2023-10-16T19:40:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52744/0 (socket says 172.21.15.29:52744) 2023-10-16T19:40:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 -- 172.21.15.29:0/1987146609 learned_addr learned my addr 172.21.15.29:0/1987146609 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b22ffd700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b2406adc0 0x7f2b24157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b237fe700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b24154a50 0x7f2b24153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 -- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b2406adc0 msgr2=0x7f2b24157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b2406adc0 0x7f2b24157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 -- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b24154a50 msgr2=0x7f2b24153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b24154a50 0x7f2b24153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 -- 172.21.15.29:0/1987146609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180094a0 con 0x7f2b2413d660 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b227fc700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b18014040 tx=0x7f2b18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180036a0 con 0x7f2b2413d660 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1801f070 con 0x7f2b2413d660 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b24155fc0 con 0x7f2b2413d660 2023-10-16T19:40:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18003a40 con 0x7f2b2413d660 2023-10-16T19:40:42.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.814+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b24156580 con 0x7f2b2413d660 2023-10-16T19:40:42.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.815+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b240c3780 con 0x7f2b2413d660 2023-10-16T19:40:42.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.816+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2b18003ba0 con 0x7f2b2413d660 2023-10-16T19:40:42.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.816+0000 7f2b0b7fe700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 0x7f2b1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:42.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.816+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b18021070 con 0x7f2b2413d660 2023-10-16T19:40:42.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.816+0000 7f2b22ffd700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 0x7f2b1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:42.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.817+0000 7f2b22ffd700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 0x7f2b1006d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b14006b20 tx=0x7f2b14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:42.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:42.821+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b180bdca0 con 0x7f2b2413d660 2023-10-16T19:40:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.020+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b24156710 con 0x7f2b2413d660 2023-10-16T19:40:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.020+0000 7f2b0b7fe700 1 -- 172.21.15.29:0/1987146609 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b18055f00 con 0x7f2b2413d660 2023-10-16T19:40:43.022 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 msgr2=0x7f2b1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 0x7f2b1006d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b14006b20 tx=0x7f2b14008040 comp rx=0 tx=0).stop 2023-10-16T19:40:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 msgr2=0x7f2b241532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b18014040 tx=0x7f2b18004750 comp rx=0 tx=0).stop 2023-10-16T19:40:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 shutdown_connections 2023-10-16T19:40:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b1006af00 0x7f2b1006d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b24154a50 0x7f2b24153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b2406adc0 0x7f2b24157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 --2- 172.21.15.29:0/1987146609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2413d660 0x7f2b241532e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 >> 172.21.15.29:0/1987146609 conn(0x7f2b240c7110 msgr2=0x7f2b241582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 shutdown_connections 2023-10-16T19:40:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.022+0000 7f2b29429700 1 -- 172.21.15.29:0/1987146609 wait complete. 2023-10-16T19:40:43.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:43.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.162+0000 7f9278581700 1 Processor -- start 2023-10-16T19:40:43.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.162+0000 7f9278581700 1 -- start start 2023-10-16T19:40:43.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9278581700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 0x7f9270156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9278581700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9270150100 0x7f9270152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9278581700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92700724a0 con 0x7f92700c18b0 2023-10-16T19:40:43.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9278581700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9270152780 con 0x7f9270150100 2023-10-16T19:40:43.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9278581700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c2660 con 0x7f927006f6e0 2023-10-16T19:40:43.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9270150100 0x7f9270152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9270150100 0x7f9270152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52754/0 (socket says 172.21.15.29:52754) 2023-10-16T19:40:43.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 -- 172.21.15.29:0/2091178943 learned_addr learned my addr 172.21.15.29:0/2091178943 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:43.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f927631d700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 0x7f9270156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 -- 172.21.15.29:0/2091178943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 msgr2=0x7f9270156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 0x7f9270156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 -- 172.21.15.29:0/2091178943 >> v1:172.21.15.53:6789/0 conn(0x7f92700c18b0 legacy=0x7f927014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 -- 172.21.15.29:0/2091178943 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700a8490 con 0x7f9270150100 2023-10-16T19:40:43.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f927631d700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 0x7f9270156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.163+0000 7f9276b1e700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9270150100 0x7f9270152ba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9268009e50 tx=0x7f926800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e2891a3da7b088 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f927531b700 1 -- 172.21.15.29:0/2091178943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800e070 con 0x7f9270150100 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f927531b700 1 -- 172.21.15.29:0/2091178943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800b9c0 con 0x7f9270150100 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f927531b700 1 -- 172.21.15.29:0/2091178943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800bd70 con 0x7f9270150100 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 -- 172.21.15.29:0/2091178943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9270150100 msgr2=0x7f9270152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9270150100 0x7f9270152ba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9268009e50 tx=0x7f926800b330 comp rx=0 tx=0).stop 2023-10-16T19:40:43.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 -- 172.21.15.29:0/2091178943 shutdown_connections 2023-10-16T19:40:43.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9270150100 0x7f9270152ba0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 --2- 172.21.15.29:0/2091178943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f927006f6e0 0x7f9270156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 -- 172.21.15.29:0/2091178943 >> 172.21.15.29:0/2091178943 conn(0x7f92700c7110 msgr2=0x7f92700c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 -- 172.21.15.29:0/2091178943 shutdown_connections 2023-10-16T19:40:43.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.164+0000 7f9278581700 1 -- 172.21.15.29:0/2091178943 wait complete. 2023-10-16T19:40:43.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.166+0000 7f9278581700 1 Processor -- start 2023-10-16T19:40:43.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.166+0000 7f9278581700 1 -- start start 2023-10-16T19:40:43.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 0x7f92701ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9270150100 0x7f92701eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927014f200 con 0x7f927006f6e0 2023-10-16T19:40:43.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927014ddc0 con 0x7f9270150100 2023-10-16T19:40:43.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9278581700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92701eb7e0 con 0x7f92700c18b0 2023-10-16T19:40:43.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52756/0 (socket says 172.21.15.29:52756) 2023-10-16T19:40:43.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 -- 172.21.15.29:0/3017432554 learned_addr learned my addr 172.21.15.29:0/3017432554 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:43.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9275b1c700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 0x7f92701ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9276b1e700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9270150100 0x7f92701eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 -- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 msgr2=0x7f92701ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 0x7f92701ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 -- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9270150100 msgr2=0x7f92701eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9270150100 0x7f92701eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 -- 172.21.15.29:0/3017432554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009b30 con 0x7f927006f6e0 2023-10-16T19:40:43.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f9275b1c700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 0x7f92701ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:43.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.167+0000 7f927631d700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f926000e840 tx=0x7f926000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260004230 con 0x7f927006f6e0 2023-10-16T19:40:43.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260004390 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927014ef20 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600036a0 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927014d9e0 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.168+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927014e030 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.169+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9260003800 con 0x7f927006f6e0 2023-10-16T19:40:43.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.169+0000 7f9266ffd700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 0x7f925406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.169+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9260089380 con 0x7f927006f6e0 2023-10-16T19:40:43.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.170+0000 7f9275b1c700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 0x7f925406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.170+0000 7f9275b1c700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 0x7f925406d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f927006b340 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.174+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9260054100 con 0x7f927006f6e0 2023-10-16T19:40:43.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.375+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92700a8d00 con 0x7f927006f6e0 2023-10-16T19:40:43.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.376+0000 7f9266ffd700 1 -- 172.21.15.29:0/3017432554 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92600094c0 con 0x7f927006f6e0 2023-10-16T19:40:43.378 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 msgr2=0x7f925406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 0x7f925406d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f927006b340 tx=0x7f926c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 msgr2=0x7f92700c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f926000e840 tx=0x7f926000ec00 comp rx=0 tx=0).stop 2023-10-16T19:40:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 shutdown_connections 2023-10-16T19:40:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f925406af00 0x7f925406d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9270150100 0x7f92701eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f927006f6e0 0x7f92700c40e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 --2- 172.21.15.29:0/3017432554 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92700c18b0 0x7f92701ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 >> 172.21.15.29:0/3017432554 conn(0x7f92700c7110 msgr2=0x7f92700ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 shutdown_connections 2023-10-16T19:40:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.378+0000 7f9278581700 1 -- 172.21.15.29:0/3017432554 wait complete. 2023-10-16T19:40:43.392 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.518+0000 7fac52dcb700 1 Processor -- start 2023-10-16T19:40:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.518+0000 7fac52dcb700 1 -- start start 2023-10-16T19:40:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac52dcb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac52dcb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac4c0c3350 0x7fac4c071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac52dcb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c155af0 con 0x7fac4c071840 2023-10-16T19:40:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac52dcb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c152300 con 0x7fac4c0c3350 2023-10-16T19:40:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac52dcb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c2e40 con 0x7fac4c14ec50 2023-10-16T19:40:43.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac4bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac4c0c3350 0x7fac4c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:45218/0 (socket says 172.21.15.29:45218) 2023-10-16T19:40:43.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 -- 172.21.15.29:0/2924379513 learned_addr learned my addr 172.21.15.29:0/2924379513 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:43.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 -- 172.21.15.29:0/2924379513 >> v2:172.21.15.53:3300/0 conn(0x7fac4c0c3350 msgr2=0x7fac4c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:43.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 --2- 172.21.15.29:0/2924379513 >> v2:172.21.15.53:3300/0 conn(0x7fac4c0c3350 0x7fac4c071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 -- 172.21.15.29:0/2924379513 >> v1:172.21.15.53:6789/0 conn(0x7fac4c071840 legacy=0x7fac4c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.519+0000 7fac50b67700 1 -- 172.21.15.29:0/2924379513 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c14f030 con 0x7fac4c14ec50 2023-10-16T19:40:43.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac50b67700 1 --2- 172.21.15.29:0/2924379513 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac400098f0 tx=0x7fac40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e7836fad2e4c3a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac4b7fe700 1 -- 172.21.15.29:0/2924379513 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40011830 con 0x7fac4c14ec50 2023-10-16T19:40:43.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac4b7fe700 1 -- 172.21.15.29:0/2924379513 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40011990 con 0x7fac4c14ec50 2023-10-16T19:40:43.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac4b7fe700 1 -- 172.21.15.29:0/2924379513 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40011d20 con 0x7fac4c14ec50 2023-10-16T19:40:43.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 -- 172.21.15.29:0/2924379513 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 msgr2=0x7fac4c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2924379513 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac400098f0 tx=0x7fac40009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:43.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 -- 172.21.15.29:0/2924379513 shutdown_connections 2023-10-16T19:40:43.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2924379513 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c14ec50 0x7fac4c1555b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2924379513 >> v2:172.21.15.53:3300/0 conn(0x7fac4c0c3350 0x7fac4c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 -- 172.21.15.29:0/2924379513 >> 172.21.15.29:0/2924379513 conn(0x7fac4c0c7110 msgr2=0x7fac4c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 -- 172.21.15.29:0/2924379513 shutdown_connections 2023-10-16T19:40:43.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.520+0000 7fac52dcb700 1 -- 172.21.15.29:0/2924379513 wait complete. 2023-10-16T19:40:43.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.521+0000 7fac52dcb700 1 Processor -- start 2023-10-16T19:40:43.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 -- start start 2023-10-16T19:40:43.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c0c3350 0x7fac4c143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac4c14ec50 0x7fac4c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14bf90 con 0x7fac4c071840 2023-10-16T19:40:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14ba60 con 0x7fac4c14ec50 2023-10-16T19:40:43.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.522+0000 7fac52dcb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14bcb0 con 0x7fac4c0c3350 2023-10-16T19:40:43.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52770/0 (socket says 172.21.15.29:52770) 2023-10-16T19:40:43.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 -- 172.21.15.29:0/2305657630 learned_addr learned my addr 172.21.15.29:0/2305657630 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:43.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac4bfff700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c0c3350 0x7fac4c143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac51368700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac4c14ec50 0x7fac4c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 -- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c0c3350 msgr2=0x7fac4c143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c0c3350 0x7fac4c143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 -- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac4c14ec50 msgr2=0x7fac4c144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac4c14ec50 0x7fac4c144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 -- 172.21.15.29:0/2305657630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009550 con 0x7fac4c071840 2023-10-16T19:40:43.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac50b67700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac40000c00 tx=0x7fac40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40004590 con 0x7fac4c071840 2023-10-16T19:40:43.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400036a0 con 0x7fac4c071840 2023-10-16T19:40:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0c6700 con 0x7fac4c071840 2023-10-16T19:40:43.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40003a50 con 0x7fac4c071840 2023-10-16T19:40:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.523+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c0aa2e0 con 0x7fac4c071840 2023-10-16T19:40:43.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.524+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c0c6560 con 0x7fac4c071840 2023-10-16T19:40:43.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.525+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac40003bb0 con 0x7fac4c071840 2023-10-16T19:40:43.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.525+0000 7fac497fa700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 0x7fac3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.525+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac4008aae0 con 0x7fac4c071840 2023-10-16T19:40:43.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.526+0000 7fac4bfff700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 0x7fac3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.526+0000 7fac4bfff700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 0x7fac3006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac4c1539b0 tx=0x7fac38009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.530+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac4c0c6560 con 0x7fac4c071840 2023-10-16T19:40:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.731+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac4c0c6560 con 0x7fac4c071840 2023-10-16T19:40:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.731+0000 7fac497fa700 1 -- 172.21.15.29:0/2305657630 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac4c0c6560 con 0x7fac4c071840 2023-10-16T19:40:43.734 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 msgr2=0x7fac3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 0x7fac3006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac4c1539b0 tx=0x7fac38009210 comp rx=0 tx=0).stop 2023-10-16T19:40:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 msgr2=0x7fac4c0abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac40000c00 tx=0x7fac40004750 comp rx=0 tx=0).stop 2023-10-16T19:40:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 shutdown_connections 2023-10-16T19:40:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3006af00 0x7fac3006d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac4c14ec50 0x7fac4c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac4c071840 0x7fac4c0abd20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 --2- 172.21.15.29:0/2305657630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac4c0c3350 0x7fac4c143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 >> 172.21.15.29:0/2305657630 conn(0x7fac4c0c7110 msgr2=0x7fac4c06a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 shutdown_connections 2023-10-16T19:40:43.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.733+0000 7fac52dcb700 1 -- 172.21.15.29:0/2305657630 wait complete. 2023-10-16T19:40:43.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-10-16T19:40:43.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.874+0000 7fa58c98e700 1 Processor -- start 2023-10-16T19:40:43.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.874+0000 7fa58c98e700 1 -- start start 2023-10-16T19:40:43.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa58c98e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58813d660 0x7fa58806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa58c98e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa588154a50 0x7fa5881583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa58c98e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58806e780 con 0x7fa58806adc0 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa58c98e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58806d320 con 0x7fa588154a50 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa58c98e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588154f10 con 0x7fa58813d660 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa585d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa588154a50 0x7fa5881583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa586d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa58806adc0 0x7fa588158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38226/0 (socket says 172.21.15.29:38226) 2023-10-16T19:40:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.875+0000 7fa586d9d700 1 -- 172.21.15.29:0/1419095489 learned_addr learned my addr 172.21.15.29:0/1419095489 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:43.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa58659c700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58813d660 0x7fa58806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa585d9b700 1 -- 172.21.15.29:0/1419095489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58813d660 msgr2=0x7fa58806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:43.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa585d9b700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58813d660 0x7fa58806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa585d9b700 1 -- 172.21.15.29:0/1419095489 >> v1:172.21.15.29:6789/0 conn(0x7fa58806adc0 legacy=0x7fa588158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa58559a700 1 -- 172.21.15.29:0/1419095489 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651151496 0 0) 0x7fa58806e780 con 0x7fa58806adc0 2023-10-16T19:40:43.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa585d9b700 1 -- 172.21.15.29:0/1419095489 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5881551f0 con 0x7fa588154a50 2023-10-16T19:40:43.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa585d9b700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa588154a50 0x7fa5881583c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa578009840 tx=0x7fa578009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306b2d64d73789d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa58559a700 1 -- 172.21.15.29:0/1419095489 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578011830 con 0x7fa588154a50 2023-10-16T19:40:43.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa58559a700 1 -- 172.21.15.29:0/1419095489 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578011990 con 0x7fa588154a50 2023-10-16T19:40:43.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.876+0000 7fa58559a700 1 -- 172.21.15.29:0/1419095489 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578011d20 con 0x7fa588154a50 2023-10-16T19:40:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 -- 172.21.15.29:0/1419095489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa588154a50 msgr2=0x7fa5881583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa588154a50 0x7fa5881583c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa578009840 tx=0x7fa578009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 -- 172.21.15.29:0/1419095489 shutdown_connections 2023-10-16T19:40:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58813d660 0x7fa58806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 --2- 172.21.15.29:0/1419095489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa588154a50 0x7fa5881583c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 -- 172.21.15.29:0/1419095489 >> 172.21.15.29:0/1419095489 conn(0x7fa5880c7110 msgr2=0x7fa5880c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 -- 172.21.15.29:0/1419095489 shutdown_connections 2023-10-16T19:40:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.877+0000 7fa58c98e700 1 -- 172.21.15.29:0/1419095489 wait complete. 2023-10-16T19:40:43.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.878+0000 7fa58c98e700 1 Processor -- start 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.878+0000 7fa58c98e700 1 -- start start 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58806adc0 0x7fa5881ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa588154a50 0x7fa5880ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880a8ed0 con 0x7fa58813d660 2023-10-16T19:40:43.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880a8490 con 0x7fa588154a50 2023-10-16T19:40:43.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58c98e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c6aa0 con 0x7fa58806adc0 2023-10-16T19:40:43.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52786/0 (socket says 172.21.15.29:52786) 2023-10-16T19:40:43.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 -- 172.21.15.29:0/1316168505 learned_addr learned my addr 172.21.15.29:0/1316168505 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:43.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa58659c700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58806adc0 0x7fa5881ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa586d9d700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa588154a50 0x7fa5880ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 -- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58806adc0 msgr2=0x7fa5881ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58806adc0 0x7fa5881ed1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 -- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa588154a50 msgr2=0x7fa5880ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:43.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa588154a50 0x7fa5880ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 -- 172.21.15.29:0/1316168505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780094a0 con 0x7fa58813d660 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.879+0000 7fa585d9b700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa578014040 tx=0x7fa578004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.880+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780038a0 con 0x7fa58813d660 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.880+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57801e070 con 0x7fa58813d660 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.880+0000 7fa58c98e700 1 -- 172.21.15.29:0/1316168505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5881edc30 con 0x7fa58813d660 2023-10-16T19:40:43.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.880+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578003c40 con 0x7fa58813d660 2023-10-16T19:40:43.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.880+0000 7fa58c98e700 1 -- 172.21.15.29:0/1316168505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5880a8980 con 0x7fa58813d660 2023-10-16T19:40:43.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.881+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5600052f0 con 0x7fa58813d660 2023-10-16T19:40:43.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.881+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa57802d450 con 0x7fa58813d660 2023-10-16T19:40:43.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.882+0000 7fa576ffd700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 0x7fa56806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:43.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.882+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa57808aae0 con 0x7fa58813d660 2023-10-16T19:40:43.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.882+0000 7fa58659c700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 0x7fa56806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:43.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.882+0000 7fa58659c700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 0x7fa56806d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa57c008850 tx=0x7fa57c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:43.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:43.886+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa578055860 con 0x7fa58813d660 2023-10-16T19:40:44.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.170+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fa560005870 con 0x7fa58813d660 2023-10-16T19:40:44.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.669+0000 7fa576ffd700 1 -- 172.21.15.29:0/1316168505 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v62) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa578020020 con 0x7fa58813d660 2023-10-16T19:40:44.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 msgr2=0x7fa56806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 0x7fa56806d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa57c008850 tx=0x7fa57c008040 comp rx=0 tx=0).stop 2023-10-16T19:40:44.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 msgr2=0x7fa5880ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa578014040 tx=0x7fa578004750 comp rx=0 tx=0).stop 2023-10-16T19:40:44.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 shutdown_connections 2023-10-16T19:40:44.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa56806af00 0x7fa56806d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa588154a50 0x7fa5880ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa58806adc0 0x7fa5881ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 --2- 172.21.15.29:0/1316168505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa58813d660 0x7fa5880ab410 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.671+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 >> 172.21.15.29:0/1316168505 conn(0x7fa5880c7110 msgr2=0x7fa5880c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:44.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.672+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 shutdown_connections 2023-10-16T19:40:44.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.672+0000 7fa574ff9700 1 -- 172.21.15.29:0/1316168505 wait complete. 2023-10-16T19:40:44.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T19:40:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.822+0000 7fcf55860700 1 Processor -- start 2023-10-16T19:40:44.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.822+0000 7fcf55860700 1 -- start start 2023-10-16T19:40:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf55860700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcf50151fa0 0x7fcf500c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf55860700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500c5580 con 0x7fcf500c4dd0 2023-10-16T19:40:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf55860700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500c5310 con 0x7fcf500c57c0 2023-10-16T19:40:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf55860700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006c480 con 0x7fcf50151fa0 2023-10-16T19:40:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf4effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcf50151fa0 0x7fcf500c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf4e7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcf500c4dd0 0x7fcf50157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38238/0 (socket says 172.21.15.29:38238) 2023-10-16T19:40:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf4e7fc700 1 -- 172.21.15.29:0/1345344225 learned_addr learned my addr 172.21.15.29:0/1345344225 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.823+0000 7fcf4effd700 1 -- 172.21.15.29:0/1345344225 >> v1:172.21.15.53:6789/0 conn(0x7fcf500c57c0 legacy=0x7fcf5015f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4effd700 1 -- 172.21.15.29:0/1345344225 >> v1:172.21.15.29:6789/0 conn(0x7fcf500c4dd0 legacy=0x7fcf50157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4effd700 1 -- 172.21.15.29:0/1345344225 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5006b980 con 0x7fcf50151fa0 2023-10-16T19:40:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4dffb700 1 -- 172.21.15.29:0/1345344225 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849550051 0 0) 0x7fcf500c5580 con 0x7fcf500c4dd0 2023-10-16T19:40:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4effd700 1 --2- 172.21.15.29:0/1345344225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf50151fa0 0x7fcf500c6d10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009840 tx=0x7fcf44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ea82f16acdd5ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4dffb700 1 -- 172.21.15.29:0/1345344225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44011830 con 0x7fcf50151fa0 2023-10-16T19:40:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4dffb700 1 -- 172.21.15.29:0/1345344225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44011990 con 0x7fcf50151fa0 2023-10-16T19:40:44.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf4dffb700 1 -- 172.21.15.29:0/1345344225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44011d20 con 0x7fcf50151fa0 2023-10-16T19:40:44.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf55860700 1 -- 172.21.15.29:0/1345344225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf50151fa0 msgr2=0x7fcf500c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.824+0000 7fcf55860700 1 --2- 172.21.15.29:0/1345344225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf50151fa0 0x7fcf500c6d10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009840 tx=0x7fcf44009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:44.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.825+0000 7fcf55860700 1 -- 172.21.15.29:0/1345344225 shutdown_connections 2023-10-16T19:40:44.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.825+0000 7fcf55860700 1 --2- 172.21.15.29:0/1345344225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf50151fa0 0x7fcf500c6d10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.825+0000 7fcf55860700 1 -- 172.21.15.29:0/1345344225 >> 172.21.15.29:0/1345344225 conn(0x7fcf500abf40 msgr2=0x7fcf500ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:44.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.825+0000 7fcf55860700 1 -- 172.21.15.29:0/1345344225 shutdown_connections 2023-10-16T19:40:44.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.825+0000 7fcf55860700 1 -- 172.21.15.29:0/1345344225 wait complete. 2023-10-16T19:40:44.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 Processor -- start 2023-10-16T19:40:44.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 -- start start 2023-10-16T19:40:44.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf500c4dd0 0x7fcf50152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:44.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:44.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcf50151fa0 0x7fcf501e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:44.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50157c80 con 0x7fcf500c57c0 2023-10-16T19:40:44.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.826+0000 7fcf55860700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501531e0 con 0x7fcf500c4dd0 2023-10-16T19:40:44.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf55860700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50157ed0 con 0x7fcf50151fa0 2023-10-16T19:40:44.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:44.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52800/0 (socket says 172.21.15.29:52800) 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 -- 172.21.15.29:0/1705087916 learned_addr learned my addr 172.21.15.29:0/1705087916 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4effd700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf500c4dd0 0x7fcf50152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4f7fe700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcf50151fa0 0x7fcf501e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 -- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcf50151fa0 msgr2=0x7fcf501e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcf50151fa0 0x7fcf501e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 -- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf500c4dd0 msgr2=0x7fcf50152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:44.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf500c4dd0 0x7fcf50152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:44.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 -- 172.21.15.29:0/1705087916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf440094a0 con 0x7fcf500c57c0 2023-10-16T19:40:44.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf4e7fc700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcf40001eb0 tx=0x7fcf4000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:44.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40004c80 con 0x7fcf500c57c0 2023-10-16T19:40:44.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40004de0 con 0x7fcf500c57c0 2023-10-16T19:40:44.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf501581b0 con 0x7fcf500c57c0 2023-10-16T19:40:44.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007310 con 0x7fcf500c57c0 2023-10-16T19:40:44.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.827+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50155b90 con 0x7fcf500c57c0 2023-10-16T19:40:44.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.828+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf501586d0 con 0x7fcf500c57c0 2023-10-16T19:40:44.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.829+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf40007470 con 0x7fcf500c57c0 2023-10-16T19:40:44.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.829+0000 7fcf37fff700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:44.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.829+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf40089550 con 0x7fcf500c57c0 2023-10-16T19:40:44.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.829+0000 7fcf4effd700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:44.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.830+0000 7fcf4effd700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf440090b0 tx=0x7fcf4401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:44.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:44.834+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf501586d0 con 0x7fcf500c57c0 2023-10-16T19:40:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.037+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcf501586d0 con 0x7fcf500c57c0 2023-10-16T19:40:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.040+0000 7fcf37fff700 1 -- 172.21.15.29:0/1705087916 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf501586d0 con 0x7fcf500c57c0 2023-10-16T19:40:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 msgr2=0x7fcf3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcf440090b0 tx=0x7fcf4401c040 comp rx=0 tx=0).stop 2023-10-16T19:40:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 msgr2=0x7fcf500c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcf40001eb0 tx=0x7fcf4000c800 comp rx=0 tx=0).stop 2023-10-16T19:40:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 shutdown_connections 2023-10-16T19:40:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcf50151fa0 0x7fcf501e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf500c4dd0 0x7fcf50152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 --2- 172.21.15.29:0/1705087916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf500c57c0 0x7fcf500c2350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 >> 172.21.15.29:0/1705087916 conn(0x7fcf500abf40 msgr2=0x7fcf500c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 shutdown_connections 2023-10-16T19:40:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.042+0000 7fcf55860700 1 -- 172.21.15.29:0/1705087916 wait complete. 2023-10-16T19:40:45.056 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T19:40:45.057 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T19:40:45.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T19:40:45.149 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T19:40:45.150 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:45.150 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:45.168 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:45.169 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:45.227 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:40:45.227 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:45.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.448+0000 7ffa6c750700 1 Processor -- start 2023-10-16T19:40:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.448+0000 7ffa6c750700 1 -- start start 2023-10-16T19:40:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa6413d660 0x7ffa6406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 0x7ffa641583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6406adc0 0x7ffa64158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6406d320 con 0x7ffa6406adc0 2023-10-16T19:40:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa64158e40 con 0x7ffa6413d660 2023-10-16T19:40:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6c750700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6406e780 con 0x7ffa64154a50 2023-10-16T19:40:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6406adc0 0x7ffa64158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6406adc0 0x7ffa64158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52810/0 (socket says 172.21.15.29:52810) 2023-10-16T19:40:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 -- 172.21.15.29:0/690311530 learned_addr learned my addr 172.21.15.29:0/690311530 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6a4ec700 1 --2- 172.21.15.29:0/690311530 >> v2:172.21.15.53:3300/0 conn(0x7ffa6413d660 0x7ffa6406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa69ceb700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 0x7ffa641583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 -- 172.21.15.29:0/690311530 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 msgr2=0x7ffa641583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 0x7ffa641583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 -- 172.21.15.29:0/690311530 >> v2:172.21.15.53:3300/0 conn(0x7ffa6413d660 msgr2=0x7ffa6406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 --2- 172.21.15.29:0/690311530 >> v2:172.21.15.53:3300/0 conn(0x7ffa6413d660 0x7ffa6406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 -- 172.21.15.29:0/690311530 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64154f10 con 0x7ffa6406adc0 2023-10-16T19:40:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa69ceb700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 0x7ffa641583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.449+0000 7ffa6aced700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6406adc0 0x7ffa64158900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa640c15e0 tx=0x7ffa5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1c52deaa9a8b7f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa694ea700 1 -- 172.21.15.29:0/690311530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00e070 con 0x7ffa6406adc0 2023-10-16T19:40:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa694ea700 1 -- 172.21.15.29:0/690311530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00b9c0 con 0x7ffa6406adc0 2023-10-16T19:40:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa694ea700 1 -- 172.21.15.29:0/690311530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00bd70 con 0x7ffa6406adc0 2023-10-16T19:40:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 -- 172.21.15.29:0/690311530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6406adc0 msgr2=0x7ffa64158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6406adc0 0x7ffa64158900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa640c15e0 tx=0x7ffa5c00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 -- 172.21.15.29:0/690311530 shutdown_connections 2023-10-16T19:40:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6406adc0 0x7ffa64158900 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 --2- 172.21.15.29:0/690311530 >> v2:172.21.15.53:3300/0 conn(0x7ffa6413d660 0x7ffa6406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 --2- 172.21.15.29:0/690311530 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa64154a50 0x7ffa641583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 -- 172.21.15.29:0/690311530 >> 172.21.15.29:0/690311530 conn(0x7ffa640c7110 msgr2=0x7ffa640c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 -- 172.21.15.29:0/690311530 shutdown_connections 2023-10-16T19:40:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.450+0000 7ffa6c750700 1 -- 172.21.15.29:0/690311530 wait complete. 2023-10-16T19:40:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.451+0000 7ffa6c750700 1 Processor -- start 2023-10-16T19:40:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.451+0000 7ffa6c750700 1 -- start start 2023-10-16T19:40:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6406adc0 0x7ffa640c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa6413d660 0x7ffa64157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6413c3d0 con 0x7ffa64154a50 2023-10-16T19:40:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6413b650 con 0x7ffa6406adc0 2023-10-16T19:40:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6c750700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6413ccf0 con 0x7ffa6413d660 2023-10-16T19:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6aced700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6aced700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52816/0 (socket says 172.21.15.29:52816) 2023-10-16T19:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6aced700 1 -- 172.21.15.29:0/1040548436 learned_addr learned my addr 172.21.15.29:0/1040548436 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa69ceb700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa6413d660 0x7ffa64157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.452+0000 7ffa6a4ec700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6406adc0 0x7ffa640c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 -- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa6413d660 msgr2=0x7ffa64157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa6413d660 0x7ffa64157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 -- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6406adc0 msgr2=0x7ffa640c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6406adc0 0x7ffa640c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 -- 172.21.15.29:0/1040548436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009b30 con 0x7ffa64154a50 2023-10-16T19:40:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6aced700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b370 tx=0x7ffa5c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0099b0 con 0x7ffa64154a50 2023-10-16T19:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c004250 con 0x7ffa64154a50 2023-10-16T19:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0045e0 con 0x7ffa64154a50 2023-10-16T19:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6413b8f0 con 0x7ffa64154a50 2023-10-16T19:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.453+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6413beb0 con 0x7ffa64154a50 2023-10-16T19:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.454+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa640c3780 con 0x7ffa64154a50 2023-10-16T19:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.454+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa5c004740 con 0x7ffa64154a50 2023-10-16T19:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.455+0000 7ffa5affd700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 0x7ffa4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.455+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa5c08a980 con 0x7ffa64154a50 2023-10-16T19:40:45.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.455+0000 7ffa6a4ec700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 0x7ffa4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.456+0000 7ffa6a4ec700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 0x7ffa4806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009950 tx=0x7ffa54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.459+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa5c0557b0 con 0x7ffa64154a50 2023-10-16T19:40:45.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.661+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa6404f400 con 0x7ffa64154a50 2023-10-16T19:40:45.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.662+0000 7ffa5affd700 1 -- 172.21.15.29:0/1040548436 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7ffa5c01f020 con 0x7ffa64154a50 2023-10-16T19:40:45.664 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:45.664 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:45.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 msgr2=0x7ffa4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 0x7ffa4806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009950 tx=0x7ffa54008040 comp rx=0 tx=0).stop 2023-10-16T19:40:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 msgr2=0x7ffa641e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b370 tx=0x7ffa5c004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 shutdown_connections 2023-10-16T19:40:45.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ffa4806af00 0x7ffa4806d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa64154a50 0x7ffa641e9a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6406adc0 0x7ffa640c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 --2- 172.21.15.29:0/1040548436 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffa6413d660 0x7ffa64157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 >> 172.21.15.29:0/1040548436 conn(0x7ffa640c7110 msgr2=0x7ffa640c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 shutdown_connections 2023-10-16T19:40:45.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.664+0000 7ffa6c750700 1 -- 172.21.15.29:0/1040548436 wait complete. 2023-10-16T19:40:45.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:45.680 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.806+0000 7f0f2c652700 1 Processor -- start 2023-10-16T19:40:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.806+0000 7f0f2c652700 1 -- start start 2023-10-16T19:40:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2c652700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 0x7f0f240ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2c652700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f24153290 0x7f0f2406d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2c652700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f24153710 con 0x7f0f2406de60 2023-10-16T19:40:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2c652700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f240ac7d0 con 0x7f0f24153290 2023-10-16T19:40:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2c652700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240ac5e0 con 0x7f0f2414c780 2023-10-16T19:40:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f24153290 0x7f0f2406d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f24153290 0x7f0f2406d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52822/0 (socket says 172.21.15.29:52822) 2023-10-16T19:40:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 -- 172.21.15.29:0/3669598317 learned_addr learned my addr 172.21.15.29:0/3669598317 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 0x7f0f240ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 -- 172.21.15.29:0/3669598317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 msgr2=0x7f0f240ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 0x7f0f240ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 -- 172.21.15.29:0/3669598317 >> v1:172.21.15.53:6789/0 conn(0x7f0f2406de60 legacy=0x7f0f2406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 -- 172.21.15.29:0/3669598317 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24156c60 con 0x7f0f24153290 2023-10-16T19:40:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 0x7f0f240ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.807+0000 7f0f29bed700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f24153290 0x7f0f2406d920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009920 tx=0x7f0f14009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868c66003cc9d18e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f293ec700 1 -- 172.21.15.29:0/3669598317 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14004230 con 0x7f0f24153290 2023-10-16T19:40:45.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f293ec700 1 -- 172.21.15.29:0/3669598317 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14004390 con 0x7f0f24153290 2023-10-16T19:40:45.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f293ec700 1 -- 172.21.15.29:0/3669598317 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14009e70 con 0x7f0f24153290 2023-10-16T19:40:45.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 -- 172.21.15.29:0/3669598317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f24153290 msgr2=0x7f0f2406d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f24153290 0x7f0f2406d920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009920 tx=0x7f0f14009c30 comp rx=0 tx=0).stop 2023-10-16T19:40:45.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 -- 172.21.15.29:0/3669598317 shutdown_connections 2023-10-16T19:40:45.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f2414c780 0x7f0f240ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 --2- 172.21.15.29:0/3669598317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f24153290 0x7f0f2406d920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 -- 172.21.15.29:0/3669598317 >> 172.21.15.29:0/3669598317 conn(0x7f0f240c66d0 msgr2=0x7f0f240c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:45.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 -- 172.21.15.29:0/3669598317 shutdown_connections 2023-10-16T19:40:45.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.808+0000 7f0f2c652700 1 -- 172.21.15.29:0/3669598317 wait complete. 2023-10-16T19:40:45.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.809+0000 7f0f2c652700 1 Processor -- start 2023-10-16T19:40:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.809+0000 7f0f2c652700 1 -- start start 2023-10-16T19:40:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 0x7f0f240c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 0x7f0f24137340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2414d0f0 con 0x7f0f2414c780 2023-10-16T19:40:45.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24152470 con 0x7f0f2406de60 2023-10-16T19:40:45.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2c652700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24137880 con 0x7f0f24153290 2023-10-16T19:40:45.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f29bed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f29bed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52828/0 (socket says 172.21.15.29:52828) 2023-10-16T19:40:45.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f29bed700 1 -- 172.21.15.29:0/2286344597 learned_addr learned my addr 172.21.15.29:0/2286344597 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 0x7f0f240c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f2abef700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 0x7f0f24137340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.810+0000 7f0f29bed700 1 -- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 msgr2=0x7f0f24137340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f29bed700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 0x7f0f24137340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f29bed700 1 -- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 msgr2=0x7f0f240c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f29bed700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 0x7f0f240c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f29bed700 1 -- 172.21.15.29:0/2286344597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009550 con 0x7f0f2414c780 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 0x7f0f240c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f2abef700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 0x7f0f24137340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f29bed700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009870 tx=0x7f0f14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140036a0 con 0x7f0f2414c780 2023-10-16T19:40:45.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14003800 con 0x7f0f2414c780 2023-10-16T19:40:45.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f241526a0 con 0x7f0f2414c780 2023-10-16T19:40:45.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14003b90 con 0x7f0f2414c780 2023-10-16T19:40:45.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.811+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f241ebbc0 con 0x7f0f2414c780 2023-10-16T19:40:45.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.812+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2404f400 con 0x7f0f2414c780 2023-10-16T19:40:45.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.812+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f14003cf0 con 0x7f0f2414c780 2023-10-16T19:40:45.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.813+0000 7f0f1affd700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 0x7f0f0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:45.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.813+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f1408b2c0 con 0x7f0f2414c780 2023-10-16T19:40:45.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.813+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 0x7f0f0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:45.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.814+0000 7f0f2a3ee700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 0x7f0f0806d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f200089b0 tx=0x7f0f20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:45.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:45.817+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f14056040 con 0x7f0f2414c780 2023-10-16T19:40:46.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.018+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f24156430 con 0x7f0f2414c780 2023-10-16T19:40:46.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.018+0000 7f0f1affd700 1 -- 172.21.15.29:0/2286344597 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f14059660 con 0x7f0f2414c780 2023-10-16T19:40:46.021 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:46.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.020+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 msgr2=0x7f0f0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.020+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 0x7f0f0806d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f200089b0 tx=0x7f0f20008040 comp rx=0 tx=0).stop 2023-10-16T19:40:46.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.020+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 msgr2=0x7f0f24136e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.020+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009870 tx=0x7f0f14004750 comp rx=0 tx=0).stop 2023-10-16T19:40:46.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 shutdown_connections 2023-10-16T19:40:46.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0f0806af00 0x7f0f0806d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0f24153290 0x7f0f24137340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2406de60 0x7f0f240c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 --2- 172.21.15.29:0/2286344597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f2414c780 0x7f0f24136e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 >> 172.21.15.29:0/2286344597 conn(0x7f0f240c66d0 msgr2=0x7f0f2414b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 shutdown_connections 2023-10-16T19:40:46.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.021+0000 7f0f2c652700 1 -- 172.21.15.29:0/2286344597 wait complete. 2023-10-16T19:40:46.035 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.161+0000 7f193d0a4700 1 Processor -- start 2023-10-16T19:40:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.161+0000 7f193d0a4700 1 -- start start 2023-10-16T19:40:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193d0a4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19380c3350 0x7f19381555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193d0a4700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 0x7f193806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193d0a4700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1938155af0 con 0x7f193814ec50 2023-10-16T19:40:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193d0a4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1938152300 con 0x7f19380c3350 2023-10-16T19:40:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193d0a4700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380c2e40 con 0x7f193806db00 2023-10-16T19:40:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19380c3350 0x7f19381555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19380c3350 0x7f19381555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52836/0 (socket says 172.21.15.29:52836) 2023-10-16T19:40:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193659c700 1 -- 172.21.15.29:0/2918353152 learned_addr learned my addr 172.21.15.29:0/2918353152 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.162+0000 7f193759e700 1 --2- 172.21.15.29:0/2918353152 >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 0x7f193806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193659c700 1 -- 172.21.15.29:0/2918353152 >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 msgr2=0x7f193806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193659c700 1 --2- 172.21.15.29:0/2918353152 >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 0x7f193806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193659c700 1 -- 172.21.15.29:0/2918353152 >> v1:172.21.15.53:6789/0 conn(0x7f193814ec50 legacy=0x7f1938071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193659c700 1 -- 172.21.15.29:0/2918353152 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193814f030 con 0x7f19380c3350 2023-10-16T19:40:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193759e700 1 --2- 172.21.15.29:0/2918353152 >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 0x7f193806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193659c700 1 --2- 172.21.15.29:0/2918353152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f19381555b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1938068e40 tx=0x7f192800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83045f871c6340c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f1935d9b700 1 -- 172.21.15.29:0/2918353152 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800dcf0 con 0x7f19380c3350 2023-10-16T19:40:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f1935d9b700 1 -- 172.21.15.29:0/2918353152 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800de50 con 0x7f19380c3350 2023-10-16T19:40:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f1935d9b700 1 -- 172.21.15.29:0/2918353152 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928004250 con 0x7f19380c3350 2023-10-16T19:40:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 -- 172.21.15.29:0/2918353152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 msgr2=0x7f19381555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 --2- 172.21.15.29:0/2918353152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f19381555b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1938068e40 tx=0x7f192800be70 comp rx=0 tx=0).stop 2023-10-16T19:40:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 -- 172.21.15.29:0/2918353152 shutdown_connections 2023-10-16T19:40:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 --2- 172.21.15.29:0/2918353152 >> v2:172.21.15.53:3300/0 conn(0x7f193806db00 0x7f193806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 --2- 172.21.15.29:0/2918353152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f19381555b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 -- 172.21.15.29:0/2918353152 >> 172.21.15.29:0/2918353152 conn(0x7f19380c7110 msgr2=0x7f19380c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 -- 172.21.15.29:0/2918353152 shutdown_connections 2023-10-16T19:40:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.163+0000 7f193d0a4700 1 -- 172.21.15.29:0/2918353152 wait complete. 2023-10-16T19:40:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.165+0000 7f193d0a4700 1 Processor -- start 2023-10-16T19:40:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.165+0000 7f193d0a4700 1 -- start start 2023-10-16T19:40:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f193806db00 0x7f193814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f193814ec50 0x7f1938140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193814cd40 con 0x7f19380c3350 2023-10-16T19:40:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193814aeb0 con 0x7f193806db00 2023-10-16T19:40:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19381eae70 con 0x7f193814ec50 2023-10-16T19:40:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52842/0 (socket says 172.21.15.29:52842) 2023-10-16T19:40:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 -- 172.21.15.29:0/776897197 learned_addr learned my addr 172.21.15.29:0/776897197 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f1936d9d700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f193806db00 0x7f193814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193759e700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f193814ec50 0x7f1938140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 -- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f193814ec50 msgr2=0x7f1938140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f193814ec50 0x7f1938140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 -- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f193806db00 msgr2=0x7f193814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f193806db00 0x7f193814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 -- 172.21.15.29:0/776897197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192800b7f0 con 0x7f19380c3350 2023-10-16T19:40:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193659c700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f192800beb0 tx=0x7f1928004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928004230 con 0x7f19380c3350 2023-10-16T19:40:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928010470 con 0x7f19380c3350 2023-10-16T19:40:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.166+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19381ea0b0 con 0x7f19380c3350 2023-10-16T19:40:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.167+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928010820 con 0x7f19380c3350 2023-10-16T19:40:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.167+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19381ea670 con 0x7f19380c3350 2023-10-16T19:40:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.168+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193804f400 con 0x7f19380c3350 2023-10-16T19:40:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.168+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19280193f0 con 0x7f19380c3350 2023-10-16T19:40:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.168+0000 7f191f7fe700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 0x7f192406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.168+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f192808b4a0 con 0x7f19380c3350 2023-10-16T19:40:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.169+0000 7f1936d9d700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 0x7f192406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.169+0000 7f1936d9d700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 0x7f192406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f192c007fd0 tx=0x7f192c007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.173+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1928056220 con 0x7f19380c3350 2023-10-16T19:40:46.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.373+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1938155af0 con 0x7f19380c3350 2023-10-16T19:40:46.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.374+0000 7f191f7fe700 1 -- 172.21.15.29:0/776897197 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1938155af0 con 0x7f19380c3350 2023-10-16T19:40:46.376 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:46.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 msgr2=0x7f192406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 0x7f192406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f192c007fd0 tx=0x7f192c007ec0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 msgr2=0x7f193814a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f192800beb0 tx=0x7f1928004750 comp rx=0 tx=0).stop 2023-10-16T19:40:46.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 shutdown_connections 2023-10-16T19:40:46.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192406af00 0x7f192406d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f193814ec50 0x7f1938140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f193806db00 0x7f193814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 --2- 172.21.15.29:0/776897197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380c3350 0x7f193814a460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 >> 172.21.15.29:0/776897197 conn(0x7f19380c7110 msgr2=0x7f19380c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 shutdown_connections 2023-10-16T19:40:46.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.376+0000 7f193d0a4700 1 -- 172.21.15.29:0/776897197 wait complete. 2023-10-16T19:40:46.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.517+0000 7f99ea09d700 1 Processor -- start 2023-10-16T19:40:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99ea09d700 1 -- start start 2023-10-16T19:40:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99ea09d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e413dd00 0x7f99e4158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99ea09d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e406e780 con 0x7f99e413d660 2023-10-16T19:40:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99ea09d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e4154f10 con 0x7f99e4154a50 2023-10-16T19:40:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99ea09d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406d320 con 0x7f99e413dd00 2023-10-16T19:40:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99e37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f99e413d660 0x7f99e406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38292/0 (socket says 172.21.15.29:38292) 2023-10-16T19:40:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99e37fe700 1 -- 172.21.15.29:0/3834625705 learned_addr learned my addr 172.21.15.29:0/3834625705 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.518+0000 7f99e3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e413dd00 0x7f99e4158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e3fff700 1 -- 172.21.15.29:0/3834625705 >> v1:172.21.15.53:6789/0 conn(0x7f99e4154a50 legacy=0x7f99e41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e3fff700 1 -- 172.21.15.29:0/3834625705 >> v1:172.21.15.29:6789/0 conn(0x7f99e413d660 legacy=0x7f99e406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e3fff700 1 -- 172.21.15.29:0/3834625705 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e41551f0 con 0x7f99e413dd00 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e27fc700 1 -- 172.21.15.29:0/3834625705 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664413166 0 0) 0x7f99e406e780 con 0x7f99e413d660 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e3fff700 1 --2- 172.21.15.29:0/3834625705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413dd00 0x7f99e4158ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009d90 tx=0x7f99dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5c2cf613aa9441 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e27fc700 1 -- 172.21.15.29:0/3834625705 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00e070 con 0x7f99e413dd00 2023-10-16T19:40:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e27fc700 1 -- 172.21.15.29:0/3834625705 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00bbd0 con 0x7f99e413dd00 2023-10-16T19:40:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.519+0000 7f99e27fc700 1 -- 172.21.15.29:0/3834625705 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc012430 con 0x7f99e413dd00 2023-10-16T19:40:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 -- 172.21.15.29:0/3834625705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413dd00 msgr2=0x7f99e4158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 --2- 172.21.15.29:0/3834625705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413dd00 0x7f99e4158ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009d90 tx=0x7f99dc00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 -- 172.21.15.29:0/3834625705 shutdown_connections 2023-10-16T19:40:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 --2- 172.21.15.29:0/3834625705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413dd00 0x7f99e4158ad0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 -- 172.21.15.29:0/3834625705 >> 172.21.15.29:0/3834625705 conn(0x7f99e40c7110 msgr2=0x7f99e40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 -- 172.21.15.29:0/3834625705 shutdown_connections 2023-10-16T19:40:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.520+0000 7f99ea09d700 1 -- 172.21.15.29:0/3834625705 wait complete. 2023-10-16T19:40:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.521+0000 7f99ea09d700 1 Processor -- start 2023-10-16T19:40:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.521+0000 7f99ea09d700 1 -- start start 2023-10-16T19:40:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99e413dd00 0x7f99e40c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99e4154a50 0x7f99e40ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4157f10 con 0x7f99e413d660 2023-10-16T19:40:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4139c60 con 0x7f99e413dd00 2023-10-16T19:40:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99ea09d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41e99d0 con 0x7f99e4154a50 2023-10-16T19:40:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52854/0 (socket says 172.21.15.29:52854) 2023-10-16T19:40:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.522+0000 7f99e37fe700 1 -- 172.21.15.29:0/599231396 learned_addr learned my addr 172.21.15.29:0/599231396 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e2ffd700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99e413dd00 0x7f99e40c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 -- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99e4154a50 msgr2=0x7f99e40ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99e4154a50 0x7f99e40ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 -- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99e413dd00 msgr2=0x7f99e40c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99e413dd00 0x7f99e40c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 -- 172.21.15.29:0/599231396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009a70 con 0x7f99e413d660 2023-10-16T19:40:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99e37fe700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99d400c520 tx=0x7f99d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4004c80 con 0x7f99e413d660 2023-10-16T19:40:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4004e00 con 0x7f99e413d660 2023-10-16T19:40:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4007310 con 0x7f99e413d660 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e41ea9a0 con 0x7f99e413d660 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.523+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e41e9c90 con 0x7f99e413d660 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.524+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40c3760 con 0x7f99e413d660 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.524+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f99d4007470 con 0x7f99e413d660 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.525+0000 7f99cbfff700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 0x7f99d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.525+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99d4089680 con 0x7f99e413d660 2023-10-16T19:40:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.525+0000 7f99e2ffd700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 0x7f99d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.526+0000 7f99e2ffd700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 0x7f99d006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.529+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99d4054400 con 0x7f99e413d660 2023-10-16T19:40:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.731+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99e404f400 con 0x7f99e413d660 2023-10-16T19:40:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.732+0000 7f99cbfff700 1 -- 172.21.15.29:0/599231396 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99d4057a20 con 0x7f99e413d660 2023-10-16T19:40:46.734 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:46.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 msgr2=0x7f99d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 0x7f99d006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fd0 tx=0x7f99d8009040 comp rx=0 tx=0).stop 2023-10-16T19:40:46.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 msgr2=0x7f99e41576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99d400c520 tx=0x7f99d400c8e0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 shutdown_connections 2023-10-16T19:40:46.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f99d006af00 0x7f99d006d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f99e4154a50 0x7f99e40ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e413d660 0x7f99e41576e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 --2- 172.21.15.29:0/599231396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99e413dd00 0x7f99e40c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 >> 172.21.15.29:0/599231396 conn(0x7f99e40c7110 msgr2=0x7f99e41582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 shutdown_connections 2023-10-16T19:40:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.734+0000 7f99ea09d700 1 -- 172.21.15.29:0/599231396 wait complete. 2023-10-16T19:40:46.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:46.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.874+0000 7fd697aed700 1 Processor -- start 2023-10-16T19:40:46.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.874+0000 7fd697aed700 1 -- start start 2023-10-16T19:40:46.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd697aed700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd69006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd697aed700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69006e780 con 0x7fd69006adc0 2023-10-16T19:40:46.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd697aed700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd690154f10 con 0x7fd690154a50 2023-10-16T19:40:46.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd697aed700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006d320 con 0x7fd69013d660 2023-10-16T19:40:46.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd69608a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd69006adc0 0x7fd69015f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38310/0 (socket says 172.21.15.29:38310) 2023-10-16T19:40:46.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd69608a700 1 -- 172.21.15.29:0/3094686243 learned_addr learned my addr 172.21.15.29:0/3094686243 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:46.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.875+0000 7fd695889700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd69006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124934160 0 0) 0x7fd69006e780 con 0x7fd69006adc0 2023-10-16T19:40:46.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd67c0035b0 con 0x7fd69006adc0 2023-10-16T19:40:46.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130528530 0 0) 0x7fd690154f10 con 0x7fd690154a50 2023-10-16T19:40:46.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd69006e780 con 0x7fd690154a50 2023-10-16T19:40:46.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318316560 0 0) 0x7fd67c0035b0 con 0x7fd69006adc0 2023-10-16T19:40:46.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 msgr2=0x7fd69006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:46.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd69006a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 >> v1:172.21.15.53:6789/0 conn(0x7fd690154a50 legacy=0x7fd6901583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6901551f0 con 0x7fd69006adc0 2023-10-16T19:40:46.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fd688001a40 con 0x7fd69006adc0 2023-10-16T19:40:46.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 >> v1:172.21.15.29:6789/0 conn(0x7fd69006adc0 legacy=0x7fd69015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd67c003bc0 0x7fd67c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c004850 0x7fd67c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd67c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006d320 con 0x7fd67c004850 2023-10-16T19:40:46.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c00bac0 con 0x7fd67c003bc0 2023-10-16T19:40:46.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c00bc80 con 0x7fd69013d660 2023-10-16T19:40:46.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c004850 0x7fd67c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695889700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd67c003bc0 0x7fd67c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd69608a700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd67c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 -- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 msgr2=0x7fd67c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:46.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69013d660 0x7fd67c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 -- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd67c003bc0 msgr2=0x7fd67c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:46.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd67c003bc0 0x7fd67c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.876+0000 7fd695088700 1 -- 172.21.15.29:0/3094686243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0035b0 con 0x7fd67c004850 2023-10-16T19:40:46.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd695088700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c004850 0x7fd67c004cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001940 tx=0x7fd67c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e167550308781e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c001430 con 0x7fd67c004850 2023-10-16T19:40:46.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c001d70 con 0x7fd67c004850 2023-10-16T19:40:46.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd694887700 1 -- 172.21.15.29:0/3094686243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c005510 con 0x7fd67c004850 2023-10-16T19:40:46.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 -- 172.21.15.29:0/3094686243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c004850 msgr2=0x7fd67c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 --2- 172.21.15.29:0/3094686243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd67c004850 0x7fd67c004cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001940 tx=0x7fd67c005880 comp rx=0 tx=0).stop 2023-10-16T19:40:46.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd69608a700 1 -- 172.21.15.29:0/3094686243 reap_dead start 2023-10-16T19:40:46.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 -- 172.21.15.29:0/3094686243 shutdown_connections 2023-10-16T19:40:46.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 -- 172.21.15.29:0/3094686243 >> 172.21.15.29:0/3094686243 conn(0x7fd6900c7110 msgr2=0x7fd6900c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:46.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 -- 172.21.15.29:0/3094686243 shutdown_connections 2023-10-16T19:40:46.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.877+0000 7fd697aed700 1 -- 172.21.15.29:0/3094686243 wait complete. 2023-10-16T19:40:46.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 Processor -- start 2023-10-16T19:40:46.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 -- start start 2023-10-16T19:40:46.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd67c004850 0x7fd6901ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690156500 0x7fd6900c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd690156f00 con 0x7fd6901388d0 2023-10-16T19:40:46.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901eaa00 con 0x7fd690156500 2023-10-16T19:40:46.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd697aed700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd690138440 con 0x7fd67c004850 2023-10-16T19:40:46.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd69608a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd69608a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52878/0 (socket says 172.21.15.29:52878) 2023-10-16T19:40:46.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd69608a700 1 -- 172.21.15.29:0/335173627 learned_addr learned my addr 172.21.15.29:0/335173627 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:46.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.879+0000 7fd695088700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690156500 0x7fd6900c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd695889700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd67c004850 0x7fd6901ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 -- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd67c004850 msgr2=0x7fd6901ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd67c004850 0x7fd6901ea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 -- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690156500 msgr2=0x7fd6900c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690156500 0x7fd6900c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:46.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 -- 172.21.15.29:0/335173627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900c5040 con 0x7fd6901388d0 2023-10-16T19:40:46.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd69608a700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd69006fe60 tx=0x7fd68800f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68800fbc0 con 0x7fd6901388d0 2023-10-16T19:40:46.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68800fd40 con 0x7fd6901388d0 2023-10-16T19:40:46.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd690155d10 con 0x7fd6901388d0 2023-10-16T19:40:46.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688013630 con 0x7fd6901388d0 2023-10-16T19:40:46.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.880+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd690137df0 con 0x7fd6901388d0 2023-10-16T19:40:46.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.881+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6900c3780 con 0x7fd6901388d0 2023-10-16T19:40:46.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.882+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd688007d50 con 0x7fd6901388d0 2023-10-16T19:40:46.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.882+0000 7fd6867fc700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 0x7fd67406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:46.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.882+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd688089ba0 con 0x7fd6901388d0 2023-10-16T19:40:46.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.882+0000 7fd695889700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 0x7fd67406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:46.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.883+0000 7fd695889700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 0x7fd67406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6900c1d80 tx=0x7fd680009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:46.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:46.887+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd688054920 con 0x7fd6901388d0 2023-10-16T19:40:47.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.086+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd69004f400 con 0x7fd6901388d0 2023-10-16T19:40:47.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.086+0000 7fd6867fc700 1 -- 172.21.15.29:0/335173627 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd688057f40 con 0x7fd6901388d0 2023-10-16T19:40:47.089 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:47.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 msgr2=0x7fd67406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 0x7fd67406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6900c1d80 tx=0x7fd680009210 comp rx=0 tx=0).stop 2023-10-16T19:40:47.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 msgr2=0x7fd690139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd69006fe60 tx=0x7fd68800f4b0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 shutdown_connections 2023-10-16T19:40:47.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67406af00 0x7fd67406d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6901388d0 0x7fd690139490 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd67c004850 0x7fd6901ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 --2- 172.21.15.29:0/335173627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690156500 0x7fd6900c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 >> 172.21.15.29:0/335173627 conn(0x7fd6900c7110 msgr2=0x7fd6900c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 shutdown_connections 2023-10-16T19:40:47.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.088+0000 7fd697aed700 1 -- 172.21.15.29:0/335173627 wait complete. 2023-10-16T19:40:47.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:40:47.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.226+0000 7f2bcbad4700 1 Processor -- start 2023-10-16T19:40:47.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.226+0000 7f2bcbad4700 1 -- start start 2023-10-16T19:40:47.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bcbad4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2bc406f6e0 0x7f2bc4156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bcbad4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40724a0 con 0x7f2bc4150100 2023-10-16T19:40:47.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bcbad4700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40c2660 con 0x7f2bc40c18b0 2023-10-16T19:40:47.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bcbad4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc4152780 con 0x7f2bc406f6e0 2023-10-16T19:40:47.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bc9870700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2bc406f6e0 0x7f2bc4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bca071700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2bc4150100 0x7f2bc4152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38330/0 (socket says 172.21.15.29:38330) 2023-10-16T19:40:47.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.227+0000 7f2bca071700 1 -- 172.21.15.29:0/3100593455 learned_addr learned my addr 172.21.15.29:0/3100593455 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:47.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc9870700 1 -- 172.21.15.29:0/3100593455 >> v1:172.21.15.53:6789/0 conn(0x7f2bc40c18b0 legacy=0x7f2bc414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc9870700 1 -- 172.21.15.29:0/3100593455 >> v1:172.21.15.29:6789/0 conn(0x7f2bc4150100 legacy=0x7f2bc4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc9870700 1 -- 172.21.15.29:0/3100593455 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40a8490 con 0x7f2bc406f6e0 2023-10-16T19:40:47.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc9870700 1 --2- 172.21.15.29:0/3100593455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc406f6e0 0x7f2bc4156670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009840 tx=0x7f2bc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c160086a0ce188 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc886e700 1 -- 172.21.15.29:0/3100593455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bc406f6e0 2023-10-16T19:40:47.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc886e700 1 -- 172.21.15.29:0/3100593455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011990 con 0x7f2bc406f6e0 2023-10-16T19:40:47.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.228+0000 7f2bc886e700 1 -- 172.21.15.29:0/3100593455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011d20 con 0x7f2bc406f6e0 2023-10-16T19:40:47.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 -- 172.21.15.29:0/3100593455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc406f6e0 msgr2=0x7f2bc4156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/3100593455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc406f6e0 0x7f2bc4156670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009840 tx=0x7f2bc0009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:47.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 -- 172.21.15.29:0/3100593455 shutdown_connections 2023-10-16T19:40:47.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/3100593455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc406f6e0 0x7f2bc4156670 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 -- 172.21.15.29:0/3100593455 >> 172.21.15.29:0/3100593455 conn(0x7f2bc40c7110 msgr2=0x7f2bc40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:47.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 -- 172.21.15.29:0/3100593455 shutdown_connections 2023-10-16T19:40:47.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.229+0000 7f2bcbad4700 1 -- 172.21.15.29:0/3100593455 wait complete. 2023-10-16T19:40:47.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.230+0000 7f2bcbad4700 1 Processor -- start 2023-10-16T19:40:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.230+0000 7f2bcbad4700 1 -- start start 2023-10-16T19:40:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 0x7f2bc41ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 0x7f2bc406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40c5b90 con 0x7f2bc40c18b0 2023-10-16T19:40:47.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41eda30 con 0x7f2bc406f6e0 2023-10-16T19:40:47.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bcbad4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41edf60 con 0x7f2bc4150100 2023-10-16T19:40:47.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bc906f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bc906f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52890/0 (socket says 172.21.15.29:52890) 2023-10-16T19:40:47.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.231+0000 7f2bc906f700 1 -- 172.21.15.29:0/107107074 learned_addr learned my addr 172.21.15.29:0/107107074 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:47.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc9870700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 0x7f2bc41ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bca071700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 0x7f2bc406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 -- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 msgr2=0x7f2bc406d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 0x7f2bc406d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 -- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 msgr2=0x7f2bc41ea6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 0x7f2bc41ea6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 -- 172.21.15.29:0/107107074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc00094a0 con 0x7f2bc40c18b0 2023-10-16T19:40:47.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc9870700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 0x7f2bc41ea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:47.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bca071700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 0x7f2bc406d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:47.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bc906f700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c4e0 tx=0x7f2bb400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40052d0 con 0x7f2bc40c18b0 2023-10-16T19:40:47.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb4005430 con 0x7f2bc40c18b0 2023-10-16T19:40:47.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc41ea220 con 0x7f2bc40c18b0 2023-10-16T19:40:47.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40038c0 con 0x7f2bc40c18b0 2023-10-16T19:40:47.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.232+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc41e9bd0 con 0x7f2bc40c18b0 2023-10-16T19:40:47.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.233+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc41e9a30 con 0x7f2bc40c18b0 2023-10-16T19:40:47.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.234+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bb4003a20 con 0x7f2bc40c18b0 2023-10-16T19:40:47.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.234+0000 7f2bba7fc700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 0x7f2ba806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.234+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2bb4088de0 con 0x7f2bc40c18b0 2023-10-16T19:40:47.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.234+0000 7f2bc9870700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 0x7f2ba806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.235+0000 7f2bc9870700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 0x7f2ba806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00090b0 tx=0x7f2bc0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.238+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bc41e9a30 con 0x7f2bc40c18b0 2023-10-16T19:40:47.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.456+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2bc41e9a30 con 0x7f2bc40c18b0 2023-10-16T19:40:47.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.457+0000 7f2bba7fc700 1 -- 172.21.15.29:0/107107074 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2bc41e9a30 con 0x7f2bc40c18b0 2023-10-16T19:40:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 msgr2=0x7f2ba806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 0x7f2ba806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00090b0 tx=0x7f2bc0008030 comp rx=0 tx=0).stop 2023-10-16T19:40:47.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 msgr2=0x7f2bc40c0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c4e0 tx=0x7f2bb400c8a0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 shutdown_connections 2023-10-16T19:40:47.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2ba806af00 0x7f2ba806d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2bc4150100 0x7f2bc406d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc406f6e0 0x7f2bc41ea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 --2- 172.21.15.29:0/107107074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc40c18b0 0x7f2bc40c0580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 >> 172.21.15.29:0/107107074 conn(0x7f2bc40c7110 msgr2=0x7f2bc414e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 shutdown_connections 2023-10-16T19:40:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.459+0000 7f2bcbad4700 1 -- 172.21.15.29:0/107107074 wait complete. 2023-10-16T19:40:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2023-10-16T19:40:47.473 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T19:40:47.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:47.474 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T19:40:47.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:40:47.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:47.552 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T19:40:47.569 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:40:47.570 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:47.592 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:40:47.592 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:47.653 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:40:47.653 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:40:47.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.837+0000 7f3cbbf54700 1 Processor -- start 2023-10-16T19:40:47.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.837+0000 7f3cbbf54700 1 -- start start 2023-10-16T19:40:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cbbf54700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cb406af90 0x7f3cb4153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cbbf54700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb4156c60 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cbbf54700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40ac500 con 0x7f3cb414c780 2023-10-16T19:40:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cbbf54700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40ac7d0 con 0x7f3cb406af90 2023-10-16T19:40:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cb94ef700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3cb40ac0a0 0x7f3cb406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38342/0 (socket says 172.21.15.29:38342) 2023-10-16T19:40:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cb94ef700 1 -- 172.21.15.29:0/2583054005 learned_addr learned my addr 172.21.15.29:0/2583054005 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230556772 0 0) 0x7f3cb4156c60 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca00035b0 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.838+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2583054005 >> v2:172.21.15.53:3300/0 conn(0x7f3cb406af90 0x7f3cb4153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4094495302 0 0) 0x7f3ca00035b0 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 >> v2:172.21.15.53:3300/0 conn(0x7f3cb406af90 msgr2=0x7f3cb4153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 --2- 172.21.15.29:0/2583054005 >> v2:172.21.15.53:3300/0 conn(0x7f3cb406af90 0x7f3cb4153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 >> v1:172.21.15.53:6789/0 conn(0x7f3cb414c780 legacy=0x7f3cb406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4155ea0 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f3cb0001670 con 0x7f3cb40ac0a0 2023-10-16T19:40:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 >> v1:172.21.15.29:6789/0 conn(0x7f3cb40ac0a0 legacy=0x7f3cb406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0003a00 0x7f3ca0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 0x7f3ca0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ca0005330 0x7f3ca000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40ac7d0 con 0x7f3ca0004850 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca000c200 con 0x7f3ca0003a00 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca000c3c0 con 0x7f3ca0005330 2023-10-16T19:40:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 0x7f3ca0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb9cf0700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0003a00 0x7f3ca0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ca0005330 0x7f3ca000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 -- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ca0005330 msgr2=0x7f3ca000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ca0005330 0x7f3ca000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 -- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0003a00 msgr2=0x7f3ca0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0003a00 0x7f3ca0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 -- 172.21.15.29:0/2583054005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00035b0 con 0x7f3ca0004850 2023-10-16T19:40:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3ca0005330 0x7f3ca000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cba4f1700 1 -- 172.21.15.29:0/2583054005 reap_dead start 2023-10-16T19:40:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.839+0000 7f3cb94ef700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 0x7f3ca0004cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c210 tx=0x7f3ca0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76ea54fe4972698 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0007c10 con 0x7f3ca0004850 2023-10-16T19:40:47.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000cdd0 con 0x7f3ca0004850 2023-10-16T19:40:47.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cb8cee700 1 -- 172.21.15.29:0/2583054005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0005ba0 con 0x7f3ca0004850 2023-10-16T19:40:47.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 msgr2=0x7f3ca0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 0x7f3ca0004cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c210 tx=0x7f3ca0005880 comp rx=0 tx=0).stop 2023-10-16T19:40:47.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2583054005 shutdown_connections 2023-10-16T19:40:47.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2583054005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca0004850 0x7f3ca0004cd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2583054005 >> 172.21.15.29:0/2583054005 conn(0x7f3cb40c66d0 msgr2=0x7f3cb40c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:47.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2583054005 shutdown_connections 2023-10-16T19:40:47.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.840+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2583054005 wait complete. 2023-10-16T19:40:47.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.841+0000 7f3cbbf54700 1 Processor -- start 2023-10-16T19:40:47.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.841+0000 7f3cbbf54700 1 -- start start 2023-10-16T19:40:47.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 0x7f3cb4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3cb414e0a0 0x7f3cb41eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb414e690 con 0x7f3cb414cb60 2023-10-16T19:40:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4154460 con 0x7f3ca0004850 2023-10-16T19:40:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cbbf54700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41eb4b0 con 0x7f3cb414e0a0 2023-10-16T19:40:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cba4f1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cba4f1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52912/0 (socket says 172.21.15.29:52912) 2023-10-16T19:40:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cba4f1700 1 -- 172.21.15.29:0/2446290422 learned_addr learned my addr 172.21.15.29:0/2446290422 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.842+0000 7f3cb9cf0700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 0x7f3cb4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 -- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3cb414e0a0 msgr2=0x7f3cb41eb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cb94ef700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3cb414e0a0 0x7f3cb41eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3cb414e0a0 0x7f3cb41eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 -- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 msgr2=0x7f3cb4155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 0x7f3cb4155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 -- 172.21.15.29:0/2446290422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4154c70 con 0x7f3cb414cb60 2023-10-16T19:40:47.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cb9cf0700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 0x7f3cb4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:47.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cba4f1700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007cf0 tx=0x7f3cac0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00e050 con 0x7f3cb414cb60 2023-10-16T19:40:47.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00f040 con 0x7f3cb414cb60 2023-10-16T19:40:47.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb41546b0 con 0x7f3cb414cb60 2023-10-16T19:40:47.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac010e80 con 0x7f3cb414cb60 2023-10-16T19:40:47.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.843+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4155a80 con 0x7f3cb414cb60 2023-10-16T19:40:47.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.844+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb40aa5e0 con 0x7f3cb414cb60 2023-10-16T19:40:47.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.844+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3cac015440 con 0x7f3cb414cb60 2023-10-16T19:40:47.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.845+0000 7f3caa7fc700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 0x7f3c9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:47.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.845+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3cac089f50 con 0x7f3cb414cb60 2023-10-16T19:40:47.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.845+0000 7f3cb9cf0700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 0x7f3c9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:47.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.846+0000 7f3cb9cf0700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 0x7f3c9806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007fd0 tx=0x7f3ca4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:47.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:47.849+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cac054c30 con 0x7f3cb414cb60 2023-10-16T19:40:48.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.051+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cb404f400 con 0x7f3cb414cb60 2023-10-16T19:40:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.052+0000 7f3caa7fc700 1 -- 172.21.15.29:0/2446290422 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f3cac058250 con 0x7f3cb414cb60 2023-10-16T19:40:48.054 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:48.055 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:48.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 msgr2=0x7f3c9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 0x7f3c9806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4007fd0 tx=0x7f3ca4009040 comp rx=0 tx=0).stop 2023-10-16T19:40:48.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 msgr2=0x7f3cb41ebe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007cf0 tx=0x7f3cac0104a0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 shutdown_connections 2023-10-16T19:40:48.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3c9806af00 0x7f3c9806d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb414cb60 0x7f3cb41ebe80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca0004850 0x7f3cb4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 --2- 172.21.15.29:0/2446290422 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3cb414e0a0 0x7f3cb41eb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 >> 172.21.15.29:0/2446290422 conn(0x7f3cb40c66d0 msgr2=0x7f3cb41476f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 shutdown_connections 2023-10-16T19:40:48.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.054+0000 7f3cbbf54700 1 -- 172.21.15.29:0/2446290422 wait complete. 2023-10-16T19:40:48.068 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:48.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.195+0000 7f194ad48700 1 Processor -- start 2023-10-16T19:40:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.195+0000 7f194ad48700 1 -- start start 2023-10-16T19:40:48.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f194ad48700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1944152100 0x7f194406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f194ad48700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f194ad48700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194406df70 con 0x7f19440c6cb0 2023-10-16T19:40:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f194ad48700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19440c6880 con 0x7f1944152100 2023-10-16T19:40:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f194ad48700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944158e50 con 0x7f194406b990 2023-10-16T19:40:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f1948ae4700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1944152100 0x7f194406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:45374/0 (socket says 172.21.15.29:45374) 2023-10-16T19:40:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 -- 172.21.15.29:0/1043352128 learned_addr learned my addr 172.21.15.29:0/1043352128 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 -- 172.21.15.29:0/1043352128 >> v2:172.21.15.53:3300/0 conn(0x7f1944152100 msgr2=0x7f194406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 --2- 172.21.15.29:0/1043352128 >> v2:172.21.15.53:3300/0 conn(0x7f1944152100 0x7f194406fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 -- 172.21.15.29:0/1043352128 >> v1:172.21.15.53:6789/0 conn(0x7f19440c6cb0 legacy=0x7f19440c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.196+0000 7f19492e5700 1 -- 172.21.15.29:0/1043352128 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194406d490 con 0x7f194406b990 2023-10-16T19:40:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f19492e5700 1 --2- 172.21.15.29:0/1043352128 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f193c009e50 tx=0x7f193c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e287a2cce38a82f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f19437fe700 1 -- 172.21.15.29:0/1043352128 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00e070 con 0x7f194406b990 2023-10-16T19:40:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f19437fe700 1 -- 172.21.15.29:0/1043352128 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b910 con 0x7f194406b990 2023-10-16T19:40:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f19437fe700 1 -- 172.21.15.29:0/1043352128 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00bcc0 con 0x7f194406b990 2023-10-16T19:40:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 -- 172.21.15.29:0/1043352128 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 msgr2=0x7f1944157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 --2- 172.21.15.29:0/1043352128 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f193c009e50 tx=0x7f193c00b330 comp rx=0 tx=0).stop 2023-10-16T19:40:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 -- 172.21.15.29:0/1043352128 shutdown_connections 2023-10-16T19:40:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 --2- 172.21.15.29:0/1043352128 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f194406b990 0x7f1944157f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 --2- 172.21.15.29:0/1043352128 >> v2:172.21.15.53:3300/0 conn(0x7f1944152100 0x7f194406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 -- 172.21.15.29:0/1043352128 >> 172.21.15.29:0/1043352128 conn(0x7f19440c7fc0 msgr2=0x7f19440c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 -- 172.21.15.29:0/1043352128 shutdown_connections 2023-10-16T19:40:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.197+0000 7f194ad48700 1 -- 172.21.15.29:0/1043352128 wait complete. 2023-10-16T19:40:48.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.198+0000 7f194ad48700 1 Processor -- start 2023-10-16T19:40:48.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 -- start start 2023-10-16T19:40:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19440c6cb0 0x7f1944156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1944152100 0x7f1944156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441543f0 con 0x7f194406b990 2023-10-16T19:40:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194414f910 con 0x7f1944152100 2023-10-16T19:40:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f194ad48700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19441ea380 con 0x7f19440c6cb0 2023-10-16T19:40:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f1948ae4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.199+0000 7f1948ae4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52922/0 (socket says 172.21.15.29:52922) 2023-10-16T19:40:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 -- 172.21.15.29:0/2757928065 learned_addr learned my addr 172.21.15.29:0/2757928065 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1943fff700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19440c6cb0 0x7f1944156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f19492e5700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1944152100 0x7f1944156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 -- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19440c6cb0 msgr2=0x7f1944156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19440c6cb0 0x7f1944156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 -- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1944152100 msgr2=0x7f1944156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1944152100 0x7f1944156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 -- 172.21.15.29:0/2757928065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009b30 con 0x7f194406b990 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f1948ae4700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f193800e930 tx=0x7f193800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938009650 con 0x7f194406b990 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938013680 con 0x7f194406b990 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19441e9ac0 con 0x7f194406b990 2023-10-16T19:40:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380139f0 con 0x7f194406b990 2023-10-16T19:40:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.200+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441ea010 con 0x7f194406b990 2023-10-16T19:40:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.201+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194404f400 con 0x7f194406b990 2023-10-16T19:40:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.202+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1938013b50 con 0x7f194406b990 2023-10-16T19:40:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.202+0000 7f19417fa700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 0x7f192806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.202+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1938089f60 con 0x7f194406b990 2023-10-16T19:40:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.202+0000 7f1943fff700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 0x7f192806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.203+0000 7f1943fff700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 0x7f192806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19440aabb0 tx=0x7f1930009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.206+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1938054dc0 con 0x7f194406b990 2023-10-16T19:40:48.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.404+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19440c7410 con 0x7f194406b990 2023-10-16T19:40:48.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.405+0000 7f19417fa700 1 -- 172.21.15.29:0/2757928065 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19380210a0 con 0x7f194406b990 2023-10-16T19:40:48.407 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:48.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 msgr2=0x7f192806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 0x7f192806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19440aabb0 tx=0x7f1930009040 comp rx=0 tx=0).stop 2023-10-16T19:40:48.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 msgr2=0x7f19440bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f193800e930 tx=0x7f193800ec40 comp rx=0 tx=0).stop 2023-10-16T19:40:48.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 shutdown_connections 2023-10-16T19:40:48.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f192806af00 0x7f192806d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1944152100 0x7f1944156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f194406b990 0x7f19440bdea0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 --2- 172.21.15.29:0/2757928065 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19440c6cb0 0x7f1944156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 >> 172.21.15.29:0/2757928065 conn(0x7f19440c7fc0 msgr2=0x7f19440c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 shutdown_connections 2023-10-16T19:40:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.407+0000 7f194ad48700 1 -- 172.21.15.29:0/2757928065 wait complete. 2023-10-16T19:40:48.421 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.547+0000 7f025af7c700 1 Processor -- start 2023-10-16T19:40:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.547+0000 7f025af7c700 1 -- start start 2023-10-16T19:40:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f025af7c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f02541520b0 0x7f025406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f025af7c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0254154da0 con 0x7f02540714a0 2023-10-16T19:40:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f025af7c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0254155080 con 0x7f02540c3240 2023-10-16T19:40:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f025af7c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0254155b60 con 0x7f02541520b0 2023-10-16T19:40:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f0258d18700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f02540714a0 0x7f0254147ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38374/0 (socket says 172.21.15.29:38374) 2023-10-16T19:40:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f0253fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f02541520b0 0x7f025406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.548+0000 7f0258d18700 1 -- 172.21.15.29:0/3320142446 learned_addr learned my addr 172.21.15.29:0/3320142446 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f0253fff700 1 -- 172.21.15.29:0/3320142446 >> v1:172.21.15.53:6789/0 conn(0x7f02540c3240 legacy=0x7f025406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f0253fff700 1 -- 172.21.15.29:0/3320142446 >> v1:172.21.15.29:6789/0 conn(0x7f02540714a0 legacy=0x7f0254147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f0253fff700 1 -- 172.21.15.29:0/3320142446 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254155360 con 0x7f02541520b0 2023-10-16T19:40:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f02537fe700 1 -- 172.21.15.29:0/3320142446 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291478540 0 0) 0x7f0254154da0 con 0x7f02540714a0 2023-10-16T19:40:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f0253fff700 1 --2- 172.21.15.29:0/3320142446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02541520b0 0x7f025406ded0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0240009840 tx=0x7f0240009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3881a9a8b29870 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f02537fe700 1 -- 172.21.15.29:0/3320142446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011830 con 0x7f02541520b0 2023-10-16T19:40:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f02537fe700 1 -- 172.21.15.29:0/3320142446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240011990 con 0x7f02541520b0 2023-10-16T19:40:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f02537fe700 1 -- 172.21.15.29:0/3320142446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011d20 con 0x7f02541520b0 2023-10-16T19:40:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f025af7c700 1 -- 172.21.15.29:0/3320142446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02541520b0 msgr2=0x7f025406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f025af7c700 1 --2- 172.21.15.29:0/3320142446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02541520b0 0x7f025406ded0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0240009840 tx=0x7f0240009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f025af7c700 1 -- 172.21.15.29:0/3320142446 shutdown_connections 2023-10-16T19:40:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.549+0000 7f025af7c700 1 --2- 172.21.15.29:0/3320142446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02541520b0 0x7f025406ded0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.550+0000 7f025af7c700 1 -- 172.21.15.29:0/3320142446 >> 172.21.15.29:0/3320142446 conn(0x7f02540c7100 msgr2=0x7f02540c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.550+0000 7f025af7c700 1 -- 172.21.15.29:0/3320142446 shutdown_connections 2023-10-16T19:40:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.550+0000 7f025af7c700 1 -- 172.21.15.29:0/3320142446 wait complete. 2023-10-16T19:40:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.551+0000 7f025af7c700 1 Processor -- start 2023-10-16T19:40:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.551+0000 7f025af7c700 1 -- start start 2023-10-16T19:40:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.551+0000 7f025af7c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02540714a0 0x7f0254154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02541520b0 0x7f02541eb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02541edf20 con 0x7f02540c3240 2023-10-16T19:40:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254154980 con 0x7f02541520b0 2023-10-16T19:40:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02541ed030 con 0x7f02540714a0 2023-10-16T19:40:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52938/0 (socket says 172.21.15.29:52938) 2023-10-16T19:40:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 -- 172.21.15.29:0/1333188820 learned_addr learned my addr 172.21.15.29:0/1333188820 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0258d18700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02540714a0 0x7f0254154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0259519700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02541520b0 0x7f02541eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 -- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02540714a0 msgr2=0x7f0254154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02540714a0 0x7f0254154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 -- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02541520b0 msgr2=0x7f02541eb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02541520b0 0x7f02541eb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 -- 172.21.15.29:0/1333188820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400094a0 con 0x7f02540c3240 2023-10-16T19:40:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f0253fff700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0254072100 tx=0x7f0240004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240004550 con 0x7f02540c3240 2023-10-16T19:40:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02400036a0 con 0x7f02540c3240 2023-10-16T19:40:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02541ed310 con 0x7f02540c3240 2023-10-16T19:40:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240003a50 con 0x7f02540c3240 2023-10-16T19:40:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.552+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02541ed8d0 con 0x7f02540c3240 2023-10-16T19:40:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.553+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02541eafa0 con 0x7f02540c3240 2023-10-16T19:40:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.554+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0240003bb0 con 0x7f02540c3240 2023-10-16T19:40:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.554+0000 7f02517fa700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 0x7f023806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.554+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f024008ad80 con 0x7f02540c3240 2023-10-16T19:40:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.554+0000 7f0258d18700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 0x7f023806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.555+0000 7f0258d18700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 0x7f023806d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0248007c40 tx=0x7f0248007b90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.559+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02541eafa0 con 0x7f02540c3240 2023-10-16T19:40:48.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.757+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02541eafa0 con 0x7f02540c3240 2023-10-16T19:40:48.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.757+0000 7f02517fa700 1 -- 172.21.15.29:0/1333188820 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02541eafa0 con 0x7f02540c3240 2023-10-16T19:40:48.759 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:48.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 msgr2=0x7f023806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 0x7f023806d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0248007c40 tx=0x7f0248007b90 comp rx=0 tx=0).stop 2023-10-16T19:40:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 msgr2=0x7f02540c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0254072100 tx=0x7f0240004750 comp rx=0 tx=0).stop 2023-10-16T19:40:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 shutdown_connections 2023-10-16T19:40:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f023806af00 0x7f023806d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02541520b0 0x7f02541eb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f02540714a0 0x7f0254154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 --2- 172.21.15.29:0/1333188820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02540c3240 0x7f02540c04e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 >> 172.21.15.29:0/1333188820 conn(0x7f02540c7100 msgr2=0x7f02540c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 shutdown_connections 2023-10-16T19:40:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.759+0000 7f025af7c700 1 -- 172.21.15.29:0/1333188820 wait complete. 2023-10-16T19:40:48.773 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:48.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.899+0000 7f7bbf595700 1 Processor -- start 2023-10-16T19:40:48.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.899+0000 7f7bbf595700 1 -- start start 2023-10-16T19:40:48.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbf595700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7bb814ec50 0x7f7bb81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbf595700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb8155af0 con 0x7f7bb806db00 2023-10-16T19:40:48.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbf595700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb8152300 con 0x7f7bb80c3350 2023-10-16T19:40:48.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbf595700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb80c2e40 con 0x7f7bb814ec50 2023-10-16T19:40:48.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbd331700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7bb814ec50 0x7f7bb81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbdb32700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7bb806db00 0x7f7bb806df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38392/0 (socket says 172.21.15.29:38392) 2023-10-16T19:40:48.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbdb32700 1 -- 172.21.15.29:0/2573033030 learned_addr learned my addr 172.21.15.29:0/2573033030 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbd331700 1 -- 172.21.15.29:0/2573033030 >> v1:172.21.15.53:6789/0 conn(0x7f7bb80c3350 legacy=0x7f7bb8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbd331700 1 -- 172.21.15.29:0/2573033030 >> v1:172.21.15.29:6789/0 conn(0x7f7bb806db00 legacy=0x7f7bb806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbd331700 1 -- 172.21.15.29:0/2573033030 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb814f030 con 0x7f7bb814ec50 2023-10-16T19:40:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.900+0000 7f7bbd331700 1 --2- 172.21.15.29:0/2573033030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb814ec50 0x7f7bb81555b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009840 tx=0x7f7bb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b46c32ff8585648 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7baffff700 1 -- 172.21.15.29:0/2573033030 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4011830 con 0x7f7bb814ec50 2023-10-16T19:40:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7baffff700 1 -- 172.21.15.29:0/2573033030 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4011990 con 0x7f7bb814ec50 2023-10-16T19:40:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7baffff700 1 -- 172.21.15.29:0/2573033030 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4011d20 con 0x7f7bb814ec50 2023-10-16T19:40:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 -- 172.21.15.29:0/2573033030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb814ec50 msgr2=0x7f7bb81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2573033030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb814ec50 0x7f7bb81555b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009840 tx=0x7f7bb4009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 -- 172.21.15.29:0/2573033030 shutdown_connections 2023-10-16T19:40:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2573033030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb814ec50 0x7f7bb81555b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 -- 172.21.15.29:0/2573033030 >> 172.21.15.29:0/2573033030 conn(0x7f7bb80c7110 msgr2=0x7f7bb80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 -- 172.21.15.29:0/2573033030 shutdown_connections 2023-10-16T19:40:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.901+0000 7f7bbf595700 1 -- 172.21.15.29:0/2573033030 wait complete. 2023-10-16T19:40:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.902+0000 7f7bbf595700 1 Processor -- start 2023-10-16T19:40:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.902+0000 7f7bbf595700 1 -- start start 2023-10-16T19:40:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bb80c3350 0x7f7bb8144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb814ec50 0x7f7bb81df300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8154890 con 0x7f7bb806db00 2023-10-16T19:40:48.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81ee170 con 0x7f7bb814ec50 2023-10-16T19:40:48.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbf595700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81ed880 con 0x7f7bb80c3350 2023-10-16T19:40:48.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52950/0 (socket says 172.21.15.29:52950) 2023-10-16T19:40:48.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 -- 172.21.15.29:0/2400845204 learned_addr learned my addr 172.21.15.29:0/2400845204 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:48.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 -- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bb80c3350 msgr2=0x7f7bb8144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bb80c3350 0x7f7bb8144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 -- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb814ec50 msgr2=0x7f7bb81df300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:48.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb814ec50 0x7f7bb81df300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:48.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.903+0000 7f7bbd331700 1 -- 172.21.15.29:0/2400845204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40094a0 con 0x7f7bb806db00 2023-10-16T19:40:48.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7bbd331700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000c00 tx=0x7f7bb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40038a0 con 0x7f7bb806db00 2023-10-16T19:40:48.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb401e070 con 0x7f7bb806db00 2023-10-16T19:40:48.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb814b8d0 con 0x7f7bb806db00 2023-10-16T19:40:48.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4003c60 con 0x7f7bb806db00 2023-10-16T19:40:48.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.904+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb81ede00 con 0x7f7bb806db00 2023-10-16T19:40:48.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.905+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb804f400 con 0x7f7bb806db00 2023-10-16T19:40:48.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.905+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bb402d450 con 0x7f7bb806db00 2023-10-16T19:40:48.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.906+0000 7f7badffb700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 0x7f7b9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:48.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.906+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7bb408aa90 con 0x7f7bb806db00 2023-10-16T19:40:48.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.906+0000 7f7bbcb30700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 0x7f7b9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:48.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.907+0000 7f7bbcb30700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 0x7f7b9c06d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba8007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:48.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:48.910+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bb4055810 con 0x7f7bb806db00 2023-10-16T19:40:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.111+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bb80a88d0 con 0x7f7bb806db00 2023-10-16T19:40:49.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.112+0000 7f7badffb700 1 -- 172.21.15.29:0/2400845204 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7bb40150a0 con 0x7f7bb806db00 2023-10-16T19:40:49.114 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 msgr2=0x7f7b9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 0x7f7b9c06d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba8007a40 comp rx=0 tx=0).stop 2023-10-16T19:40:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 msgr2=0x7f7bb814b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000c00 tx=0x7f7bb4004750 comp rx=0 tx=0).stop 2023-10-16T19:40:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 shutdown_connections 2023-10-16T19:40:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7b9c06af00 0x7f7b9c06d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb814ec50 0x7f7bb81df300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bb806db00 0x7f7bb814b080 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 --2- 172.21.15.29:0/2400845204 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bb80c3350 0x7f7bb8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 >> 172.21.15.29:0/2400845204 conn(0x7f7bb80c7110 msgr2=0x7f7bb814d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 shutdown_connections 2023-10-16T19:40:49.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.114+0000 7f7bbf595700 1 -- 172.21.15.29:0/2400845204 wait complete. 2023-10-16T19:40:49.128 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:49.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.254+0000 7f9481fef700 1 Processor -- start 2023-10-16T19:40:49.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.254+0000 7f9481fef700 1 -- start start 2023-10-16T19:40:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f9481fef700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f947c13d660 0x7f947c06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f9481fef700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f947c06adc0 0x7f947c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f9481fef700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c06e780 con 0x7f947c154a50 2023-10-16T19:40:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f9481fef700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c06d320 con 0x7f947c06adc0 2023-10-16T19:40:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f9481fef700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c154f10 con 0x7f947c13d660 2023-10-16T19:40:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f947bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f947c06adc0 0x7f947c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f947affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f947c154a50 0x7f947c1583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38404/0 (socket says 172.21.15.29:38404) 2023-10-16T19:40:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f947affd700 1 -- 172.21.15.29:0/2606771780 learned_addr learned my addr 172.21.15.29:0/2606771780 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.255+0000 7f947b7fe700 1 --2- 172.21.15.29:0/2606771780 >> v2:172.21.15.53:3300/0 conn(0x7f947c13d660 0x7f947c06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947bfff700 1 -- 172.21.15.29:0/2606771780 >> v2:172.21.15.53:3300/0 conn(0x7f947c13d660 msgr2=0x7f947c06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947bfff700 1 --2- 172.21.15.29:0/2606771780 >> v2:172.21.15.53:3300/0 conn(0x7f947c13d660 0x7f947c06a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947bfff700 1 -- 172.21.15.29:0/2606771780 >> v1:172.21.15.29:6789/0 conn(0x7f947c154a50 legacy=0x7f947c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947a7fc700 1 -- 172.21.15.29:0/2606771780 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554014077 0 0) 0x7f947c06e780 con 0x7f947c154a50 2023-10-16T19:40:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947bfff700 1 -- 172.21.15.29:0/2606771780 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c1551f0 con 0x7f947c06adc0 2023-10-16T19:40:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947bfff700 1 --2- 172.21.15.29:0/2606771780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c06adc0 0x7f947c158ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c15e0 tx=0x7f947400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879a8b7a480e15e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947a7fc700 1 -- 172.21.15.29:0/2606771780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947400e070 con 0x7f947c06adc0 2023-10-16T19:40:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947a7fc700 1 -- 172.21.15.29:0/2606771780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947400bb20 con 0x7f947c06adc0 2023-10-16T19:40:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.256+0000 7f947a7fc700 1 -- 172.21.15.29:0/2606771780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474012430 con 0x7f947c06adc0 2023-10-16T19:40:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 -- 172.21.15.29:0/2606771780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c06adc0 msgr2=0x7f947c158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 --2- 172.21.15.29:0/2606771780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c06adc0 0x7f947c158ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c15e0 tx=0x7f947400b330 comp rx=0 tx=0).stop 2023-10-16T19:40:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 -- 172.21.15.29:0/2606771780 shutdown_connections 2023-10-16T19:40:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 --2- 172.21.15.29:0/2606771780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c06adc0 0x7f947c158ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 --2- 172.21.15.29:0/2606771780 >> v2:172.21.15.53:3300/0 conn(0x7f947c13d660 0x7f947c06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 -- 172.21.15.29:0/2606771780 >> 172.21.15.29:0/2606771780 conn(0x7f947c0c7110 msgr2=0x7f947c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 -- 172.21.15.29:0/2606771780 shutdown_connections 2023-10-16T19:40:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.257+0000 7f9481fef700 1 -- 172.21.15.29:0/2606771780 wait complete. 2023-10-16T19:40:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.258+0000 7f9481fef700 1 Processor -- start 2023-10-16T19:40:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.258+0000 7f9481fef700 1 -- start start 2023-10-16T19:40:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f947c06adc0 0x7f947c1ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f947c154a50 0x7f947c13b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c138d80 con 0x7f947c13d660 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c139b90 con 0x7f947c06adc0 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1ea920 con 0x7f947c154a50 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52966/0 (socket says 172.21.15.29:52966) 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 -- 172.21.15.29:0/2490580783 learned_addr learned my addr 172.21.15.29:0/2490580783 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947b7fe700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f947c06adc0 0x7f947c1ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 -- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f947c154a50 msgr2=0x7f947c13b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f947c154a50 0x7f947c13b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 -- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f947c06adc0 msgr2=0x7f947c1ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f947c06adc0 0x7f947c1ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 -- 172.21.15.29:0/2490580783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009a70 con 0x7f947c13d660 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f947affd700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f947000c550 tx=0x7f947000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470004c80 con 0x7f947c13d660 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470004e00 con 0x7f947c13d660 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470007310 con 0x7f947c13d660 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c139da0 con 0x7f947c13d660 2023-10-16T19:40:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.259+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c13a360 con 0x7f947c13d660 2023-10-16T19:40:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.261+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c0c3760 con 0x7f947c13d660 2023-10-16T19:40:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.261+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9470007470 con 0x7f947c13d660 2023-10-16T19:40:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.261+0000 7f9463fff700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 0x7f946806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.261+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94700895e0 con 0x7f947c13d660 2023-10-16T19:40:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.262+0000 7f947b7fe700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 0x7f946806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.262+0000 7f947b7fe700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 0x7f946806d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f947c1365e0 tx=0x7f946c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.266+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9470054360 con 0x7f947c13d660 2023-10-16T19:40:49.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.469+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f947c04f400 con 0x7f947c13d660 2023-10-16T19:40:49.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.469+0000 7f9463fff700 1 -- 172.21.15.29:0/2490580783 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9470057980 con 0x7f947c13d660 2023-10-16T19:40:49.474 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:49.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 msgr2=0x7f946806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 0x7f946806d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f947c1365e0 tx=0x7f946c008040 comp rx=0 tx=0).stop 2023-10-16T19:40:49.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 msgr2=0x7f947c137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f947000c550 tx=0x7f947000c910 comp rx=0 tx=0).stop 2023-10-16T19:40:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 shutdown_connections 2023-10-16T19:40:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f946806af30 0x7f946806d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f947c154a50 0x7f947c13b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f947c06adc0 0x7f947c1ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 --2- 172.21.15.29:0/2490580783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f947c13d660 0x7f947c137f10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 >> 172.21.15.29:0/2490580783 conn(0x7f947c0c7110 msgr2=0x7f947c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 shutdown_connections 2023-10-16T19:40:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.471+0000 7f9481fef700 1 -- 172.21.15.29:0/2490580783 wait complete. 2023-10-16T19:40:49.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:40:49.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.610+0000 7fcb93dfc700 1 Processor -- start 2023-10-16T19:40:49.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.610+0000 7fcb93dfc700 1 -- start start 2023-10-16T19:40:49.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb93dfc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb8c154a50 0x7fcb8c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb93dfc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb8c13dd00 0x7fcb8c158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb93dfc700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c158e40 con 0x7fcb8c13d660 2023-10-16T19:40:49.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb93dfc700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c06d320 con 0x7fcb8c13dd00 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb93dfc700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c06e780 con 0x7fcb8c154a50 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb91b98700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcb8c13d660 0x7fcb8c06a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38416/0 (socket says 172.21.15.29:38416) 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb91b98700 1 -- 172.21.15.29:0/1975133431 learned_addr learned my addr 172.21.15.29:0/1975133431 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 --2- 172.21.15.29:0/1975133431 >> v2:172.21.15.29:3300/0 conn(0x7fcb8c13dd00 0x7fcb8c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb90b96700 1 -- 172.21.15.29:0/1975133431 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760806119 0 0) 0x7fcb8c158e40 con 0x7fcb8c13d660 2023-10-16T19:40:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb91397700 1 --2- 172.21.15.29:0/1975133431 >> v2:172.21.15.53:3300/0 conn(0x7fcb8c154a50 0x7fcb8c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb90b96700 1 -- 172.21.15.29:0/1975133431 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb780035b0 con 0x7fcb8c13d660 2023-10-16T19:40:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 -- 172.21.15.29:0/1975133431 >> v2:172.21.15.53:3300/0 conn(0x7fcb8c154a50 msgr2=0x7fcb8c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 --2- 172.21.15.29:0/1975133431 >> v2:172.21.15.53:3300/0 conn(0x7fcb8c154a50 0x7fcb8c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 -- 172.21.15.29:0/1975133431 >> v1:172.21.15.29:6789/0 conn(0x7fcb8c13d660 legacy=0x7fcb8c06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 -- 172.21.15.29:0/1975133431 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c154f10 con 0x7fcb8c13dd00 2023-10-16T19:40:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.611+0000 7fcb92399700 1 --2- 172.21.15.29:0/1975133431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c158900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0c1780 tx=0x7fcb8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a703ba1daf539d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb90b96700 1 -- 172.21.15.29:0/1975133431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400e070 con 0x7fcb8c13dd00 2023-10-16T19:40:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb90b96700 1 -- 172.21.15.29:0/1975133431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400bb20 con 0x7fcb8c13dd00 2023-10-16T19:40:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb90b96700 1 -- 172.21.15.29:0/1975133431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84012430 con 0x7fcb8c13dd00 2023-10-16T19:40:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 -- 172.21.15.29:0/1975133431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 msgr2=0x7fcb8c158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/1975133431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c158900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0c1780 tx=0x7fcb8400b330 comp rx=0 tx=0).stop 2023-10-16T19:40:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 -- 172.21.15.29:0/1975133431 shutdown_connections 2023-10-16T19:40:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/1975133431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c158900 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/1975133431 >> v2:172.21.15.53:3300/0 conn(0x7fcb8c154a50 0x7fcb8c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 -- 172.21.15.29:0/1975133431 >> 172.21.15.29:0/1975133431 conn(0x7fcb8c0c7110 msgr2=0x7fcb8c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 -- 172.21.15.29:0/1975133431 shutdown_connections 2023-10-16T19:40:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.612+0000 7fcb93dfc700 1 -- 172.21.15.29:0/1975133431 wait complete. 2023-10-16T19:40:49.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.613+0000 7fcb93dfc700 1 Processor -- start 2023-10-16T19:40:49.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.613+0000 7fcb93dfc700 1 -- start start 2023-10-16T19:40:49.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb8c13d660 0x7fcb8c1eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb8c154a50 0x7fcb8c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c5950 con 0x7fcb8c13dd00 2023-10-16T19:40:49.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c1545f0 con 0x7fcb8c154a50 2023-10-16T19:40:49.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb93dfc700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c1edfa0 con 0x7fcb8c13d660 2023-10-16T19:40:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb91397700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb91397700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52980/0 (socket says 172.21.15.29:52980) 2023-10-16T19:40:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb91397700 1 -- 172.21.15.29:0/2142599810 learned_addr learned my addr 172.21.15.29:0/2142599810 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb91397700 1 -- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb8c13d660 msgr2=0x7fcb8c1eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.614+0000 7fcb91b98700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb8c13d660 0x7fcb8c1eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb92399700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb8c154a50 0x7fcb8c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb91397700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb8c13d660 0x7fcb8c1eb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb91397700 1 -- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb8c154a50 msgr2=0x7fcb8c0c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb91397700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb8c154a50 0x7fcb8c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb91397700 1 -- 172.21.15.29:0/2142599810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009a70 con 0x7fcb8c13dd00 2023-10-16T19:40:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb91397700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d800 tx=0x7fcb7c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0125f0 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c012750 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c012b00 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0c5300 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.615+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c13c7b0 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.616+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0c5b00 con 0x7fcb8c13dd00 2023-10-16T19:40:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.616+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcb7c012c60 con 0x7fcb8c13dd00 2023-10-16T19:40:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.617+0000 7fcb827fc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 0x7fcb7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.617+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb7c089c90 con 0x7fcb8c13dd00 2023-10-16T19:40:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.617+0000 7fcb91b98700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 0x7fcb7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.618+0000 7fcb91b98700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 0x7fcb7006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb880011e0 tx=0x7fcb88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.621+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb8c0c5b00 con 0x7fcb8c13dd00 2023-10-16T19:40:49.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.840+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb8c0c5b00 con 0x7fcb8c13dd00 2023-10-16T19:40:49.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.841+0000 7fcb827fc700 1 -- 172.21.15.29:0/2142599810 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb8c0c5b00 con 0x7fcb8c13dd00 2023-10-16T19:40:49.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 msgr2=0x7fcb7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 0x7fcb7006d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb880011e0 tx=0x7fcb88009040 comp rx=0 tx=0).stop 2023-10-16T19:40:49.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 msgr2=0x7fcb8c13c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:49.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d800 tx=0x7fcb7c00dbc0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 shutdown_connections 2023-10-16T19:40:49.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcb7006af00 0x7fcb7006d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb8c154a50 0x7fcb8c0c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcb8c13d660 0x7fcb8c1eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 --2- 172.21.15.29:0/2142599810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb8c13dd00 0x7fcb8c13c270 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 >> 172.21.15.29:0/2142599810 conn(0x7fcb8c0c7110 msgr2=0x7fcb8c06a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 shutdown_connections 2023-10-16T19:40:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:49.843+0000 7fcb93dfc700 1 -- 172.21.15.29:0/2142599810 wait complete. 2023-10-16T19:40:49.848 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2023-10-16T19:40:49.857 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T19:40:49.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:49.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-16T19:40:49.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:40:49.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:40:49.908 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T19:40:49.931 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-16T19:40:49.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.055+0000 7fd69c6f8700 1 Processor -- start 2023-10-16T19:40:50.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.055+0000 7fd69c6f8700 1 -- start start 2023-10-16T19:40:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69c6f8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6940c3350 0x7fd6941555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69c6f8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 0x7fd69406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69c6f8700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd694155af0 con 0x7fd69414ec50 2023-10-16T19:40:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69c6f8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd694152300 con 0x7fd6940c3350 2023-10-16T19:40:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69c6f8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c2e40 con 0x7fd69406db00 2023-10-16T19:40:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd699c93700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6940c3350 0x7fd6941555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd699c93700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6940c3350 0x7fd6941555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52988/0 (socket says 172.21.15.29:52988) 2023-10-16T19:40:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd699c93700 1 -- 172.21.15.29:0/4156720920 learned_addr learned my addr 172.21.15.29:0/4156720920 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.056+0000 7fd69ac95700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 0x7fd69406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699c93700 1 -- 172.21.15.29:0/4156720920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 msgr2=0x7fd69406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699c93700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 0x7fd69406dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699c93700 1 -- 172.21.15.29:0/4156720920 >> v1:172.21.15.53:6789/0 conn(0x7fd69414ec50 legacy=0x7fd694071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699c93700 1 -- 172.21.15.29:0/4156720920 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69414f030 con 0x7fd6940c3350 2023-10-16T19:40:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd69ac95700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 0x7fd69406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699c93700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6940c3350 0x7fd6941555b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098f0 tx=0x7fd690009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0168b6a2fdef093 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699492700 1 -- 172.21.15.29:0/4156720920 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000b8a0 con 0x7fd6940c3350 2023-10-16T19:40:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699492700 1 -- 172.21.15.29:0/4156720920 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000ba00 con 0x7fd6940c3350 2023-10-16T19:40:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd699492700 1 -- 172.21.15.29:0/4156720920 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000bd90 con 0x7fd6940c3350 2023-10-16T19:40:50.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd69c6f8700 1 -- 172.21.15.29:0/4156720920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6940c3350 msgr2=0x7fd6941555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.057+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6940c3350 0x7fd6941555b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098f0 tx=0x7fd690009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:50.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 -- 172.21.15.29:0/4156720920 shutdown_connections 2023-10-16T19:40:50.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd69406db00 0x7fd69406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/4156720920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6940c3350 0x7fd6941555b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 -- 172.21.15.29:0/4156720920 >> 172.21.15.29:0/4156720920 conn(0x7fd6940c7110 msgr2=0x7fd6940c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 -- 172.21.15.29:0/4156720920 shutdown_connections 2023-10-16T19:40:50.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.058+0000 7fd69c6f8700 1 -- 172.21.15.29:0/4156720920 wait complete. 2023-10-16T19:40:50.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 Processor -- start 2023-10-16T19:40:50.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 -- start start 2023-10-16T19:40:50.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd69406db00 0x7fd6941e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd6940c3350 0x7fd6941e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941e8c30 con 0x7fd69414ec50 2023-10-16T19:40:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940a9b10 con 0x7fd69406db00 2023-10-16T19:40:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.059+0000 7fd69c6f8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940a9550 con 0x7fd6940c3350 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52996/0 (socket says 172.21.15.29:52996) 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 -- 172.21.15.29:0/2103744922 learned_addr learned my addr 172.21.15.29:0/2103744922 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd699c93700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd6940c3350 0x7fd6941e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69a494700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd69406db00 0x7fd6941e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 -- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd6940c3350 msgr2=0x7fd6941e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd6940c3350 0x7fd6941e86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 -- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd69406db00 msgr2=0x7fd6941e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd69406db00 0x7fd6941e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 -- 172.21.15.29:0/2103744922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690009550 con 0x7fd69414ec50 2023-10-16T19:40:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69ac95700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00cd80 tx=0x7fd68c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f480 con 0x7fd69414ec50 2023-10-16T19:40:50.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00f600 con 0x7fd69414ec50 2023-10-16T19:40:50.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940a9830 con 0x7fd69414ec50 2023-10-16T19:40:50.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f9b0 con 0x7fd69414ec50 2023-10-16T19:40:50.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.060+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6941eb630 con 0x7fd69414ec50 2023-10-16T19:40:50.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.061+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6941eb850 con 0x7fd69414ec50 2023-10-16T19:40:50.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.062+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd68c00b040 con 0x7fd69414ec50 2023-10-16T19:40:50.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.062+0000 7fd68affd700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 0x7fd67806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.062+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd68c089fe0 con 0x7fd69414ec50 2023-10-16T19:40:50.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.062+0000 7fd69a494700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 0x7fd67806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.063+0000 7fd69a494700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 0x7fd67806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd684007fd0 tx=0x7fd684009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.067+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd68c054d60 con 0x7fd69414ec50 2023-10-16T19:40:50.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.310+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd69404f400 con 0x7fd69414ec50 2023-10-16T19:40:50.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.311+0000 7fd68affd700 1 -- 172.21.15.29:0/2103744922 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fd68c058380 con 0x7fd69414ec50 2023-10-16T19:40:50.314 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:50.314 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:50.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 msgr2=0x7fd67806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 0x7fd67806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd684007fd0 tx=0x7fd684009040 comp rx=0 tx=0).stop 2023-10-16T19:40:50.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 msgr2=0x7fd6941ebb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00cd80 tx=0x7fd68c00a560 comp rx=0 tx=0).stop 2023-10-16T19:40:50.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 shutdown_connections 2023-10-16T19:40:50.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd67806af00 0x7fd67806d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd69414ec50 0x7fd6941ebb50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd69406db00 0x7fd6941e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 --2- 172.21.15.29:0/2103744922 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd6940c3350 0x7fd6941e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 >> 172.21.15.29:0/2103744922 conn(0x7fd6940c7110 msgr2=0x7fd69414d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 shutdown_connections 2023-10-16T19:40:50.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.313+0000 7fd69c6f8700 1 -- 172.21.15.29:0/2103744922 wait complete. 2023-10-16T19:40:50.318 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:50.328 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.450+0000 7feeecaa6700 1 Processor -- start 2023-10-16T19:40:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.450+0000 7feeecaa6700 1 -- start start 2023-10-16T19:40:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feeecaa6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feee80ac0a0 0x7feee8153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feeecaa6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee8156c60 con 0x7feee806a880 2023-10-16T19:40:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feeecaa6700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80ac500 con 0x7feee814c780 2023-10-16T19:40:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feeecaa6700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee80ac7d0 con 0x7feee80ac0a0 2023-10-16T19:40:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee5d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feee80ac0a0 0x7feee8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee6d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7feee806a880 0x7feee806ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38444/0 (socket says 172.21.15.29:38444) 2023-10-16T19:40:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee6d9d700 1 -- 172.21.15.29:0/436226992 learned_addr learned my addr 172.21.15.29:0/436226992 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee5d9b700 1 -- 172.21.15.29:0/436226992 >> v1:172.21.15.53:6789/0 conn(0x7feee814c780 legacy=0x7feee806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee559a700 1 -- 172.21.15.29:0/436226992 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409613609 0 0) 0x7feee8156c60 con 0x7feee806a880 2023-10-16T19:40:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee5d9b700 1 -- 172.21.15.29:0/436226992 >> v1:172.21.15.29:6789/0 conn(0x7feee806a880 legacy=0x7feee806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.451+0000 7feee5d9b700 1 -- 172.21.15.29:0/436226992 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8155ea0 con 0x7feee80ac0a0 2023-10-16T19:40:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feee5d9b700 1 --2- 172.21.15.29:0/436226992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8153290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feed8009840 tx=0x7feed8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b715f86b2a978e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feee559a700 1 -- 172.21.15.29:0/436226992 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011830 con 0x7feee80ac0a0 2023-10-16T19:40:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feee559a700 1 -- 172.21.15.29:0/436226992 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8011990 con 0x7feee80ac0a0 2023-10-16T19:40:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feee559a700 1 -- 172.21.15.29:0/436226992 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011d20 con 0x7feee80ac0a0 2023-10-16T19:40:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 -- 172.21.15.29:0/436226992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 msgr2=0x7feee8153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 --2- 172.21.15.29:0/436226992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8153290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feed8009840 tx=0x7feed8009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 -- 172.21.15.29:0/436226992 shutdown_connections 2023-10-16T19:40:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 --2- 172.21.15.29:0/436226992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8153290 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 -- 172.21.15.29:0/436226992 >> 172.21.15.29:0/436226992 conn(0x7feee80c66d0 msgr2=0x7feee80c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 -- 172.21.15.29:0/436226992 shutdown_connections 2023-10-16T19:40:50.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.452+0000 7feeecaa6700 1 -- 172.21.15.29:0/436226992 wait complete. 2023-10-16T19:40:50.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 Processor -- start 2023-10-16T19:40:50.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 -- start start 2023-10-16T19:40:50.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feee806a880 0x7feee80c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 0x7feee8070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee814a400 con 0x7feee80ac0a0 2023-10-16T19:40:50.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c2af0 con 0x7feee814c780 2023-10-16T19:40:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feeecaa6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c0080 con 0x7feee806a880 2023-10-16T19:40:50.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feee5d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feee5d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53008/0 (socket says 172.21.15.29:53008) 2023-10-16T19:40:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.454+0000 7feee5d9b700 1 -- 172.21.15.29:0/133795909 learned_addr learned my addr 172.21.15.29:0/133795909 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee6d9d700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 0x7feee8070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 -- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feee806a880 msgr2=0x7feee80c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feee806a880 0x7feee80c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 -- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 msgr2=0x7feee8070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 0x7feee8070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 -- 172.21.15.29:0/133795909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80094a0 con 0x7feee80ac0a0 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee6d9d700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 0x7feee8070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feee5d9b700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feed80090b0 tx=0x7feed8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8004520 con 0x7feee80ac0a0 2023-10-16T19:40:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed801f070 con 0x7feee80ac0a0 2023-10-16T19:40:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80038c0 con 0x7feee80ac0a0 2023-10-16T19:40:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee81e9b60 con 0x7feee80ac0a0 2023-10-16T19:40:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.455+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee81e9e20 con 0x7feee80ac0a0 2023-10-16T19:40:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.456+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee804f400 con 0x7feee80ac0a0 2023-10-16T19:40:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.456+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feed8021030 con 0x7feee80ac0a0 2023-10-16T19:40:50.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.457+0000 7feed6ffd700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 0x7feec806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.457+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feed808ad60 con 0x7feee80ac0a0 2023-10-16T19:40:50.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.457+0000 7feee659c700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 0x7feec806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.458+0000 7feee659c700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 0x7feec806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feedc000f60 tx=0x7feedc007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.462+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feed8055ae0 con 0x7feee80ac0a0 2023-10-16T19:40:50.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.662+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee8066a80 con 0x7feee80ac0a0 2023-10-16T19:40:50.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.664+0000 7feed6ffd700 1 -- 172.21.15.29:0/133795909 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7feed8015090 con 0x7feee80ac0a0 2023-10-16T19:40:50.666 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:50.667 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:50.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 msgr2=0x7feec806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 0x7feec806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feedc000f60 tx=0x7feedc007a60 comp rx=0 tx=0).stop 2023-10-16T19:40:50.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 msgr2=0x7feee8072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feed80090b0 tx=0x7feed8004750 comp rx=0 tx=0).stop 2023-10-16T19:40:50.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 shutdown_connections 2023-10-16T19:40:50.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feec806af00 0x7feec806d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee814c780 0x7feee8070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feee806a880 0x7feee80c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 --2- 172.21.15.29:0/133795909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee80ac0a0 0x7feee8072320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 >> 172.21.15.29:0/133795909 conn(0x7feee80c66d0 msgr2=0x7feee8153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 shutdown_connections 2023-10-16T19:40:50.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.666+0000 7feeecaa6700 1 -- 172.21.15.29:0/133795909 wait complete. 2023-10-16T19:40:50.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:39:50.284613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:39:51.342127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T19:39:55.005615+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T19:40:50.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:40:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.807+0000 7fcc8ab0e700 1 Processor -- start 2023-10-16T19:40:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.807+0000 7fcc8ab0e700 1 -- start start 2023-10-16T19:40:50.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc8ab0e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc8413d660 0x7fcc8406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc8ab0e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8406e780 con 0x7fcc84154a50 2023-10-16T19:40:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc8ab0e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc84154f10 con 0x7fcc8406adc0 2023-10-16T19:40:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc8ab0e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8406d320 con 0x7fcc8413d660 2023-10-16T19:40:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc888aa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc8413d660 0x7fcc8406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc83fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcc84154a50 0x7fcc841583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38462/0 (socket says 172.21.15.29:38462) 2023-10-16T19:40:50.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc83fff700 1 -- 172.21.15.29:0/4196709925 learned_addr learned my addr 172.21.15.29:0/4196709925 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:50.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc888aa700 1 -- 172.21.15.29:0/4196709925 >> v1:172.21.15.53:6789/0 conn(0x7fcc8406adc0 legacy=0x7fcc8415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:50.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc888aa700 1 -- 172.21.15.29:0/4196709925 >> v1:172.21.15.29:6789/0 conn(0x7fcc84154a50 legacy=0x7fcc841583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc888aa700 1 -- 172.21.15.29:0/4196709925 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc841551f0 con 0x7fcc8413d660 2023-10-16T19:40:50.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc837fe700 1 -- 172.21.15.29:0/4196709925 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329332409 0 0) 0x7fcc8406e780 con 0x7fcc84154a50 2023-10-16T19:40:50.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.808+0000 7fcc888aa700 1 --2- 172.21.15.29:0/4196709925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8413d660 0x7fcc8406a880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009840 tx=0x7fcc78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20953f5c4a910950 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc837fe700 1 -- 172.21.15.29:0/4196709925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78004230 con 0x7fcc8413d660 2023-10-16T19:40:50.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc837fe700 1 -- 172.21.15.29:0/4196709925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78004390 con 0x7fcc8413d660 2023-10-16T19:40:50.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc837fe700 1 -- 172.21.15.29:0/4196709925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780036a0 con 0x7fcc8413d660 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4196709925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8413d660 msgr2=0x7fcc8406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4196709925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8413d660 0x7fcc8406a880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009840 tx=0x7fcc78009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4196709925 shutdown_connections 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4196709925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8413d660 0x7fcc8406a880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4196709925 >> 172.21.15.29:0/4196709925 conn(0x7fcc840c7110 msgr2=0x7fcc840c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:50.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4196709925 shutdown_connections 2023-10-16T19:40:50.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.809+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4196709925 wait complete. 2023-10-16T19:40:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.810+0000 7fcc8ab0e700 1 Processor -- start 2023-10-16T19:40:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.810+0000 7fcc8ab0e700 1 -- start start 2023-10-16T19:40:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc8413d660 0x7fcc841ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcc84154a50 0x7fcc841ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c6ac0 con 0x7fcc8406adc0 2023-10-16T19:40:50.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8413bd60 con 0x7fcc8413d660 2023-10-16T19:40:50.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc8ab0e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8413c040 con 0x7fcc84154a50 2023-10-16T19:40:50.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc888aa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc888aa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53020/0 (socket says 172.21.15.29:53020) 2023-10-16T19:40:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.811+0000 7fcc888aa700 1 -- 172.21.15.29:0/4233667092 learned_addr learned my addr 172.21.15.29:0/4233667092 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc83fff700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc8413d660 0x7fcc841ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 -- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcc84154a50 msgr2=0x7fcc841ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcc84154a50 0x7fcc841ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 -- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc8413d660 msgr2=0x7fcc841ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc8413d660 0x7fcc841ed980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 -- 172.21.15.29:0/4233667092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780094a0 con 0x7fcc8406adc0 2023-10-16T19:40:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc888aa700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc780090b0 tx=0x7fcc78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78011830 con 0x7fcc8406adc0 2023-10-16T19:40:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7801e070 con 0x7fcc8406adc0 2023-10-16T19:40:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8413c320 con 0x7fcc8406adc0 2023-10-16T19:40:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78011bb0 con 0x7fcc8406adc0 2023-10-16T19:40:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.812+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc841e9f60 con 0x7fcc8406adc0 2023-10-16T19:40:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.813+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc840c3760 con 0x7fcc8406adc0 2023-10-16T19:40:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.813+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcc78011d10 con 0x7fcc8406adc0 2023-10-16T19:40:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.814+0000 7fcc817fa700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 0x7fcc6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.814+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc7808ad40 con 0x7fcc8406adc0 2023-10-16T19:40:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.814+0000 7fcc83fff700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 0x7fcc6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.815+0000 7fcc83fff700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 0x7fcc6806d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc8413baf0 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:50.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:50.818+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc78055ac0 con 0x7fcc8406adc0 2023-10-16T19:40:51.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.019+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc840c3760 con 0x7fcc8406adc0 2023-10-16T19:40:51.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.020+0000 7fcc817fa700 1 -- 172.21.15.29:0/4233667092 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc78020020 con 0x7fcc8406adc0 2023-10-16T19:40:51.022 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:40:51.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 msgr2=0x7fcc6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 0x7fcc6806d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc8413baf0 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2023-10-16T19:40:51.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 msgr2=0x7fcc8413a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc780090b0 tx=0x7fcc78004750 comp rx=0 tx=0).stop 2023-10-16T19:40:51.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 shutdown_connections 2023-10-16T19:40:51.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcc6806af00 0x7fcc6806d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcc84154a50 0x7fcc841ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc8406adc0 0x7fcc8413a280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 --2- 172.21.15.29:0/4233667092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc8413d660 0x7fcc841ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 >> 172.21.15.29:0/4233667092 conn(0x7fcc840c7110 msgr2=0x7fcc840c1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 shutdown_connections 2023-10-16T19:40:51.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.022+0000 7fcc8ab0e700 1 -- 172.21.15.29:0/4233667092 wait complete. 2023-10-16T19:40:51.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:40:51.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.162+0000 7fbdefb36700 1 Processor -- start 2023-10-16T19:40:51.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.162+0000 7fbdefb36700 1 -- start start 2023-10-16T19:40:51.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdefb36700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 0x7fbde8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdefb36700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde806e780 con 0x7fbde813d660 2023-10-16T19:40:51.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdefb36700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde8154f10 con 0x7fbde8154a50 2023-10-16T19:40:51.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdefb36700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde806d320 con 0x7fbde813dd00 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbded8d2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbde813d660 0x7fbde806a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38472/0 (socket says 172.21.15.29:38472) 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbded8d2700 1 -- 172.21.15.29:0/1380152322 learned_addr learned my addr 172.21.15.29:0/1380152322 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdee0d3700 1 --2- 172.21.15.29:0/1380152322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 0x7fbde8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206516236 0 0) 0x7fbde806e780 con 0x7fbde813d660 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd40035b0 con 0x7fbde813d660 2023-10-16T19:40:51.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396481344 0 0) 0x7fbde8154f10 con 0x7fbde8154a50 2023-10-16T19:40:51.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.163+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde806e780 con 0x7fbde8154a50 2023-10-16T19:40:51.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdee0d3700 1 -- 172.21.15.29:0/1380152322 >> v1:172.21.15.53:6789/0 conn(0x7fbde8154a50 legacy=0x7fbde81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdee0d3700 1 -- 172.21.15.29:0/1380152322 >> v1:172.21.15.29:6789/0 conn(0x7fbde813d660 legacy=0x7fbde806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 926470553 0 0) 0x7fbdd40035b0 con 0x7fbde813d660 2023-10-16T19:40:51.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdee0d3700 1 -- 172.21.15.29:0/1380152322 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde81551f0 con 0x7fbde813dd00 2023-10-16T19:40:51.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdee0d3700 1 --2- 172.21.15.29:0/1380152322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 0x7fbde8158ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009dc0 tx=0x7fbde000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d99da0fa91a8f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000e070 con 0x7fbde813dd00 2023-10-16T19:40:51.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0003a70 con 0x7fbde813dd00 2023-10-16T19:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdec8d0700 1 -- 172.21.15.29:0/1380152322 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4001670 con 0x7fbde813dd00 2023-10-16T19:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdefb36700 1 -- 172.21.15.29:0/1380152322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 msgr2=0x7fbde8158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.164+0000 7fbdefb36700 1 --2- 172.21.15.29:0/1380152322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 0x7fbde8158ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009dc0 tx=0x7fbde000b330 comp rx=0 tx=0).stop 2023-10-16T19:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.165+0000 7fbdefb36700 1 -- 172.21.15.29:0/1380152322 shutdown_connections 2023-10-16T19:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.165+0000 7fbdefb36700 1 --2- 172.21.15.29:0/1380152322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde813dd00 0x7fbde8158ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.165+0000 7fbdefb36700 1 -- 172.21.15.29:0/1380152322 >> 172.21.15.29:0/1380152322 conn(0x7fbde80c7110 msgr2=0x7fbde80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.165+0000 7fbdefb36700 1 -- 172.21.15.29:0/1380152322 shutdown_connections 2023-10-16T19:40:51.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.165+0000 7fbdefb36700 1 -- 172.21.15.29:0/1380152322 wait complete. 2023-10-16T19:40:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.166+0000 7fbdefb36700 1 Processor -- start 2023-10-16T19:40:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.166+0000 7fbdefb36700 1 -- start start 2023-10-16T19:40:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.166+0000 7fbdefb36700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbde813dd00 0x7fbde80c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde8154a50 0x7fbde8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80a8fa0 con 0x7fbde813d660 2023-10-16T19:40:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81eab70 con 0x7fbde813dd00 2023-10-16T19:40:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80abd40 con 0x7fbde8154a50 2023-10-16T19:40:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53034/0 (socket says 172.21.15.29:53034) 2023-10-16T19:40:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 -- 172.21.15.29:0/927331984 learned_addr learned my addr 172.21.15.29:0/927331984 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdee0d3700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde8154a50 0x7fbde8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded0d1700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbde813dd00 0x7fbde80c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 -- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde8154a50 msgr2=0x7fbde8156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde8154a50 0x7fbde8156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 -- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbde813dd00 msgr2=0x7fbde80c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbde813dd00 0x7fbde80c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 -- 172.21.15.29:0/927331984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009a70 con 0x7fbde813d660 2023-10-16T19:40:51.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbded8d2700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c750 tx=0x7fbde400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004d40 con 0x7fbde813d660 2023-10-16T19:40:51.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde40070d0 con 0x7fbde813d660 2023-10-16T19:40:51.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004ea0 con 0x7fbde813d660 2023-10-16T19:40:51.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8157c40 con 0x7fbde813d660 2023-10-16T19:40:51.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.167+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8155a90 con 0x7fbde813d660 2023-10-16T19:40:51.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.168+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde80c3760 con 0x7fbde813d660 2023-10-16T19:40:51.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.169+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbde4007460 con 0x7fbde813d660 2023-10-16T19:40:51.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.169+0000 7fbdde7fc700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 0x7fbdcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.169+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbde40896e0 con 0x7fbde813d660 2023-10-16T19:40:51.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.170+0000 7fbded0d1700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 0x7fbdcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.170+0000 7fbded0d1700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 0x7fbdcc06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbde80c6580 tx=0x7fbdd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.174+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbde4054460 con 0x7fbde813d660 2023-10-16T19:40:51.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.373+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbde804f400 con 0x7fbde813d660 2023-10-16T19:40:51.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.373+0000 7fbdde7fc700 1 -- 172.21.15.29:0/927331984 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbde4057a80 con 0x7fbde813d660 2023-10-16T19:40:51.376 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:51.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 msgr2=0x7fbdcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 0x7fbdcc06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbde80c6580 tx=0x7fbdd8009040 comp rx=0 tx=0).stop 2023-10-16T19:40:51.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 msgr2=0x7fbde81ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c750 tx=0x7fbde400ca60 comp rx=0 tx=0).stop 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 shutdown_connections 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbdcc06af00 0x7fbdcc06d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbde8154a50 0x7fbde8156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbde813d660 0x7fbde81ea630 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 --2- 172.21.15.29:0/927331984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbde813dd00 0x7fbde80c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 >> 172.21.15.29:0/927331984 conn(0x7fbde80c7110 msgr2=0x7fbde8135a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 shutdown_connections 2023-10-16T19:40:51.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.375+0000 7fbdefb36700 1 -- 172.21.15.29:0/927331984 wait complete. 2023-10-16T19:40:51.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:40:51.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.515+0000 7fa9d1c8d700 1 Processor -- start 2023-10-16T19:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.515+0000 7fa9d1c8d700 1 -- start start 2023-10-16T19:40:51.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9d1c8d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9cc150100 0x7fa9cc156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9d1c8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9d1c8d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc0724a0 con 0x7fa9cc06f6e0 2023-10-16T19:40:51.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9d1c8d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc152780 con 0x7fa9cc150100 2023-10-16T19:40:51.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9d1c8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0c2660 con 0x7fa9cc0c18b0 2023-10-16T19:40:51.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9caffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9cc150100 0x7fa9cc156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9caffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9cc150100 0x7fa9cc156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53044/0 (socket says 172.21.15.29:53044) 2023-10-16T19:40:51.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.516+0000 7fa9caffd700 1 -- 172.21.15.29:0/262618853 learned_addr learned my addr 172.21.15.29:0/262618853 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:51.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9cbfff700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9caffd700 1 -- 172.21.15.29:0/262618853 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 msgr2=0x7fa9cc152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:51.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9caffd700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9caffd700 1 -- 172.21.15.29:0/262618853 >> v1:172.21.15.53:6789/0 conn(0x7fa9cc06f6e0 legacy=0x7fa9cc14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9caffd700 1 -- 172.21.15.29:0/262618853 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0a8490 con 0x7fa9cc150100 2023-10-16T19:40:51.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9ca7fc700 1 -- 172.21.15.29:0/262618853 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692331787 0 0) 0x7fa9cc0724a0 con 0x7fa9cc06f6e0 2023-10-16T19:40:51.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9cbfff700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:51.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9caffd700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc156670 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40098f0 tx=0x7fa9b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e240d4949392660 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9ca7fc700 1 -- 172.21.15.29:0/262618853 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400b8a0 con 0x7fa9cc150100 2023-10-16T19:40:51.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9ca7fc700 1 -- 172.21.15.29:0/262618853 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b400ba00 con 0x7fa9cc150100 2023-10-16T19:40:51.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.517+0000 7fa9ca7fc700 1 -- 172.21.15.29:0/262618853 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400bd90 con 0x7fa9cc150100 2023-10-16T19:40:51.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/262618853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 msgr2=0x7fa9cc156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc156670 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40098f0 tx=0x7fa9b4009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:51.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/262618853 shutdown_connections 2023-10-16T19:40:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/262618853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc156670 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/262618853 >> 172.21.15.29:0/262618853 conn(0x7fa9cc0c7110 msgr2=0x7fa9cc0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/262618853 shutdown_connections 2023-10-16T19:40:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.518+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/262618853 wait complete. 2023-10-16T19:40:51.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.519+0000 7fa9d1c8d700 1 Processor -- start 2023-10-16T19:40:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.519+0000 7fa9d1c8d700 1 -- start start 2023-10-16T19:40:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9cc06f6e0 0x7fa9cc153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc155460 con 0x7fa9cc150100 2023-10-16T19:40:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc154070 con 0x7fa9cc06f6e0 2023-10-16T19:40:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9d1c8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc154350 con 0x7fa9cc0c18b0 2023-10-16T19:40:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53052/0 (socket says 172.21.15.29:53052) 2023-10-16T19:40:51.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 -- 172.21.15.29:0/1588339248 learned_addr learned my addr 172.21.15.29:0/1588339248 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:51.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cb7fe700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9cc06f6e0 0x7fa9cc153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9caffd700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 -- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 msgr2=0x7fa9cc156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 -- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9cc06f6e0 msgr2=0x7fa9cc153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9cc06f6e0 0x7fa9cc153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9cbfff700 1 -- 172.21.15.29:0/1588339248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b4009550 con 0x7fa9cc150100 2023-10-16T19:40:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.520+0000 7fa9caffd700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9cbfff700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4007ef0 tx=0x7fa9c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400de30 con 0x7fa9cc150100 2023-10-16T19:40:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400f040 con 0x7fa9cc150100 2023-10-16T19:40:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc154630 con 0x7fa9cc150100 2023-10-16T19:40:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4003cb0 con 0x7fa9cc150100 2023-10-16T19:40:51.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.521+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc1549c0 con 0x7fa9cc150100 2023-10-16T19:40:51.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.522+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc156890 con 0x7fa9cc150100 2023-10-16T19:40:51.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.522+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa9c4004030 con 0x7fa9cc150100 2023-10-16T19:40:51.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.523+0000 7fa9c3fff700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 0x7fa9ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.523+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa9c4089a50 con 0x7fa9cc150100 2023-10-16T19:40:51.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.523+0000 7fa9cb7fe700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 0x7fa9ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.523+0000 7fa9cb7fe700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 0x7fa9ac06d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc007fd0 tx=0x7fa9bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.527+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9cc156890 con 0x7fa9cc150100 2023-10-16T19:40:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.728+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9cc156890 con 0x7fa9cc150100 2023-10-16T19:40:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.728+0000 7fa9c3fff700 1 -- 172.21.15.29:0/1588339248 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9cc156890 con 0x7fa9cc150100 2023-10-16T19:40:51.730 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-16T19:40:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 msgr2=0x7fa9ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 0x7fa9ac06d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc007fd0 tx=0x7fa9bc009040 comp rx=0 tx=0).stop 2023-10-16T19:40:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 msgr2=0x7fa9cc1446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4007ef0 tx=0x7fa9c400d3b0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 shutdown_connections 2023-10-16T19:40:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa9ac06af00 0x7fa9ac06d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9cc150100 0x7fa9cc1446a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9cc06f6e0 0x7fa9cc153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 --2- 172.21.15.29:0/1588339248 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa9cc0c18b0 0x7fa9cc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 >> 172.21.15.29:0/1588339248 conn(0x7fa9cc0c7110 msgr2=0x7fa9cc150510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.730+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 shutdown_connections 2023-10-16T19:40:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.731+0000 7fa9d1c8d700 1 -- 172.21.15.29:0/1588339248 wait complete. 2023-10-16T19:40:51.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T19:40:51.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.871+0000 7f529c013700 1 Processor -- start 2023-10-16T19:40:51.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f529c013700 1 -- start start 2023-10-16T19:40:51.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f529c013700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f529406e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f529c013700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5294152300 con 0x7f529414ec50 2023-10-16T19:40:51.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f529c013700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940c2e40 con 0x7f52940c3350 2023-10-16T19:40:51.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f529c013700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529414f030 con 0x7f52941555b0 2023-10-16T19:40:51.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.872+0000 7f5299daf700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f529414ec50 0x7f5294071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38500/0 (socket says 172.21.15.29:38500) 2023-10-16T19:40:51.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5299daf700 1 -- 172.21.15.29:0/1851519409 learned_addr learned my addr 172.21.15.29:0/1851519409 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:51.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939925971 0 0) 0x7f5294152300 con 0x7f529414ec50 2023-10-16T19:40:51.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52800035b0 con 0x7f529414ec50 2023-10-16T19:40:51.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f529a5b0700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f529406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078702654 0 0) 0x7f52800035b0 con 0x7f529414ec50 2023-10-16T19:40:51.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 msgr2=0x7f529406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:51.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f529406e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 >> v1:172.21.15.53:6789/0 conn(0x7f52940c3350 legacy=0x7f529406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294155a60 con 0x7f529414ec50 2023-10-16T19:40:51.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f5284001670 con 0x7f529414ec50 2023-10-16T19:40:51.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 >> v1:172.21.15.29:6789/0 conn(0x7f529414ec50 legacy=0x7f5294071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5280003a30 0x7f5280003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f5280004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5280004d90 0x7f5280005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529414f030 con 0x7f5280004d90 2023-10-16T19:40:51.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528000bac0 con 0x7f5280003a30 2023-10-16T19:40:51.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528000bc80 con 0x7f52941555b0 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f529a5b0700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5280004d90 0x7f5280005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f5299daf700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5280003a30 0x7f5280003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.873+0000 7f52995ae700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f5280004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 -- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 msgr2=0x7f5280004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f5280004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 -- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5280003a30 msgr2=0x7f5280003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5280003a30 0x7f5280003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 -- 172.21.15.29:0/1851519409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800035b0 con 0x7f5280004d90 2023-10-16T19:40:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f52995ae700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f52941555b0 0x7f5280004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5280004d90 0x7f5280005210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f528c009fc0 tx=0x7f5280005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfeb2622ce9bf68 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00ec30 con 0x7f5280004d90 2023-10-16T19:40:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00f040 con 0x7f5280004d90 2023-10-16T19:40:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f5298dad700 1 -- 172.21.15.29:0/1851519409 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c014480 con 0x7f5280004d90 2023-10-16T19:40:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529c013700 1 -- 172.21.15.29:0/1851519409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5280004d90 msgr2=0x7f5280005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529c013700 1 --2- 172.21.15.29:0/1851519409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5280004d90 0x7f5280005210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f528c009fc0 tx=0x7f5280005880 comp rx=0 tx=0).stop 2023-10-16T19:40:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529a5b0700 1 -- 172.21.15.29:0/1851519409 reap_dead start 2023-10-16T19:40:51.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529c013700 1 -- 172.21.15.29:0/1851519409 shutdown_connections 2023-10-16T19:40:51.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.874+0000 7f529c013700 1 -- 172.21.15.29:0/1851519409 >> 172.21.15.29:0/1851519409 conn(0x7f52940c7110 msgr2=0x7f52940c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:51.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.875+0000 7f529c013700 1 -- 172.21.15.29:0/1851519409 shutdown_connections 2023-10-16T19:40:51.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.875+0000 7f529c013700 1 -- 172.21.15.29:0/1851519409 wait complete. 2023-10-16T19:40:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 Processor -- start 2023-10-16T19:40:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 -- start start 2023-10-16T19:40:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940abda0 0x7f52940c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5294150e20 0x7f529414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940ab4c0 con 0x7f52940a97e0 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5294143700 con 0x7f52940abda0 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.876+0000 7f529c013700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940c5550 con 0x7f5294150e20 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53070/0 (socket says 172.21.15.29:53070) 2023-10-16T19:40:51.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 -- 172.21.15.29:0/4186821173 learned_addr learned my addr 172.21.15.29:0/4186821173 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:51.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f5299daf700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940abda0 0x7f52940c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f529a5b0700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5294150e20 0x7f529414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 -- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5294150e20 msgr2=0x7f529414f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5294150e20 0x7f529414f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 -- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940abda0 msgr2=0x7f52940c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940abda0 0x7f52940c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 -- 172.21.15.29:0/4186821173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940c57f0 con 0x7f52940a97e0 2023-10-16T19:40:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f52995ae700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f529000e7d0 tx=0x7f529000eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900052e0 con 0x7f52940a97e0 2023-10-16T19:40:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290005440 con 0x7f52940a97e0 2023-10-16T19:40:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940c5ad0 con 0x7f52940a97e0 2023-10-16T19:40:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900038c0 con 0x7f52940a97e0 2023-10-16T19:40:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.877+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940c6090 con 0x7f52940a97e0 2023-10-16T19:40:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.878+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52940ab190 con 0x7f52940a97e0 2023-10-16T19:40:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.879+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5290003a20 con 0x7f52940a97e0 2023-10-16T19:40:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.879+0000 7f528a7fc700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 0x7f527806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.879+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5290088f80 con 0x7f52940a97e0 2023-10-16T19:40:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.879+0000 7f5299daf700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 0x7f527806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.880+0000 7f5299daf700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 0x7f527806d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f52840010e0 tx=0x7f5284000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:51.883+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52900bbca0 con 0x7f52940a97e0 2023-10-16T19:40:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.085+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5294151200 con 0x7f52940a97e0 2023-10-16T19:40:52.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.085+0000 7f528a7fc700 1 -- 172.21.15.29:0/4186821173 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5290019020 con 0x7f52940a97e0 2023-10-16T19:40:52.088 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-16T19:40:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 msgr2=0x7f527806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 0x7f527806d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f52840010e0 tx=0x7f5284000ed0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 msgr2=0x7f52941508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f529000e7d0 tx=0x7f529000eae0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 shutdown_connections 2023-10-16T19:40:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f527806af30 0x7f527806d3f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5294150e20 0x7f529414f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940abda0 0x7f52940c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 --2- 172.21.15.29:0/4186821173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52940a97e0 0x7f52941508e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 >> 172.21.15.29:0/4186821173 conn(0x7f52940c7110 msgr2=0x7f52940c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 shutdown_connections 2023-10-16T19:40:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.087+0000 7f529c013700 1 -- 172.21.15.29:0/4186821173 wait complete. 2023-10-16T19:40:52.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.224+0000 7f132073d700 1 Processor -- start 2023-10-16T19:40:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.224+0000 7f132073d700 1 -- start start 2023-10-16T19:40:52.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f132073d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13180ac0a0 0x7f1318153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f132073d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131806a880 0x7f131806ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f132073d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1318156c60 con 0x7f131814c780 2023-10-16T19:40:52.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f132073d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180ac7d0 con 0x7f13180ac0a0 2023-10-16T19:40:52.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f132073d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13181537d0 con 0x7f131806a880 2023-10-16T19:40:52.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f131dcd8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13180ac0a0 0x7f1318153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f131dcd8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13180ac0a0 0x7f1318153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53078/0 (socket says 172.21.15.29:53078) 2023-10-16T19:40:52.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.225+0000 7f131dcd8700 1 -- 172.21.15.29:0/2115908879 learned_addr learned my addr 172.21.15.29:0/2115908879 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131ecda700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131806a880 0x7f131806ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131dcd8700 1 -- 172.21.15.29:0/2115908879 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131806a880 msgr2=0x7f131806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131dcd8700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131806a880 0x7f131806ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131dcd8700 1 -- 172.21.15.29:0/2115908879 >> v1:172.21.15.53:6789/0 conn(0x7f131814c780 legacy=0x7f131806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131dcd8700 1 -- 172.21.15.29:0/2115908879 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180ac500 con 0x7f13180ac0a0 2023-10-16T19:40:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131dcd8700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f130c009920 tx=0x7f130c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3356d6f84ae184 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131d4d7700 1 -- 172.21.15.29:0/2115908879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00ba20 con 0x7f13180ac0a0 2023-10-16T19:40:52.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131d4d7700 1 -- 172.21.15.29:0/2115908879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00bb80 con 0x7f13180ac0a0 2023-10-16T19:40:52.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.226+0000 7f131d4d7700 1 -- 172.21.15.29:0/2115908879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c009e70 con 0x7f13180ac0a0 2023-10-16T19:40:52.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 -- 172.21.15.29:0/2115908879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 msgr2=0x7f1318153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f130c009920 tx=0x7f130c009c30 comp rx=0 tx=0).stop 2023-10-16T19:40:52.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 -- 172.21.15.29:0/2115908879 shutdown_connections 2023-10-16T19:40:52.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131806a880 0x7f131806ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 --2- 172.21.15.29:0/2115908879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 -- 172.21.15.29:0/2115908879 >> 172.21.15.29:0/2115908879 conn(0x7f13180c66d0 msgr2=0x7f13180c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 -- 172.21.15.29:0/2115908879 shutdown_connections 2023-10-16T19:40:52.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.227+0000 7f132073d700 1 -- 172.21.15.29:0/2115908879 wait complete. 2023-10-16T19:40:52.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 Processor -- start 2023-10-16T19:40:52.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 -- start start 2023-10-16T19:40:52.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131806a880 0x7f1318154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131814c780 0x7f13180aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.228+0000 7f132073d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318155160 con 0x7f13180ac0a0 2023-10-16T19:40:52.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f132073d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318155b30 con 0x7f131806a880 2023-10-16T19:40:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f132073d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13181558c0 con 0x7f131814c780 2023-10-16T19:40:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53084/0 (socket says 172.21.15.29:53084) 2023-10-16T19:40:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 -- 172.21.15.29:0/2019639732 learned_addr learned my addr 172.21.15.29:0/2019639732 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131e4d9700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131806a880 0x7f1318154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131ecda700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131814c780 0x7f13180aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 -- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131814c780 msgr2=0x7f13180aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131814c780 0x7f13180aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 -- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131806a880 msgr2=0x7f1318154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131806a880 0x7f1318154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 -- 172.21.15.29:0/2019639732 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009550 con 0x7f13180ac0a0 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f131dcd8700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c004300 con 0x7f13180ac0a0 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c01f070 con 0x7f13180ac0a0 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318142100 con 0x7f13180ac0a0 2023-10-16T19:40:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0036a0 con 0x7f13180ac0a0 2023-10-16T19:40:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.229+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181e7d00 con 0x7f13180ac0a0 2023-10-16T19:40:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.230+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131804f400 con 0x7f13180ac0a0 2023-10-16T19:40:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.231+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f130c021030 con 0x7f13180ac0a0 2023-10-16T19:40:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.231+0000 7f130affd700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 0x7f12fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.231+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f130c08b000 con 0x7f13180ac0a0 2023-10-16T19:40:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.231+0000 7f131e4d9700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 0x7f12fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.232+0000 7f131e4d9700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 0x7f12fc06d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1314007fd0 tx=0x7f1314009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.235+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f130c055ea0 con 0x7f13180ac0a0 2023-10-16T19:40:52.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.481+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1318066a80 con 0x7f13180ac0a0 2023-10-16T19:40:52.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.482+0000 7f130affd700 1 -- 172.21.15.29:0/2019639732 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7f130c0594c0 con 0x7f13180ac0a0 2023-10-16T19:40:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:52.485 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:52.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 msgr2=0x7f12fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 0x7f12fc06d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1314007fd0 tx=0x7f1314009040 comp rx=0 tx=0).stop 2023-10-16T19:40:52.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 msgr2=0x7f1318153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c004750 comp rx=0 tx=0).stop 2023-10-16T19:40:52.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 shutdown_connections 2023-10-16T19:40:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f12fc06af00 0x7f12fc06d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f131814c780 0x7f13180aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131806a880 0x7f1318154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 --2- 172.21.15.29:0/2019639732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13180ac0a0 0x7f1318153ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 >> 172.21.15.29:0/2019639732 conn(0x7f13180c66d0 msgr2=0x7f1318151370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 shutdown_connections 2023-10-16T19:40:52.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.484+0000 7f132073d700 1 -- 172.21.15.29:0/2019639732 wait complete. 2023-10-16T19:40:52.489 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:52.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:52.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.621+0000 7fc172417700 1 Processor -- start 2023-10-16T19:40:52.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.621+0000 7fc172417700 1 -- start start 2023-10-16T19:40:52.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc16c0c4f50 0x7fc16c153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c0c7bb0 0x7fc16c070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc16c070ac0 0x7fc16c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c0c3000 con 0x7fc16c070ac0 2023-10-16T19:40:52.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c0bd0e0 con 0x7fc16c0c4f50 2023-10-16T19:40:52.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc172417700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0c5330 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc16c070ac0 0x7fc16c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc16c070ac0 0x7fc16c155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53094/0 (socket says 172.21.15.29:53094) 2023-10-16T19:40:52.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 -- 172.21.15.29:0/632423886 learned_addr learned my addr 172.21.15.29:0/632423886 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc16b7fe700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c0c7bb0 0x7fc16c070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc16bfff700 1 --2- 172.21.15.29:0/632423886 >> v2:172.21.15.53:3300/0 conn(0x7fc16c0c4f50 0x7fc16c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 -- 172.21.15.29:0/632423886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c0c7bb0 msgr2=0x7fc16c070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:52.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c0c7bb0 0x7fc16c070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 -- 172.21.15.29:0/632423886 >> v2:172.21.15.53:3300/0 conn(0x7fc16c0c4f50 msgr2=0x7fc16c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:52.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 --2- 172.21.15.29:0/632423886 >> v2:172.21.15.53:3300/0 conn(0x7fc16c0c4f50 0x7fc16c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.622+0000 7fc1709b4700 1 -- 172.21.15.29:0/632423886 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0c2a40 con 0x7fc16c070ac0 2023-10-16T19:40:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc1709b4700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c070ac0 0x7fc16c155e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0c7960 tx=0x7fc16400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb0c95b56277bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc16affd700 1 -- 172.21.15.29:0/632423886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400e070 con 0x7fc16c070ac0 2023-10-16T19:40:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc16affd700 1 -- 172.21.15.29:0/632423886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400b9c0 con 0x7fc16c070ac0 2023-10-16T19:40:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc16affd700 1 -- 172.21.15.29:0/632423886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400bd70 con 0x7fc16c070ac0 2023-10-16T19:40:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 -- 172.21.15.29:0/632423886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c070ac0 msgr2=0x7fc16c155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c070ac0 0x7fc16c155e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0c7960 tx=0x7fc16400b330 comp rx=0 tx=0).stop 2023-10-16T19:40:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 -- 172.21.15.29:0/632423886 shutdown_connections 2023-10-16T19:40:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c070ac0 0x7fc16c155e00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 --2- 172.21.15.29:0/632423886 >> v2:172.21.15.53:3300/0 conn(0x7fc16c0c4f50 0x7fc16c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 --2- 172.21.15.29:0/632423886 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c0c7bb0 0x7fc16c070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 -- 172.21.15.29:0/632423886 >> 172.21.15.29:0/632423886 conn(0x7fc16c0a9cd0 msgr2=0x7fc16c0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 -- 172.21.15.29:0/632423886 shutdown_connections 2023-10-16T19:40:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.623+0000 7fc172417700 1 -- 172.21.15.29:0/632423886 wait complete. 2023-10-16T19:40:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.624+0000 7fc172417700 1 Processor -- start 2023-10-16T19:40:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 -- start start 2023-10-16T19:40:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c070ac0 0x7fc16c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 0x7fc16c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0aca00 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0ad840 con 0x7fc16c0c4f50 2023-10-16T19:40:52.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.625+0000 7fc172417700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0a8230 con 0x7fc16c070ac0 2023-10-16T19:40:52.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53100/0 (socket says 172.21.15.29:53100) 2023-10-16T19:40:52.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 -- 172.21.15.29:0/1789297175 learned_addr learned my addr 172.21.15.29:0/1789297175 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc16bfff700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c070ac0 0x7fc16c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc16b7fe700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 0x7fc16c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 -- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c070ac0 msgr2=0x7fc16c154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c070ac0 0x7fc16c154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 -- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 msgr2=0x7fc16c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 0x7fc16c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 -- 172.21.15.29:0/1789297175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009b30 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc16b7fe700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 0x7fc16c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc1709b4700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc16400b370 tx=0x7fc164004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164004310 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164004470 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c154680 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164004820 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.626+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c1e8370 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.627+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c04f400 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.628+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc16401c440 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.628+0000 7fc168ff9700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 0x7fc15806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.628+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc16408af80 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.629+0000 7fc16bfff700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 0x7fc15806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.629+0000 7fc16bfff700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 0x7fc15806d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc16000aa30 tx=0x7fc160008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.633+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1640bdca0 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.835+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc16c0c7990 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.836+0000 7fc168ff9700 1 -- 172.21.15.29:0/1789297175 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7fc16402a090 con 0x7fc16c0c7bb0 2023-10-16T19:40:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:52.839 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 msgr2=0x7fc15806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 0x7fc15806d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc16000aa30 tx=0x7fc160008040 comp rx=0 tx=0).stop 2023-10-16T19:40:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 msgr2=0x7fc16c154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc16400b370 tx=0x7fc164004ad0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 shutdown_connections 2023-10-16T19:40:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc15806af00 0x7fc15806d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0c7bb0 0x7fc16c154140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc16c070ac0 0x7fc16c154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 --2- 172.21.15.29:0/1789297175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16c0c4f50 0x7fc16c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 >> 172.21.15.29:0/1789297175 conn(0x7fc16c0a9cd0 msgr2=0x7fc16c0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 shutdown_connections 2023-10-16T19:40:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.838+0000 7fc172417700 1 -- 172.21.15.29:0/1789297175 wait complete. 2023-10-16T19:40:52.853 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T19:40:52.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:52.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.976+0000 7fb437c19700 1 Processor -- start 2023-10-16T19:40:52.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.976+0000 7fb437c19700 1 -- start start 2023-10-16T19:40:52.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.976+0000 7fb437c19700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4300c3350 0x7fb4301555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb437c19700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb437c19700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb430155af0 con 0x7fb43014ec50 2023-10-16T19:40:52.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb437c19700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb430152300 con 0x7fb4300c3350 2023-10-16T19:40:52.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb437c19700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300c2e40 con 0x7fb43006db00 2023-10-16T19:40:52.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:45562/0 (socket says 172.21.15.29:45562) 2023-10-16T19:40:52.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 -- 172.21.15.29:0/642953764 learned_addr learned my addr 172.21.15.29:0/642953764 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4351b4700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4300c3350 0x7fb4301555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 -- 172.21.15.29:0/642953764 >> v2:172.21.15.53:3300/0 conn(0x7fb4300c3350 msgr2=0x7fb4301555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:52.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 --2- 172.21.15.29:0/642953764 >> v2:172.21.15.53:3300/0 conn(0x7fb4300c3350 0x7fb4301555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 -- 172.21.15.29:0/642953764 >> v1:172.21.15.53:6789/0 conn(0x7fb43014ec50 legacy=0x7fb430071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 -- 172.21.15.29:0/642953764 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43014f030 con 0x7fb43006db00 2023-10-16T19:40:52.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.977+0000 7fb4361b6700 1 --2- 172.21.15.29:0/642953764 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb42800d150 tx=0x7fb42800d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9314ac0118009db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb4349b3700 1 -- 172.21.15.29:0/642953764 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428010070 con 0x7fb43006db00 2023-10-16T19:40:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb4349b3700 1 -- 172.21.15.29:0/642953764 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800dd10 con 0x7fb43006db00 2023-10-16T19:40:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb4349b3700 1 -- 172.21.15.29:0/642953764 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800b310 con 0x7fb43006db00 2023-10-16T19:40:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 -- 172.21.15.29:0/642953764 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 msgr2=0x7fb43006dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 --2- 172.21.15.29:0/642953764 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb42800d150 tx=0x7fb42800d460 comp rx=0 tx=0).stop 2023-10-16T19:40:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 -- 172.21.15.29:0/642953764 shutdown_connections 2023-10-16T19:40:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 --2- 172.21.15.29:0/642953764 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006dfb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 --2- 172.21.15.29:0/642953764 >> v2:172.21.15.53:3300/0 conn(0x7fb4300c3350 0x7fb4301555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 -- 172.21.15.29:0/642953764 >> 172.21.15.29:0/642953764 conn(0x7fb4300c7110 msgr2=0x7fb4300c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 -- 172.21.15.29:0/642953764 shutdown_connections 2023-10-16T19:40:52.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.978+0000 7fb437c19700 1 -- 172.21.15.29:0/642953764 wait complete. 2023-10-16T19:40:52.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.979+0000 7fb437c19700 1 Processor -- start 2023-10-16T19:40:52.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.979+0000 7fb437c19700 1 -- start start 2023-10-16T19:40:52.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 0x7fb4301541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300a9fc0 con 0x7fb43014ec50 2023-10-16T19:40:52.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301e6180 con 0x7fb4300c3350 2023-10-16T19:40:52.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb437c19700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301e5890 con 0x7fb43006db00 2023-10-16T19:40:52.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53114/0 (socket says 172.21.15.29:53114) 2023-10-16T19:40:52.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 -- 172.21.15.29:0/2535877908 learned_addr learned my addr 172.21.15.29:0/2535877908 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:52.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4359b5700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4351b4700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 0x7fb4301541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 -- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 msgr2=0x7fb43006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 -- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 msgr2=0x7fb4301541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:52.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.980+0000 7fb4361b6700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 0x7fb4301541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:52.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4361b6700 1 -- 172.21.15.29:0/2535877908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42800bd40 con 0x7fb43014ec50 2023-10-16T19:40:52.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4359b5700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:52.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4351b4700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 0x7fb4301541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:52.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4361b6700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb42800d4a0 tx=0x7fb428004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:52.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800bbc0 con 0x7fb43014ec50 2023-10-16T19:40:52.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800b4c0 con 0x7fb43014ec50 2023-10-16T19:40:52.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4301e5b30 con 0x7fb43014ec50 2023-10-16T19:40:52.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428004040 con 0x7fb43014ec50 2023-10-16T19:40:52.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.981+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb430154b90 con 0x7fb43014ec50 2023-10-16T19:40:52.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.982+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43004f400 con 0x7fb43014ec50 2023-10-16T19:40:52.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.982+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb4280041a0 con 0x7fb43014ec50 2023-10-16T19:40:52.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.983+0000 7fb4267fc700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 0x7fb41406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:52.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.983+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb42808cff0 con 0x7fb43014ec50 2023-10-16T19:40:52.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.983+0000 7fb4359b5700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 0x7fb41406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:52.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.983+0000 7fb4359b5700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 0x7fb41406d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4301e35c0 tx=0x7fb42c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:52.987+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb428057c50 con 0x7fb43014ec50 2023-10-16T19:40:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.236+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4301e62c0 con 0x7fb43014ec50 2023-10-16T19:40:53.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.237+0000 7fb4267fc700 1 -- 172.21.15.29:0/2535877908 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7fb42805b270 con 0x7fb43014ec50 2023-10-16T19:40:53.239 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:53.239 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 msgr2=0x7fb41406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 0x7fb41406d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4301e35c0 tx=0x7fb42c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 msgr2=0x7fb4301448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb42800d4a0 tx=0x7fb428004b20 comp rx=0 tx=0).stop 2023-10-16T19:40:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 shutdown_connections 2023-10-16T19:40:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb41406aed0 0x7fb41406d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb43014ec50 0x7fb4301448d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb43006db00 0x7fb43006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 --2- 172.21.15.29:0/2535877908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4300c3350 0x7fb4301541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 >> 172.21.15.29:0/2535877908 conn(0x7fb4300c7110 msgr2=0x7fb4300c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 shutdown_connections 2023-10-16T19:40:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.239+0000 7fb437c19700 1 -- 172.21.15.29:0/2535877908 wait complete. 2023-10-16T19:40:53.244 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:53.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:40:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.376+0000 7efdbf253700 1 Processor -- start 2023-10-16T19:40:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.376+0000 7efdbf253700 1 -- start start 2023-10-16T19:40:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbf253700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdb80bed80 0x7efdb806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbf253700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbf253700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb80c2a40 con 0x7efdb8152190 2023-10-16T19:40:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbf253700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8152570 con 0x7efdb80bed80 2023-10-16T19:40:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbf253700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80be9f0 con 0x7efdb8155710 2023-10-16T19:40:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdb80bed80 0x7efdb806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdb80bed80 0x7efdb806b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53120/0 (socket says 172.21.15.29:53120) 2023-10-16T19:40:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 -- 172.21.15.29:0/3417712187 learned_addr learned my addr 172.21.15.29:0/3417712187 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdbd7f0700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 -- 172.21.15.29:0/3417712187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 msgr2=0x7efdb815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 -- 172.21.15.29:0/3417712187 >> v1:172.21.15.53:6789/0 conn(0x7efdb8152190 legacy=0x7efdb80c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 -- 172.21.15.29:0/3417712187 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80a7710 con 0x7efdb80bed80 2023-10-16T19:40:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb7fff700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb80bed80 0x7efdb806b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efda4009920 tx=0x7efda4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebf578acd1cd6f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb77fe700 1 -- 172.21.15.29:0/3417712187 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400ba20 con 0x7efdb80bed80 2023-10-16T19:40:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.377+0000 7efdb77fe700 1 -- 172.21.15.29:0/3417712187 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400bb80 con 0x7efdb80bed80 2023-10-16T19:40:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdb77fe700 1 -- 172.21.15.29:0/3417712187 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4009e70 con 0x7efdb80bed80 2023-10-16T19:40:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 -- 172.21.15.29:0/3417712187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb80bed80 msgr2=0x7efdb806b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb80bed80 0x7efdb806b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efda4009920 tx=0x7efda4009c30 comp rx=0 tx=0).stop 2023-10-16T19:40:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 -- 172.21.15.29:0/3417712187 shutdown_connections 2023-10-16T19:40:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb815f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 --2- 172.21.15.29:0/3417712187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb80bed80 0x7efdb806b990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 -- 172.21.15.29:0/3417712187 >> 172.21.15.29:0/3417712187 conn(0x7efdb80a9cd0 msgr2=0x7efdb80aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 -- 172.21.15.29:0/3417712187 shutdown_connections 2023-10-16T19:40:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.378+0000 7efdbf253700 1 -- 172.21.15.29:0/3417712187 wait complete. 2023-10-16T19:40:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.379+0000 7efdbf253700 1 Processor -- start 2023-10-16T19:40:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.379+0000 7efdbf253700 1 -- start start 2023-10-16T19:40:53.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 0x7efdb81ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb81ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80ab460 con 0x7efdb814eb30 2023-10-16T19:40:53.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80aaec0 con 0x7efdb8152190 2023-10-16T19:40:53.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbf253700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81edb70 con 0x7efdb8155710 2023-10-16T19:40:53.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbd7f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbd7f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53128/0 (socket says 172.21.15.29:53128) 2023-10-16T19:40:53.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbd7f0700 1 -- 172.21.15.29:0/2016034887 learned_addr learned my addr 172.21.15.29:0/2016034887 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdb7fff700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb81ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.380+0000 7efdbcfef700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 0x7efdb81ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 -- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 msgr2=0x7efdb81ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb81ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 -- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 msgr2=0x7efdb81ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 0x7efdb81ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 -- 172.21.15.29:0/2016034887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4009550 con 0x7efdb814eb30 2023-10-16T19:40:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbcfef700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 0x7efdb81ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbd7f0700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007e30 tx=0x7efdb000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000eea0 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0014420 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb80ab180 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00147d0 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.381+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8156b30 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.382+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb806f1b0 con 0x7efdb814eb30 2023-10-16T19:40:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.382+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efdb0014930 con 0x7efdb814eb30 2023-10-16T19:40:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.383+0000 7efdb57fa700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 0x7efd9c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.383+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdb008a070 con 0x7efdb814eb30 2023-10-16T19:40:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.383+0000 7efdbcfef700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 0x7efd9c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.383+0000 7efdbcfef700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 0x7efd9c06d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdac000f60 tx=0x7efdac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.387+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdb806f1b0 con 0x7efdb814eb30 2023-10-16T19:40:53.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.630+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb806f1b0 con 0x7efdb814eb30 2023-10-16T19:40:53.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.631+0000 7efdb57fa700 1 -- 172.21.15.29:0/2016034887 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4900 (secure 0 0 0) 0x7efdb806f1b0 con 0x7efdb814eb30 2023-10-16T19:40:53.634 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:53.634 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/967757351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":967757351},{"type":"v1","addr":"172.21.15.53:6836","nonce":967757351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/651599698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":651599698},{"type":"v1","addr":"172.21.15.53:6837","nonce":651599698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/140238807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":140238807},{"type":"v1","addr":"172.21.15.29:6834","nonce":140238807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:39:52.363895+0000","modified":"2023-10-16T19:40:16.827052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1712057273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1712057273},{"type":"v1","addr":"172.21.15.29:6835","nonce":1712057273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:40:53.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 msgr2=0x7efd9c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 0x7efd9c06d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdac000f60 tx=0x7efdac009040 comp rx=0 tx=0).stop 2023-10-16T19:40:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 msgr2=0x7efdb806f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007e30 tx=0x7efdb000e3c0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 shutdown_connections 2023-10-16T19:40:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7efd9c06af30 0x7efd9c06d3f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdb814eb30 0x7efdb806f490 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdb8152190 0x7efdb81ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 --2- 172.21.15.29:0/2016034887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdb8155710 0x7efdb81ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 >> 172.21.15.29:0/2016034887 conn(0x7efdb80a9cd0 msgr2=0x7efdb81544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 shutdown_connections 2023-10-16T19:40:53.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.633+0000 7efdbf253700 1 -- 172.21.15.29:0/2016034887 wait complete. 2023-10-16T19:40:53.639 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2023-10-16T19:40:53.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:40:53.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.772+0000 7f873bf35700 1 Processor -- start 2023-10-16T19:40:53.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.772+0000 7f873bf35700 1 -- start start 2023-10-16T19:40:53.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f873bf35700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8734154a50 0x7f87341583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f873bf35700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873406e780 con 0x7f873413d660 2023-10-16T19:40:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f873bf35700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8734154f10 con 0x7f873413dd00 2023-10-16T19:40:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f873bf35700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873406d320 con 0x7f8734154a50 2023-10-16T19:40:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8734154a50 0x7f87341583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8739cd1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f873413d660 0x7f873406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38576/0 (socket says 172.21.15.29:38576) 2023-10-16T19:40:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8734154a50 0x7f87341583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53134/0 (socket says 172.21.15.29:53134) 2023-10-16T19:40:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8739cd1700 1 -- 172.21.15.29:0/375961097 learned_addr learned my addr 172.21.15.29:0/375961097 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 -- 172.21.15.29:0/375961097 >> v1:172.21.15.53:6789/0 conn(0x7f873413dd00 legacy=0x7f8734158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 -- 172.21.15.29:0/375961097 >> v1:172.21.15.29:6789/0 conn(0x7f873413d660 legacy=0x7f873406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8738ccf700 1 -- 172.21.15.29:0/375961097 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076860187 0 0) 0x7f873406e780 con 0x7f873413d660 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 -- 172.21.15.29:0/375961097 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87341551f0 con 0x7f8734154a50 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f87394d0700 1 --2- 172.21.15.29:0/375961097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8734154a50 0x7f87341583c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8724009840 tx=0x7f8724009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d158aa4fe2cb925a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8738ccf700 1 -- 172.21.15.29:0/375961097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724004230 con 0x7f8734154a50 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8738ccf700 1 -- 172.21.15.29:0/375961097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724004390 con 0x7f8734154a50 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.773+0000 7f8738ccf700 1 -- 172.21.15.29:0/375961097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240036a0 con 0x7f8734154a50 2023-10-16T19:40:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 -- 172.21.15.29:0/375961097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8734154a50 msgr2=0x7f87341583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 --2- 172.21.15.29:0/375961097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8734154a50 0x7f87341583c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8724009840 tx=0x7f8724009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:53.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 -- 172.21.15.29:0/375961097 shutdown_connections 2023-10-16T19:40:53.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 --2- 172.21.15.29:0/375961097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8734154a50 0x7f87341583c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 -- 172.21.15.29:0/375961097 >> 172.21.15.29:0/375961097 conn(0x7f87340c7110 msgr2=0x7f87340c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 -- 172.21.15.29:0/375961097 shutdown_connections 2023-10-16T19:40:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.774+0000 7f873bf35700 1 -- 172.21.15.29:0/375961097 wait complete. 2023-10-16T19:40:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.775+0000 7f873bf35700 1 Processor -- start 2023-10-16T19:40:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.775+0000 7f873bf35700 1 -- start start 2023-10-16T19:40:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f873413dd00 0x7f8734155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734154a50 0x7f8734153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341eafa0 con 0x7f873413d660 2023-10-16T19:40:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734137cf0 con 0x7f8734154a50 2023-10-16T19:40:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873bf35700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8734139790 con 0x7f873413dd00 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53138/0 (socket says 172.21.15.29:53138) 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 -- 172.21.15.29:0/1068165478 learned_addr learned my addr 172.21.15.29:0/1068165478 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f87394d0700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f873413dd00 0x7f8734155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f873a4d2700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734154a50 0x7f8734153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 -- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f873413dd00 msgr2=0x7f8734155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f873413dd00 0x7f8734155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 -- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734154a50 msgr2=0x7f8734153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734154a50 0x7f8734153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 -- 172.21.15.29:0/1068165478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094a0 con 0x7f873413d660 2023-10-16T19:40:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.776+0000 7f8739cd1700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f87300011e0 tx=0x7f873000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730004c80 con 0x7f873413d660 2023-10-16T19:40:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730004e00 con 0x7f873413d660 2023-10-16T19:40:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8734139a70 con 0x7f873413d660 2023-10-16T19:40:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007310 con 0x7f873413d660 2023-10-16T19:40:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8734156450 con 0x7f873413d660 2023-10-16T19:40:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.777+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734137f10 con 0x7f873413d660 2023-10-16T19:40:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.778+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8730007470 con 0x7f873413d660 2023-10-16T19:40:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.779+0000 7f872a7fc700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 0x7f871806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:53.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.779+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8730089c30 con 0x7f873413d660 2023-10-16T19:40:53.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.779+0000 7f87394d0700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 0x7f871806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:53.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.780+0000 7f87394d0700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 0x7f871806d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87240090b0 tx=0x7f8724013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:53.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.783+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8730054990 con 0x7f873413d660 2023-10-16T19:40:53.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.985+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87340c3760 con 0x7f873413d660 2023-10-16T19:40:53.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.986+0000 7f872a7fc700 1 -- 172.21.15.29:0/1068165478 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f8730057fb0 con 0x7f873413d660 2023-10-16T19:40:53.989 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:40:53.989 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:40:41.656445+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:39:50.284613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:39:51.342127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T19:39:55.005615+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:40:53.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.988+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 msgr2=0x7f871806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 0x7f871806d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87240090b0 tx=0x7f8724013040 comp rx=0 tx=0).stop 2023-10-16T19:40:53.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 msgr2=0x7f8734157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:53.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f87300011e0 tx=0x7f873000cae0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 shutdown_connections 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f871806af30 0x7f871806d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734154a50 0x7f8734153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f873413d660 0x7f8734157cb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 --2- 172.21.15.29:0/1068165478 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f873413dd00 0x7f8734155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:53.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 >> 172.21.15.29:0/1068165478 conn(0x7f87340c7110 msgr2=0x7f8734135600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:53.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 shutdown_connections 2023-10-16T19:40:53.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:53.989+0000 7f873bf35700 1 -- 172.21.15.29:0/1068165478 wait complete. 2023-10-16T19:40:54.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T19:40:54.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.127+0000 7f92cbfe6700 1 Processor -- start 2023-10-16T19:40:54.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 -- start start 2023-10-16T19:40:54.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92c4154a50 0x7f92c41583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 0x7f92c4158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c4158e40 con 0x7f92c413d660 2023-10-16T19:40:54.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c406d320 con 0x7f92c4154a50 2023-10-16T19:40:54.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.128+0000 7f92cbfe6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c406e780 con 0x7f92c413dd00 2023-10-16T19:40:54.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92c4154a50 0x7f92c41583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92c4154a50 0x7f92c41583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:43432/0 (socket says 172.21.15.29:43432) 2023-10-16T19:40:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 -- 172.21.15.29:0/163661946 learned_addr learned my addr 172.21.15.29:0/163661946 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92ca583700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 0x7f92c4158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 -- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 msgr2=0x7f92c4158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 0x7f92c4158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 -- 172.21.15.29:0/163661946 >> v1:172.21.15.53:6789/0 conn(0x7f92c413d660 legacy=0x7f92c406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 -- 172.21.15.29:0/163661946 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4154f10 con 0x7f92c4154a50 2023-10-16T19:40:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92ca583700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 0x7f92c4158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c9581700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c4154a50 0x7f92c41583c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92c00098f0 tx=0x7f92c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aafc292e75f96f85 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c8d80700 1 -- 172.21.15.29:0/163661946 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0011830 con 0x7f92c4154a50 2023-10-16T19:40:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.129+0000 7f92c8d80700 1 -- 172.21.15.29:0/163661946 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c0011990 con 0x7f92c4154a50 2023-10-16T19:40:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92c8d80700 1 -- 172.21.15.29:0/163661946 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0011d20 con 0x7f92c4154a50 2023-10-16T19:40:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 -- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c4154a50 msgr2=0x7f92c41583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c4154a50 0x7f92c41583c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92c00098f0 tx=0x7f92c0009c00 comp rx=0 tx=0).stop 2023-10-16T19:40:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 -- 172.21.15.29:0/163661946 shutdown_connections 2023-10-16T19:40:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413dd00 0x7f92c4158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/163661946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c4154a50 0x7f92c41583c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 -- 172.21.15.29:0/163661946 >> 172.21.15.29:0/163661946 conn(0x7f92c40c7110 msgr2=0x7f92c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 -- 172.21.15.29:0/163661946 shutdown_connections 2023-10-16T19:40:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.130+0000 7f92cbfe6700 1 -- 172.21.15.29:0/163661946 wait complete. 2023-10-16T19:40:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.131+0000 7f92cbfe6700 1 Processor -- start 2023-10-16T19:40:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.131+0000 7f92cbfe6700 1 -- start start 2023-10-16T19:40:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413d660 0x7f92c40c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c413dd00 0x7f92c40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4136020 con 0x7f92c4154a50 2023-10-16T19:40:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41ee170 con 0x7f92c413dd00 2023-10-16T19:40:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92cbfe6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41ed310 con 0x7f92c413d660 2023-10-16T19:40:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53156/0 (socket says 172.21.15.29:53156) 2023-10-16T19:40:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 -- 172.21.15.29:0/4138599322 learned_addr learned my addr 172.21.15.29:0/4138599322 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92c9581700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c413dd00 0x7f92c40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92c9d82700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413d660 0x7f92c40c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 -- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413d660 msgr2=0x7f92c40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413d660 0x7f92c40c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 -- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c413dd00 msgr2=0x7f92c40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c413dd00 0x7f92c40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.132+0000 7f92ca583700 1 -- 172.21.15.29:0/4138599322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009a70 con 0x7f92c4154a50 2023-10-16T19:40:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92ca583700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009f00 tx=0x7f92bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc009d70 con 0x7f92c4154a50 2023-10-16T19:40:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc00f040 con 0x7f92c4154a50 2023-10-16T19:40:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c0009550 con 0x7f92c4154a50 2023-10-16T19:40:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc014680 con 0x7f92c4154a50 2023-10-16T19:40:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.133+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c41ed840 con 0x7f92c4154a50 2023-10-16T19:40:54.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.134+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c40c3030 con 0x7f92c4154a50 2023-10-16T19:40:54.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.134+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92bc0147e0 con 0x7f92c4154a50 2023-10-16T19:40:54.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.135+0000 7f92ba7fc700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 0x7f92a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.135+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92bc08a800 con 0x7f92c4154a50 2023-10-16T19:40:54.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.135+0000 7f92c9d82700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 0x7f92a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.135+0000 7f92c9d82700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 0x7f92a806d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000f60 tx=0x7f92b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.139+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92bc0554f0 con 0x7f92c4154a50 2023-10-16T19:40:54.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.383+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f92c40c3760 con 0x7f92c4154a50 2023-10-16T19:40:54.386 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-16T19:40:54.384+0000 7f538eb0c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T19:40:54.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.385+0000 7f92ba7fc700 1 -- 172.21.15.29:0/4138599322 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f92bc018090 con 0x7f92c4154a50 2023-10-16T19:40:54.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 msgr2=0x7f92a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 0x7f92a806d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000f60 tx=0x7f92b4009040 comp rx=0 tx=0).stop 2023-10-16T19:40:54.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 msgr2=0x7f92c41516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009f00 tx=0x7f92bc00c3a0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 shutdown_connections 2023-10-16T19:40:54.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f92a806af00 0x7f92a806d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92c4154a50 0x7f92c41516f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f92c413d660 0x7f92c40c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.388+0000 7f92cbfe6700 1 --2- 172.21.15.29:0/4138599322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c413dd00 0x7f92c40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.389+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 >> 172.21.15.29:0/4138599322 conn(0x7f92c40c7110 msgr2=0x7f92c406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:54.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.389+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 shutdown_connections 2023-10-16T19:40:54.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.389+0000 7f92cbfe6700 1 -- 172.21.15.29:0/4138599322 wait complete. 2023-10-16T19:40:54.394 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T19:40:54.394 INFO:tasks.ceph.mds.c.smithi029.stderr: -4457> 2023-10-16T19:39:56.749+0000 7f0f9cc7a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T19:40:54.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T19:40:54.426 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-16T19:40:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.531+0000 7fda5a610700 1 Processor -- start 2023-10-16T19:40:54.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.531+0000 7fda5a610700 1 -- start start 2023-10-16T19:40:54.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda5a610700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 0x7fda5406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda5a610700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda54154a50 0x7fda541583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda5a610700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5406e780 con 0x7fda5406adc0 2023-10-16T19:40:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda5a610700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5406d320 con 0x7fda54154a50 2023-10-16T19:40:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda5a610700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda54154f10 con 0x7fda5413d660 2023-10-16T19:40:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda537fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda54154a50 0x7fda541583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda537fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda54154a50 0x7fda541583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53172/0 (socket says 172.21.15.29:53172) 2023-10-16T19:40:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.532+0000 7fda537fe700 1 -- 172.21.15.29:0/3874591101 learned_addr learned my addr 172.21.15.29:0/3874591101 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda53fff700 1 --2- 172.21.15.29:0/3874591101 >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 0x7fda5406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda537fe700 1 -- 172.21.15.29:0/3874591101 >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 msgr2=0x7fda5406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda537fe700 1 --2- 172.21.15.29:0/3874591101 >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 0x7fda5406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda537fe700 1 -- 172.21.15.29:0/3874591101 >> v1:172.21.15.53:6789/0 conn(0x7fda5406adc0 legacy=0x7fda54158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:54.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda537fe700 1 -- 172.21.15.29:0/3874591101 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda541551f0 con 0x7fda54154a50 2023-10-16T19:40:54.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda53fff700 1 --2- 172.21.15.29:0/3874591101 >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 0x7fda5406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:54.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda537fe700 1 --2- 172.21.15.29:0/3874591101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda541583c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda540c15e0 tx=0x7fda3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507877a6680e22c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda52ffd700 1 -- 172.21.15.29:0/3874591101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c004230 con 0x7fda54154a50 2023-10-16T19:40:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda52ffd700 1 -- 172.21.15.29:0/3874591101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c004390 con 0x7fda54154a50 2023-10-16T19:40:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda52ffd700 1 -- 172.21.15.29:0/3874591101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0036a0 con 0x7fda54154a50 2023-10-16T19:40:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda5a610700 1 -- 172.21.15.29:0/3874591101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 msgr2=0x7fda541583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.533+0000 7fda5a610700 1 --2- 172.21.15.29:0/3874591101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda541583c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda540c15e0 tx=0x7fda3c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 -- 172.21.15.29:0/3874591101 shutdown_connections 2023-10-16T19:40:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 --2- 172.21.15.29:0/3874591101 >> v2:172.21.15.53:3300/0 conn(0x7fda5413d660 0x7fda5406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 --2- 172.21.15.29:0/3874591101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda541583c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 -- 172.21.15.29:0/3874591101 >> 172.21.15.29:0/3874591101 conn(0x7fda540c7110 msgr2=0x7fda540c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 -- 172.21.15.29:0/3874591101 shutdown_connections 2023-10-16T19:40:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.534+0000 7fda5a610700 1 -- 172.21.15.29:0/3874591101 wait complete. 2023-10-16T19:40:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.535+0000 7fda5a610700 1 Processor -- start 2023-10-16T19:40:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.535+0000 7fda5a610700 1 -- start start 2023-10-16T19:40:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 0x7fda541532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fda5413d660 0x7fda540c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c4ba0 con 0x7fda54154a50 2023-10-16T19:40:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda541ede50 con 0x7fda5406adc0 2023-10-16T19:40:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c4e40 con 0x7fda5413d660 2023-10-16T19:40:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53180/0 (socket says 172.21.15.29:53180) 2023-10-16T19:40:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 -- 172.21.15.29:0/4103913613 learned_addr learned my addr 172.21.15.29:0/4103913613 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda537fe700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fda5413d660 0x7fda540c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda53fff700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 0x7fda541532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 -- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fda5413d660 msgr2=0x7fda540c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fda5413d660 0x7fda540c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 -- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 msgr2=0x7fda541532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 0x7fda541532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 -- 172.21.15.29:0/4103913613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009550 con 0x7fda54154a50 2023-10-16T19:40:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda53fff700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 0x7fda541532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda58bad700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00cc10 tx=0x7fda4c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c004be0 con 0x7fda54154a50 2023-10-16T19:40:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c004d40 con 0x7fda54154a50 2023-10-16T19:40:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda54153820 con 0x7fda54154a50 2023-10-16T19:40:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00ab90 con 0x7fda54154a50 2023-10-16T19:40:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.536+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda54153d20 con 0x7fda54154a50 2023-10-16T19:40:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.537+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda540c3780 con 0x7fda54154a50 2023-10-16T19:40:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.538+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda4c00acf0 con 0x7fda54154a50 2023-10-16T19:40:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.538+0000 7fda50ff9700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 0x7fda3406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:54.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.539+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fda4c089330 con 0x7fda54154a50 2023-10-16T19:40:54.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.539+0000 7fda53fff700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 0x7fda3406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:54.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.539+0000 7fda53fff700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 0x7fda3406d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda44006fd0 tx=0x7fda44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:54.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.543+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda4c054060 con 0x7fda54154a50 2023-10-16T19:40:54.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:54.791+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda5404f400 con 0x7fda54154a50 2023-10-16T19:40:55.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.418+0000 7fda50ff9700 1 -- 172.21.15.29:0/4103913613 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda4c057680 con 0x7fda54154a50 2023-10-16T19:40:55.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 msgr2=0x7fda3406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 0x7fda3406d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda44006fd0 tx=0x7fda44008040 comp rx=0 tx=0).stop 2023-10-16T19:40:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 msgr2=0x7fda5413be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00cc10 tx=0x7fda4c00cf20 comp rx=0 tx=0).stop 2023-10-16T19:40:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 shutdown_connections 2023-10-16T19:40:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fda3406af30 0x7fda3406d3f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda54154a50 0x7fda5413be10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5406adc0 0x7fda541532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 --2- 172.21.15.29:0/4103913613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fda5413d660 0x7fda540c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 >> 172.21.15.29:0/4103913613 conn(0x7fda540c7110 msgr2=0x7fda540c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 shutdown_connections 2023-10-16T19:40:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.421+0000 7fda5a610700 1 -- 172.21.15.29:0/4103913613 wait complete. 2023-10-16T19:40:55.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T19:40:55.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.615+0000 7f005d0fd700 1 Processor -- start 2023-10-16T19:40:55.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.615+0000 7f005d0fd700 1 -- start start 2023-10-16T19:40:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005d0fd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0058155470 0x7f005806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005d0fd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0058158080 con 0x7f00580c2350 2023-10-16T19:40:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005d0fd700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0058155880 con 0x7f00580acb10 2023-10-16T19:40:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005d0fd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0058158f50 con 0x7f0058155470 2023-10-16T19:40:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0058155470 0x7f005806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0058155470 0x7f005806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53190/0 (socket says 172.21.15.29:53190) 2023-10-16T19:40:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005659c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f00580c2350 0x7f005814b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38632/0 (socket says 172.21.15.29:38632) 2023-10-16T19:40:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 -- 172.21.15.29:0/4055591037 learned_addr learned my addr 172.21.15.29:0/4055591037 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 -- 172.21.15.29:0/4055591037 >> v1:172.21.15.53:6789/0 conn(0x7f00580acb10 legacy=0x7f0058158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 -- 172.21.15.29:0/4055591037 >> v1:172.21.15.29:6789/0 conn(0x7f00580c2350 legacy=0x7f005814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f005759e700 1 -- 172.21.15.29:0/4055591037 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580c3180 con 0x7f0058155470 2023-10-16T19:40:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.616+0000 7f0055d9b700 1 -- 172.21.15.29:0/4055591037 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951889712 0 0) 0x7f0058158080 con 0x7f00580c2350 2023-10-16T19:40:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005759e700 1 --2- 172.21.15.29:0/4055591037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f005806d2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d58074687626e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f0055d9b700 1 -- 172.21.15.29:0/4055591037 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000e070 con 0x7f0058155470 2023-10-16T19:40:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f0055d9b700 1 -- 172.21.15.29:0/4055591037 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005000b9c0 con 0x7f0058155470 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f0055d9b700 1 -- 172.21.15.29:0/4055591037 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000bd70 con 0x7f0058155470 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 -- 172.21.15.29:0/4055591037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 msgr2=0x7f005806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 --2- 172.21.15.29:0/4055591037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f005806d2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005000b330 comp rx=0 tx=0).stop 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 -- 172.21.15.29:0/4055591037 shutdown_connections 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 --2- 172.21.15.29:0/4055591037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f005806d2a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 -- 172.21.15.29:0/4055591037 >> 172.21.15.29:0/4055591037 conn(0x7f00580c6ff0 msgr2=0x7f00580c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 -- 172.21.15.29:0/4055591037 shutdown_connections 2023-10-16T19:40:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.617+0000 7f005d0fd700 1 -- 172.21.15.29:0/4055591037 wait complete. 2023-10-16T19:40:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.619+0000 7f005d0fd700 1 Processor -- start 2023-10-16T19:40:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.619+0000 7f005d0fd700 1 -- start start 2023-10-16T19:40:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580acb10 0x7f0058152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00580c2350 0x7f0058156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005814b500 con 0x7f0058155470 2023-10-16T19:40:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058144010 con 0x7f00580acb10 2023-10-16T19:40:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005814af40 con 0x7f00580c2350 2023-10-16T19:40:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53196/0 (socket says 172.21.15.29:53196) 2023-10-16T19:40:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 -- 172.21.15.29:0/1915588444 learned_addr learned my addr 172.21.15.29:0/1915588444 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005659c700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00580c2350 0x7f0058156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f0056d9d700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580acb10 0x7f0058152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 -- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00580c2350 msgr2=0x7f0058156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00580c2350 0x7f0058156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 -- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580acb10 msgr2=0x7f0058152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580acb10 0x7f0058152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 -- 172.21.15.29:0/1915588444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009b30 con 0x7f0058155470 2023-10-16T19:40:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005759e700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e20 tx=0x7f0050004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050007000 con 0x7f0058155470 2023-10-16T19:40:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050004920 con 0x7f0058155470 2023-10-16T19:40:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005001b670 con 0x7f0058155470 2023-10-16T19:40:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005814b220 con 0x7f0058155470 2023-10-16T19:40:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.620+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0058152f50 con 0x7f0058155470 2023-10-16T19:40:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.621+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0058143b00 con 0x7f0058155470 2023-10-16T19:40:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.622+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f005001b7d0 con 0x7f0058155470 2023-10-16T19:40:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.622+0000 7f003f7fe700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 0x7f004406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.622+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f005008b2a0 con 0x7f0058155470 2023-10-16T19:40:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.623+0000 7f0056d9d700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 0x7f004406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.623+0000 7f0056d9d700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 0x7f004406d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f004c007fd0 tx=0x7f004c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.627+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0058143b00 con 0x7f0058155470 2023-10-16T19:40:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:55.828+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0058143b00 con 0x7f0058155470 2023-10-16T19:40:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.698+0000 7f003f7fe700 1 -- 172.21.15.29:0/1915588444 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0058143b00 con 0x7f0058155470 2023-10-16T19:40:56.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 msgr2=0x7f004406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 0x7f004406d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f004c007fd0 tx=0x7f004c009040 comp rx=0 tx=0).stop 2023-10-16T19:40:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 msgr2=0x7f0058156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e20 tx=0x7f0050004ad0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 shutdown_connections 2023-10-16T19:40:56.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f004406af00 0x7f004406d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0058155470 0x7f0058156a70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580acb10 0x7f0058152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 --2- 172.21.15.29:0/1915588444 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00580c2350 0x7f0058156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 >> 172.21.15.29:0/1915588444 conn(0x7f00580c6ff0 msgr2=0x7f00580c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 shutdown_connections 2023-10-16T19:40:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.702+0000 7f005d0fd700 1 -- 172.21.15.29:0/1915588444 wait complete. 2023-10-16T19:40:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-16T19:40:56.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T19:40:56.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 Processor -- start 2023-10-16T19:40:56.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 -- start start 2023-10-16T19:40:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c0c0c8200 0x7f7c0c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c06ff20 con 0x7f7c0c152f70 2023-10-16T19:40:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c070170 con 0x7f7c0c156a50 2023-10-16T19:40:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.854+0000 7f7c12133700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c155f70 con 0x7f7c0c0c8200 2023-10-16T19:40:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7c0c152f70 0x7f7c0c0c73f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38648/0 (socket says 172.21.15.29:38648) 2023-10-16T19:40:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0bfff700 1 -- 172.21.15.29:0/1806692619 learned_addr learned my addr 172.21.15.29:0/1806692619 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0b7fe700 1 --2- 172.21.15.29:0/1806692619 >> v2:172.21.15.53:3300/0 conn(0x7f7c0c0c8200 0x7f7c0c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494518824 0 0) 0x7f7c0c06ff20 con 0x7f7c0c152f70 2023-10-16T19:40:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf40035b0 con 0x7f7c0c152f70 2023-10-16T19:40:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 386092885 0 0) 0x7f7bf40035b0 con 0x7f7c0c152f70 2023-10-16T19:40:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 >> v2:172.21.15.53:3300/0 conn(0x7f7c0c0c8200 msgr2=0x7f7c0c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 --2- 172.21.15.29:0/1806692619 >> v2:172.21.15.53:3300/0 conn(0x7f7c0c0c8200 0x7f7c0c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 >> v1:172.21.15.53:6789/0 conn(0x7f7c0c156a50 legacy=0x7f7c0c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c156250 con 0x7f7c0c152f70 2023-10-16T19:40:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f7c040019f0 con 0x7f7c0c152f70 2023-10-16T19:40:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 >> v1:172.21.15.29:6789/0 conn(0x7f7c0c152f70 legacy=0x7f7c0c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bf4003a00 0x7f7bf4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bf4004850 0x7f7bf4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7bf400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c155f70 con 0x7f7bf4005210 2023-10-16T19:40:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400c1b0 con 0x7f7bf4003a00 2023-10-16T19:40:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf400c370 con 0x7f7bf4004850 2023-10-16T19:40:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7bf400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0b7fe700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bf4003a00 0x7f7bf4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.855+0000 7f7c0affd700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bf4004850 0x7f7bf4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 -- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bf4004850 msgr2=0x7f7bf4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7bf4004850 0x7f7bf4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 -- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bf4003a00 msgr2=0x7f7bf4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bf4003a00 0x7f7bf4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 -- 172.21.15.29:0/1806692619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40035b0 con 0x7f7bf4005210 2023-10-16T19:40:56.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 -- 172.21.15.29:0/1806692619 reap_dead start 2023-10-16T19:40:56.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7bf400ba10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a800 tx=0x7f7bf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579703c91898538b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:56.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400a2f0 con 0x7f7bf4005210 2023-10-16T19:40:56.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04012600 con 0x7f7bf4005210 2023-10-16T19:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c0a7fc700 1 -- 172.21.15.29:0/1806692619 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c040129b0 con 0x7f7bf4005210 2023-10-16T19:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c12133700 1 -- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 msgr2=0x7f7bf400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.856+0000 7f7c12133700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7bf400ba10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a800 tx=0x7f7bf4005880 comp rx=0 tx=0).stop 2023-10-16T19:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.857+0000 7f7c12133700 1 -- 172.21.15.29:0/1806692619 shutdown_connections 2023-10-16T19:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.857+0000 7f7c12133700 1 --2- 172.21.15.29:0/1806692619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7bf400ba10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.857+0000 7f7c12133700 1 -- 172.21.15.29:0/1806692619 >> 172.21.15.29:0/1806692619 conn(0x7f7c0c0729d0 msgr2=0x7f7c0c06a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:56.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.857+0000 7f7c12133700 1 -- 172.21.15.29:0/1806692619 shutdown_connections 2023-10-16T19:40:56.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.857+0000 7f7c12133700 1 -- 172.21.15.29:0/1806692619 wait complete. 2023-10-16T19:40:56.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.858+0000 7f7c12133700 1 Processor -- start 2023-10-16T19:40:56.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.858+0000 7f7c12133700 1 -- start start 2023-10-16T19:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.858+0000 7f7c12133700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 0x7f7c0c0bad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 0x7f7c0c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1e9af0 con 0x7f7bf4005210 2023-10-16T19:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0bfa70 con 0x7f7c0c0bff30 2023-10-16T19:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1ed180 con 0x7f7c0c0bf3e0 2023-10-16T19:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53212/0 (socket says 172.21.15.29:53212) 2023-10-16T19:40:56.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 -- 172.21.15.29:0/2187953987 learned_addr learned my addr 172.21.15.29:0/2187953987 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:56.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 0x7f7c0c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0affd700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 0x7f7c0c0bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 -- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 msgr2=0x7f7c0c0bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 0x7f7c0c0bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 -- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 msgr2=0x7f7c0c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 0x7f7c0c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 -- 172.21.15.29:0/2187953987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0c0490 con 0x7f7bf4005210 2023-10-16T19:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0affd700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 0x7f7c0c0bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0bfff700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 0x7f7c0c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c0b7fe700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0119a0 tx=0x7f7bfc011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00f8e0 con 0x7f7bf4005210 2023-10-16T19:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00fa40 con 0x7f7bf4005210 2023-10-16T19:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00fdd0 con 0x7f7bf4005210 2023-10-16T19:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c0bfcc0 con 0x7f7bf4005210 2023-10-16T19:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.859+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c1ece10 con 0x7f7bf4005210 2023-10-16T19:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.860+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c1ecc70 con 0x7f7bf4005210 2023-10-16T19:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.861+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bfc014440 con 0x7f7bf4005210 2023-10-16T19:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.861+0000 7f7bf3fff700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 0x7f7bf806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.861+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f7bfc089e20 con 0x7f7bf4005210 2023-10-16T19:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.861+0000 7f7c0affd700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 0x7f7bf806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.862+0000 7f7c0affd700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 0x7f7bf806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c155f40 tx=0x7f7c00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:56.865+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c0c1ecc70 con 0x7f7bf4005210 2023-10-16T19:40:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.070+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c0c1ecc70 con 0x7f7bf4005210 2023-10-16T19:40:57.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:57.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:40:57.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.700+0000 7f7bf3fff700 1 -- 172.21.15.29:0/2187953987 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c0c1ecc70 con 0x7f7bf4005210 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 msgr2=0x7f7bf806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 0x7f7bf806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c155f40 tx=0x7f7c00009040 comp rx=0 tx=0).stop 2023-10-16T19:40:57.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 msgr2=0x7f7c0c1ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0119a0 tx=0x7f7bfc011d60 comp rx=0 tx=0).stop 2023-10-16T19:40:57.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 shutdown_connections 2023-10-16T19:40:57.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f7bf806af00 0x7f7bf806d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c0c0bff30 0x7f7c0c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bf4005210 0x7f7c0c1ed610 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0119a0 tx=0x7f7bfc011d60 comp rx=0 tx=0).stop 2023-10-16T19:40:57.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 --2- 172.21.15.29:0/2187953987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c0c0bf3e0 0x7f7c0c0bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.703+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 >> 172.21.15.29:0/2187953987 conn(0x7f7c0c0729d0 msgr2=0x7f7c0c0a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:57.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.704+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 shutdown_connections 2023-10-16T19:40:57.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.705+0000 7f7c12133700 1 -- 172.21.15.29:0/2187953987 wait complete. 2023-10-16T19:40:57.708 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-16T19:40:57.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-16T19:40:57.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.854+0000 7f8c6f62b700 1 Processor -- start 2023-10-16T19:40:57.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.854+0000 7f8c6f62b700 1 -- start start 2023-10-16T19:40:57.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6f62b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c680c43b0 0x7f8c681531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6f62b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680c7d10 con 0x7f8c680adb20 2023-10-16T19:40:57.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6f62b700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680c73e0 con 0x7f8c680a9ed0 2023-10-16T19:40:57.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6f62b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680c4990 con 0x7f8c680c43b0 2023-10-16T19:40:57.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6cbc6700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c680adb20 0x7f8c68152aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38664/0 (socket says 172.21.15.29:38664) 2023-10-16T19:40:57.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6cbc6700 1 -- 172.21.15.29:0/3700035457 learned_addr learned my addr 172.21.15.29:0/3700035457 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:57.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c680c43b0 0x7f8c681531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122130013 0 0) 0x7f8c680c7d10 con 0x7f8c680adb20 2023-10-16T19:40:57.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c540035b0 con 0x7f8c680adb20 2023-10-16T19:40:57.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.855+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016244062 0 0) 0x7f8c680c73e0 con 0x7f8c680a9ed0 2023-10-16T19:40:57.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c680c7d10 con 0x7f8c680a9ed0 2023-10-16T19:40:57.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985761969 0 0) 0x7f8c540035b0 con 0x7f8c680adb20 2023-10-16T19:40:57.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c680c43b0 msgr2=0x7f8c681531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:57.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c680c43b0 0x7f8c681531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 >> v1:172.21.15.53:6789/0 conn(0x7f8c680a9ed0 legacy=0x7f8c6814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680c76c0 con 0x7f8c680adb20 2023-10-16T19:40:57.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f8c64001670 con 0x7f8c680adb20 2023-10-16T19:40:57.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 >> v1:172.21.15.29:6789/0 conn(0x7f8c680adb20 legacy=0x7f8c68152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54003bc0 0x7f8c54003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c54004850 0x7f8c54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c54005210 0x7f8c5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680c4990 con 0x7f8c54005210 2023-10-16T19:40:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400c080 con 0x7f8c54004850 2023-10-16T19:40:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5400c240 con 0x7f8c54003bc0 2023-10-16T19:40:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c680c43b0 0x7f8c681531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:40:57.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c54005210 0x7f8c5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6d3c7700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54003bc0 0x7f8c54003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6cbc6700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c54004850 0x7f8c54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54003bc0 msgr2=0x7f8c54003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54003bc0 0x7f8c54003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c54004850 msgr2=0x7f8c54004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c54004850 0x7f8c54004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3700035457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540035b0 con 0x7f8c54005210 2023-10-16T19:40:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c54005210 0x7f8c5400ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8c680c4790 tx=0x7f8c54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f205e1d0f8c1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.856+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60003c20 con 0x7f8c54005210 2023-10-16T19:40:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000f040 con 0x7f8c54005210 2023-10-16T19:40:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c5ffff700 1 -- 172.21.15.29:0/3700035457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000ea60 con 0x7f8c54005210 2023-10-16T19:40:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3700035457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c54005210 msgr2=0x7f8c5400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3700035457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c54005210 0x7f8c5400ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8c680c4790 tx=0x7f8c54005880 comp rx=0 tx=0).stop 2023-10-16T19:40:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3700035457 reap_dead start 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3700035457 shutdown_connections 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3700035457 >> 172.21.15.29:0/3700035457 conn(0x7f8c6806aeb0 msgr2=0x7f8c680c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3700035457 shutdown_connections 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.857+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3700035457 wait complete. 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.858+0000 7f8c6f62b700 1 Processor -- start 2023-10-16T19:40:57.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.858+0000 7f8c6f62b700 1 -- start start 2023-10-16T19:40:57.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 0x7f8c681472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c680c1d90 0x7f8c680be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680c1a20 con 0x7f8c6814e800 2023-10-16T19:40:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6814e2b0 con 0x7f8c680c1d90 2023-10-16T19:40:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6f62b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68146e00 con 0x7f8c54005210 2023-10-16T19:40:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6dbc8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6dbc8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53234/0 (socket says 172.21.15.29:53234) 2023-10-16T19:40:57.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3285321106 learned_addr learned my addr 172.21.15.29:0/3285321106 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:57.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6cbc6700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c680c1d90 0x7f8c680be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.859+0000 7f8c6d3c7700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 0x7f8c681472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 msgr2=0x7f8c681472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 0x7f8c681472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c680c1d90 msgr2=0x7f8c680be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:57.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c680c1d90 0x7f8c680be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:57.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 -- 172.21.15.29:0/3285321106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c681dcb40 con 0x7f8c6814e800 2023-10-16T19:40:57.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6d3c7700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 0x7f8c681472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:40:57.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6dbc8700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8c60015000 tx=0x7f8c60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:57.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60004230 con 0x7f8c6814e800 2023-10-16T19:40:57.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60022070 con 0x7f8c6814e800 2023-10-16T19:40:57.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6806bb10 con 0x7f8c6814e800 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600045d0 con 0x7f8c6814e800 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.860+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c680bed60 con 0x7f8c6814e800 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.861+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c68147800 con 0x7f8c6814e800 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.861+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c60024030 con 0x7f8c6814e800 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.862+0000 7f8c5dffb700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 0x7f8c4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:57.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.862+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f8c6008b070 con 0x7f8c6814e800 2023-10-16T19:40:57.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.862+0000 7f8c6d3c7700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 0x7f8c4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:57.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.863+0000 7f8c6d3c7700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 0x7f8c4c06d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007fd0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:57.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:57.867+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c60056280 con 0x7f8c6814e800 2023-10-16T19:40:58.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.072+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c6804f400 con 0x7f8c6814e800 2023-10-16T19:40:58.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.712+0000 7f8c5dffb700 1 -- 172.21.15.29:0/3285321106 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8c600598a0 con 0x7f8c6814e800 2023-10-16T19:40:58.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.717+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 msgr2=0x7f8c4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.717+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 0x7f8c4c06d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007fd0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2023-10-16T19:40:58.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.717+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 msgr2=0x7f8c680c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.717+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8c60015000 tx=0x7f8c60009750 comp rx=0 tx=0).stop 2023-10-16T19:40:58.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 shutdown_connections 2023-10-16T19:40:58.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f8c4c06af00 0x7f8c4c06d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c6814e800 0x7f8c680c2980 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c54005210 0x7f8c681472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 --2- 172.21.15.29:0/3285321106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c680c1d90 0x7f8c680be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 >> 172.21.15.29:0/3285321106 conn(0x7f8c6806aeb0 msgr2=0x7f8c68150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:58.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 shutdown_connections 2023-10-16T19:40:58.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.719+0000 7f8c6f62b700 1 -- 172.21.15.29:0/3285321106 wait complete. 2023-10-16T19:40:58.726 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2023-10-16T19:40:58.739 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T19:40:58.740 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T19:40:58.740 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T19:40:58.740 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:40:58.741 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T19:40:58.741 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T19:40:58.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T19:40:58.742 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:40:58.742 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T19:40:58.742 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T19:40:58.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T19:40:58.743 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:40:58.743 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T19:40:58.743 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T19:40:58.744 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T19:40:58.744 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:40:58.752 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T19:40:58.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T19:40:58.754 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T19:40:58.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T19:40:58.755 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T19:40:58.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T19:40:58.757 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T19:40:58.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T19:40:58.795 INFO:tasks.ceph.mds.a:Started 2023-10-16T19:40:58.796 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:58.797 INFO:tasks.ceph.mds.c:Started 2023-10-16T19:40:58.798 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:58.799 INFO:tasks.ceph.mds.d:Started 2023-10-16T19:40:58.799 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:58.800 INFO:tasks.ceph.mds.b:Started 2023-10-16T19:40:58.800 DEBUG:teuthology.parallel:result is None 2023-10-16T19:40:58.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T19:40:58.883 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-16T19:40:58.884 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-16T19:40:58.889 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2023-10-16T19:40:58.889 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2023-10-16T19:40:58.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.934+0000 7fede4c20700 1 Processor -- start 2023-10-16T19:40:58.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.934+0000 7fede4c20700 1 -- start start 2023-10-16T19:40:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fede4c20700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 0x7fede01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fede4c20700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fede006db00 0x7fede006df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fede4c20700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede0155af0 con 0x7fede014ec50 2023-10-16T19:40:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fede4c20700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede0152300 con 0x7fede006db00 2023-10-16T19:40:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fede4c20700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00c2e40 con 0x7fede00c3350 2023-10-16T19:40:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fedde59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fede014ec50 0x7fede0071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38706/0 (socket says 172.21.15.29:38706) 2023-10-16T19:40:58.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fedde59c700 1 -- 172.21.15.29:0/1395157864 learned_addr learned my addr 172.21.15.29:0/1395157864 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:40:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1395157864 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 0x7fede01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.935+0000 7fedded9d700 1 --2- 172.21.15.29:0/1395157864 >> v2:172.21.15.53:3300/0 conn(0x7fede006db00 0x7fede006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7feddd59a700 1 -- 172.21.15.29:0/1395157864 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346666810 0 0) 0x7fedd4001110 con 0x7fede014ec50 2023-10-16T19:40:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7feddd59a700 1 -- 172.21.15.29:0/1395157864 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc80035b0 con 0x7fede014ec50 2023-10-16T19:40:58.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7fedddd9b700 1 -- 172.21.15.29:0/1395157864 >> v2:172.21.15.53:3300/0 conn(0x7fede006db00 msgr2=0x7fede006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:40:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1395157864 >> v2:172.21.15.53:3300/0 conn(0x7fede006db00 0x7fede006df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7fedddd9b700 1 -- 172.21.15.29:0/1395157864 >> v1:172.21.15.29:6789/0 conn(0x7fede014ec50 legacy=0x7fede0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7fedddd9b700 1 -- 172.21.15.29:0/1395157864 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede014f030 con 0x7fede00c3350 2023-10-16T19:40:58.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1395157864 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 0x7fede01555b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11cbe8327cf81da server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7feddd59a700 1 -- 172.21.15.29:0/1395157864 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011830 con 0x7fede00c3350 2023-10-16T19:40:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7feddd59a700 1 -- 172.21.15.29:0/1395157864 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0011990 con 0x7fede00c3350 2023-10-16T19:40:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.936+0000 7feddd59a700 1 -- 172.21.15.29:0/1395157864 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011d00 con 0x7fede00c3350 2023-10-16T19:40:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 -- 172.21.15.29:0/1395157864 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 msgr2=0x7fede01555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 --2- 172.21.15.29:0/1395157864 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 0x7fede01555b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).stop 2023-10-16T19:40:58.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 -- 172.21.15.29:0/1395157864 shutdown_connections 2023-10-16T19:40:58.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 --2- 172.21.15.29:0/1395157864 >> v2:172.21.15.53:3300/0 conn(0x7fede006db00 0x7fede006df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 --2- 172.21.15.29:0/1395157864 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede00c3350 0x7fede01555b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 -- 172.21.15.29:0/1395157864 >> 172.21.15.29:0/1395157864 conn(0x7fede00c7110 msgr2=0x7fede00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:40:58.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 -- 172.21.15.29:0/1395157864 shutdown_connections 2023-10-16T19:40:58.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.937+0000 7fede4c20700 1 -- 172.21.15.29:0/1395157864 wait complete. 2023-10-16T19:40:58.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.938+0000 7fede4c20700 1 Processor -- start 2023-10-16T19:40:58.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.938+0000 7fede4c20700 1 -- start start 2023-10-16T19:40:58.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede006db00 0x7fede00c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede014ec50 0x7fede0144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0153e60 con 0x7fede00c3350 2023-10-16T19:40:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0150bb0 con 0x7fede014ec50 2023-10-16T19:40:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fede4c20700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede01451b0 con 0x7fede006db00 2023-10-16T19:40:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53270/0 (socket says 172.21.15.29:53270) 2023-10-16T19:40:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 -- 172.21.15.29:0/1636768744 learned_addr learned my addr 172.21.15.29:0/1636768744 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:40:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedde59c700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede006db00 0x7fede00c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedded9d700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede014ec50 0x7fede0144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 -- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede006db00 msgr2=0x7fede00c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede006db00 0x7fede00c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 -- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede014ec50 msgr2=0x7fede0144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:40:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede014ec50 0x7fede0144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:40:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 -- 172.21.15.29:0/1636768744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00094a0 con 0x7fede00c3350 2023-10-16T19:40:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.939+0000 7fedddd9b700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009fd0 tx=0x7fedd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.940+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004550 con 0x7fede00c3350 2023-10-16T19:40:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.940+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd001e070 con 0x7fede00c3350 2023-10-16T19:40:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.940+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede014ffa0 con 0x7fede00c3350 2023-10-16T19:40:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.940+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00038e0 con 0x7fede00c3350 2023-10-16T19:40:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.940+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede0150560 con 0x7fede00c3350 2023-10-16T19:40:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.941+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00a8b90 con 0x7fede00c3350 2023-10-16T19:40:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.941+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedd0003a40 con 0x7fede00c3350 2023-10-16T19:40:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.942+0000 7fedceffd700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:40:58.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.942+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fedd008a1a0 con 0x7fede00c3350 2023-10-16T19:40:58.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.942+0000 7fedde59c700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:40:58.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.942+0000 7fedde59c700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 0x7fedc006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fedd4007fd0 tx=0x7fedd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:40:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:58.946+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedd0055420 con 0x7fede00c3350 2023-10-16T19:40:59.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:40:59.163+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fede004f400 con 0x7fede00c3350 2023-10-16T19:41:00.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.426+0000 7fedceffd700 1 -- 172.21.15.29:0/1636768744 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fedd0058a40 con 0x7fede00c3350 2023-10-16T19:41:00.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 msgr2=0x7fedc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 0x7fedc006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fedd4007fd0 tx=0x7fedd4009040 comp rx=0 tx=0).stop 2023-10-16T19:41:00.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 msgr2=0x7fede0144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009fd0 tx=0x7fedd0004750 comp rx=0 tx=0).stop 2023-10-16T19:41:00.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 shutdown_connections 2023-10-16T19:41:00.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede014ec50 0x7fede0144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fede006db00 0x7fede00c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 --2- 172.21.15.29:0/1636768744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fede00c3350 0x7fede0144730 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 >> 172.21.15.29:0/1636768744 conn(0x7fede00c7110 msgr2=0x7fede0154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:00.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 shutdown_connections 2023-10-16T19:41:00.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.429+0000 7fede4c20700 1 -- 172.21.15.29:0/1636768744 wait complete. 2023-10-16T19:41:00.434 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-16T19:41:00.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T19:41:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.576+0000 7f4f81b90700 1 Processor -- start 2023-10-16T19:41:00.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.576+0000 7f4f81b90700 1 -- start start 2023-10-16T19:41:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f81b90700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c150100 0x7f4f7c156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f81b90700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f7c0c18b0 0x7f4f7c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f81b90700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c0724a0 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f81b90700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c152780 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f81b90700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c0c2660 con 0x7f4f7c150100 2023-10-16T19:41:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f7c06f6e0 0x7f4f7c14f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38724/0 (socket says 172.21.15.29:38724) 2023-10-16T19:41:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7b7fe700 1 -- 172.21.15.29:0/1285067012 learned_addr learned my addr 172.21.15.29:0/1285067012 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7bfff700 1 --2- 172.21.15.29:0/1285067012 >> v2:172.21.15.29:3300/0 conn(0x7f4f7c0c18b0 0x7f4f7c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7affd700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c150100 0x7f4f7c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7bfff700 1 -- 172.21.15.29:0/1285067012 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c150100 msgr2=0x7f4f7c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7bfff700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c150100 0x7f4f7c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7bfff700 1 -- 172.21.15.29:0/1285067012 >> v1:172.21.15.29:6789/0 conn(0x7f4f7c06f6e0 legacy=0x7f4f7c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.577+0000 7f4f7bfff700 1 -- 172.21.15.29:0/1285067012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0a8490 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f7bfff700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c0c18b0 0x7f4f7c152ba0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009d90 tx=0x7f4f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ec961efb37a957 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f7a7fc700 1 -- 172.21.15.29:0/1285067012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400e070 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f7a7fc700 1 -- 172.21.15.29:0/1285067012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400bbd0 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f7a7fc700 1 -- 172.21.15.29:0/1285067012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74012430 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 -- 172.21.15.29:0/1285067012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c0c18b0 msgr2=0x7f4f7c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c0c18b0 0x7f4f7c152ba0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009d90 tx=0x7f4f7400b330 comp rx=0 tx=0).stop 2023-10-16T19:41:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 -- 172.21.15.29:0/1285067012 shutdown_connections 2023-10-16T19:41:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c0c18b0 0x7f4f7c152ba0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 --2- 172.21.15.29:0/1285067012 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c150100 0x7f4f7c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 -- 172.21.15.29:0/1285067012 >> 172.21.15.29:0/1285067012 conn(0x7f4f7c0c7110 msgr2=0x7f4f7c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 -- 172.21.15.29:0/1285067012 shutdown_connections 2023-10-16T19:41:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.578+0000 7f4f81b90700 1 -- 172.21.15.29:0/1285067012 wait complete. 2023-10-16T19:41:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.579+0000 7f4f81b90700 1 Processor -- start 2023-10-16T19:41:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 -- start start 2023-10-16T19:41:00.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c0c18b0 0x7f4f7c1ee050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f7c150100 0x7f4f7c0c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c13f490 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c146160 con 0x7f4f7c150100 2023-10-16T19:41:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f81b90700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c0c4b00 con 0x7f4f7c0c18b0 2023-10-16T19:41:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f7b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.580+0000 7f4f7b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53286/0 (socket says 172.21.15.29:53286) 2023-10-16T19:41:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 -- 172.21.15.29:0/2385503648 learned_addr learned my addr 172.21.15.29:0/2385503648 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:00.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7bfff700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f7c150100 0x7f4f7c0c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7affd700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c0c18b0 0x7f4f7c1ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 -- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c0c18b0 msgr2=0x7f4f7c1ee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c0c18b0 0x7f4f7c1ee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 -- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f7c150100 msgr2=0x7f4f7c0c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f7c150100 0x7f4f7c0c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 -- 172.21.15.29:0/2385503648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009a70 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f7b7fe700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400c520 tx=0x7f4f6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64005d70 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f640070d0 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64007440 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c1edbc0 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.581+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c0c4d50 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.582+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c072690 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.583+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f640075a0 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.583+0000 7f4f73fff700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 0x7f4f5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.583+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4f64088670 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.583+0000 7f4f7affd700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 0x7f4f5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.584+0000 7f4f7affd700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 0x7f4f5c06d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c14d100 tx=0x7f4f6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:00.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.588+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f64053a70 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.869+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f7c04f400 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.869+0000 7f4f73fff700 1 -- 172.21.15.29:0/2385503648 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f4f64057090 con 0x7f4f7c06f6e0 2023-10-16T19:41:00.872 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:00.872 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:00.872 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTkS1lnK4WMRAAff5bUjhlsh9+Y/wl+nnKdw==", 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.873 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.874 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.875 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-16T19:41:00.875 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBUkS1lM5a8AhAAsmoxUyjWymlYozp1zlJ4Ng==", 2023-10-16T19:41:00.875 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.875 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.875 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-16T19:41:00.876 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-16T19:41:00.876 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.876 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.877 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.877 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-16T19:41:00.877 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTkS1lxX2SOBAAHRyJ98rm8g6A/CAUqUI5UQ==", 2023-10-16T19:41:00.878 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.878 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.878 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-16T19:41:00.878 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-16T19:41:00.878 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.879 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.879 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.879 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-16T19:41:00.879 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBUkS1l5x6BChAARHBcmYXiFiPxVfa2Qd3JjA==", 2023-10-16T19:41:00.880 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.880 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.880 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-16T19:41:00.880 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-16T19:41:00.880 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.881 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.881 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.881 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBVkS1lUOc2JhAAOwrLnI7XgQJa0uYPXhMrAQ==", 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.882 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.883 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBYkS1lQNt4JRAA/eEj06pEmUcu2wumPSft7w==", 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.884 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.885 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.885 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-16T19:41:00.885 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBbkS1loCh1JRAAGrY0qOVVlY/YLBzM4f41DQ==", 2023-10-16T19:41:00.885 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.886 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.886 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.886 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.886 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.887 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.887 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-16T19:41:00.887 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBekS1lz+SuJBAAEzT4gxg3ZiGoUHwn2vdDSw==", 2023-10-16T19:41:00.887 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.887 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.888 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.888 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.888 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBikS1lPd1rMxAAXrCCNmvT7lR3/T481JeX2g==", 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.889 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.890 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.890 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.890 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.890 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-16T19:41:00.891 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBlkS1lVSiuMhAAxzLeS0Kt2b7XEL7lDRVZoA==", 2023-10-16T19:41:00.891 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.891 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.891 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.892 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.892 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.892 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-16T19:41:00.893 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBokS1lawoWMhAACKPYp7aIdgbk48wdlcERVQ==", 2023-10-16T19:41:00.893 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.893 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.893 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.893 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.894 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.894 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.894 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.894 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-16T19:41:00.894 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBrkS1lB8akMRAAzezftIRUNUdJ5yMjbOdWtQ==", 2023-10-16T19:41:00.895 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.895 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-16T19:41:00.895 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-16T19:41:00.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.895 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.896 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.896 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-16T19:41:00.896 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBUkS1lF9wWDxAAg1bVqXLjGOgEIq3Eu3eYsQ==", 2023-10-16T19:41:00.896 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.898 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.898 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-16T19:41:00.898 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBUkS1lIeSGEhAAVqMQh+Vp8VLN4DwAJu0w1g==", 2023-10-16T19:41:00.898 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.898 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-16T19:41:00.899 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-16T19:41:00.899 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-16T19:41:00.899 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-16T19:41:00.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.899 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.900 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.900 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-16T19:41:00.900 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTkS1leYPxEhAAy+ViBsRpohzfnBkL6XaBmQ==", 2023-10-16T19:41:00.900 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.900 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.902 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mds", 2023-10-16T19:41:00.902 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1ljwfmJxAAciWEc3IIA7xQaQT+rwqXEA==", 2023-10-16T19:41:00.902 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.902 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T19:41:00.903 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.903 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.903 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T19:41:00.904 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1lihPmJxAAFtuDZhU4bTNbxdvZqOpzow==", 2023-10-16T19:41:00.904 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.904 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T19:41:00.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.904 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-osd", 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1lhBzmJxAAKkcIBVv1/VKxXIsVYZ48bw==", 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.905 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T19:41:00.906 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1lSiXmJxAALxWDjgRPjcO85bqov2CQHg==", 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.908 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T19:41:00.908 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1lJS7mJxAAzEYy7mCIEGU3dfxL7J9qJg==", 2023-10-16T19:41:00.908 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.908 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T19:41:00.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQB2kS1lCjfmJxAAuMrAXMVxfDY167CFQWdK/w==", 2023-10-16T19:41:00.909 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.910 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T19:41:00.910 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.910 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.910 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.910 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTkS1lxMCOLRAAwXhHcrxfe4byJOMayA685g==", 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-16T19:41:00.912 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:00.912 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-16T19:41:00.912 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTkS1lKUMjKRAAXYxYFRQ3K4A3ctGLk9SfiQ==", 2023-10-16T19:41:00.912 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-16T19:41:00.913 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-16T19:41:00.913 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-16T19:41:00.913 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-16T19:41:00.913 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.914 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:00.914 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-16T19:41:00.914 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 msgr2=0x7f4f5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 0x7f4f5c06d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c14d100 tx=0x7f4f6c008040 comp rx=0 tx=0).stop 2023-10-16T19:41:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 msgr2=0x7f4f7c0c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400c520 tx=0x7f4f6400c830 comp rx=0 tx=0).stop 2023-10-16T19:41:00.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 shutdown_connections 2023-10-16T19:41:00.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f5c06af00 0x7f4f5c06d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f7c150100 0x7f4f7c0c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c06f6e0 0x7f4f7c0c5d30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 --2- 172.21.15.29:0/2385503648 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f7c0c18b0 0x7f4f7c1ee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:00.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 >> 172.21.15.29:0/2385503648 conn(0x7f4f7c0c7110 msgr2=0x7f4f7c0aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:00.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 shutdown_connections 2023-10-16T19:41:00.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:00.871+0000 7f4f81b90700 1 -- 172.21.15.29:0/2385503648 wait complete. 2023-10-16T19:41:00.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T19:41:01.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.043+0000 7fcd2684c700 1 Processor -- start 2023-10-16T19:41:01.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.043+0000 7fcd2684c700 1 -- start start 2023-10-16T19:41:01.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd2684c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd20152190 0x7fcd200c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd2684c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd200bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd2684c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2006bac0 con 0x7fcd200bd480 2023-10-16T19:41:01.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd2684c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2006daf0 con 0x7fcd20152190 2023-10-16T19:41:01.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd2684c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201554e0 con 0x7fcd2006d670 2023-10-16T19:41:01.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd20152190 0x7fcd200c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd20152190 0x7fcd200c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53294/0 (socket says 172.21.15.29:53294) 2023-10-16T19:41:01.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 -- 172.21.15.29:0/3092469626 learned_addr learned my addr 172.21.15.29:0/3092469626 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:01.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1f7fe700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd200bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 -- 172.21.15.29:0/3092469626 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 msgr2=0x7fcd200bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:01.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd200bcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 -- 172.21.15.29:0/3092469626 >> v1:172.21.15.53:6789/0 conn(0x7fcd200bd480 legacy=0x7fcd200c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 -- 172.21.15.29:0/3092469626 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200bd910 con 0x7fcd20152190 2023-10-16T19:41:01.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1ffff700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd200c7b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098f0 tx=0x7fcd10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b32ce483c43a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.044+0000 7fcd1effd700 1 -- 172.21.15.29:0/3092469626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000b8a0 con 0x7fcd20152190 2023-10-16T19:41:01.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd1effd700 1 -- 172.21.15.29:0/3092469626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000ba00 con 0x7fcd20152190 2023-10-16T19:41:01.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd1effd700 1 -- 172.21.15.29:0/3092469626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000bd90 con 0x7fcd20152190 2023-10-16T19:41:01.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 -- 172.21.15.29:0/3092469626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 msgr2=0x7fcd200c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd200c7b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098f0 tx=0x7fcd10009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:01.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 -- 172.21.15.29:0/3092469626 shutdown_connections 2023-10-16T19:41:01.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd200c7b60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3092469626 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd200bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 -- 172.21.15.29:0/3092469626 >> 172.21.15.29:0/3092469626 conn(0x7fcd200a9cd0 msgr2=0x7fcd200aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 -- 172.21.15.29:0/3092469626 shutdown_connections 2023-10-16T19:41:01.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.045+0000 7fcd2684c700 1 -- 172.21.15.29:0/3092469626 wait complete. 2023-10-16T19:41:01.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.046+0000 7fcd2684c700 1 Processor -- start 2023-10-16T19:41:01.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.046+0000 7fcd2684c700 1 -- start start 2023-10-16T19:41:01.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd20155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd200bd480 0x7fcd2014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200705b0 con 0x7fcd20152190 2023-10-16T19:41:01.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2006e870 con 0x7fcd200bd480 2023-10-16T19:41:01.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd2684c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20158770 con 0x7fcd2006d670 2023-10-16T19:41:01.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd24de9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd24de9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53304/0 (socket says 172.21.15.29:53304) 2023-10-16T19:41:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd24de9700 1 -- 172.21.15.29:0/3909333701 learned_addr learned my addr 172.21.15.29:0/3909333701 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd1ffff700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd20155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.047+0000 7fcd1f7fe700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd200bd480 0x7fcd2014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 -- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 msgr2=0x7fcd20155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd20155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 -- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd200bd480 msgr2=0x7fcd2014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd200bd480 0x7fcd2014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 -- 172.21.15.29:0/3909333701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009550 con 0x7fcd20152190 2023-10-16T19:41:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd24de9700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800cc80 tx=0x7fcd1800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18003c00 con 0x7fcd20152190 2023-10-16T19:41:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18003d60 con 0x7fcd20152190 2023-10-16T19:41:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd20156880 con 0x7fcd20152190 2023-10-16T19:41:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800aaa0 con 0x7fcd20152190 2023-10-16T19:41:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.048+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd201ea650 con 0x7fcd20152190 2023-10-16T19:41:01.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.049+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2006e9b0 con 0x7fcd20152190 2023-10-16T19:41:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.049+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd1800ac00 con 0x7fcd20152190 2023-10-16T19:41:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.050+0000 7fcd1cff9700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 0x7fcd0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.050+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcd18089310 con 0x7fcd20152190 2023-10-16T19:41:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.050+0000 7fcd1ffff700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 0x7fcd0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.050+0000 7fcd1ffff700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 0x7fcd0c06d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009c40 tx=0x7fcd10008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.054+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd18054660 con 0x7fcd20152190 2023-10-16T19:41:01.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.338+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fcd201ea990 con 0x7fcd20152190 2023-10-16T19:41:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.340+0000 7fcd1cff9700 1 -- 172.21.15.29:0/3909333701 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd18057c80 con 0x7fcd20152190 2023-10-16T19:41:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 msgr2=0x7fcd0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 0x7fcd0c06d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009c40 tx=0x7fcd10008030 comp rx=0 tx=0).stop 2023-10-16T19:41:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 msgr2=0x7fcd2014e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800cc80 tx=0x7fcd1800cf90 comp rx=0 tx=0).stop 2023-10-16T19:41:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 shutdown_connections 2023-10-16T19:41:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fcd0c06af00 0x7fcd0c06d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd20152190 0x7fcd2014e420 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcd2006d670 0x7fcd20155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 --2- 172.21.15.29:0/3909333701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd200bd480 0x7fcd2014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 >> 172.21.15.29:0/3909333701 conn(0x7fcd200a9cd0 msgr2=0x7fcd200c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 shutdown_connections 2023-10-16T19:41:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.342+0000 7fcd2684c700 1 -- 172.21.15.29:0/3909333701 wait complete. 2023-10-16T19:41:01.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T19:41:01.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.481+0000 7effea6b7700 1 Processor -- start 2023-10-16T19:41:01.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.481+0000 7effea6b7700 1 -- start start 2023-10-16T19:41:01.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effea6b7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effea6b7700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7effe4150100 0x7effe4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effea6b7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe40724a0 con 0x7effe40c18b0 2023-10-16T19:41:01.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effea6b7700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe4152780 con 0x7effe4150100 2023-10-16T19:41:01.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effea6b7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe40c2660 con 0x7effe406f6e0 2023-10-16T19:41:01.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7effe40c18b0 0x7effe414f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38752/0 (socket says 172.21.15.29:38752) 2023-10-16T19:41:01.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe37fe700 1 -- 172.21.15.29:0/580005759 learned_addr learned my addr 172.21.15.29:0/580005759 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:01.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe3fff700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe8c54700 1 --2- 172.21.15.29:0/580005759 >> v2:172.21.15.53:3300/0 conn(0x7effe4150100 0x7effe4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe2ffd700 1 -- 172.21.15.29:0/580005759 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920018952 0 0) 0x7effe40724a0 con 0x7effe40c18b0 2023-10-16T19:41:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.482+0000 7effe2ffd700 1 -- 172.21.15.29:0/580005759 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd00035b0 con 0x7effe40c18b0 2023-10-16T19:41:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe8c54700 1 -- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 msgr2=0x7effe4156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe8c54700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe8c54700 1 -- 172.21.15.29:0/580005759 >> v1:172.21.15.29:6789/0 conn(0x7effe40c18b0 legacy=0x7effe414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe8c54700 1 -- 172.21.15.29:0/580005759 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe40a8490 con 0x7effe4150100 2023-10-16T19:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe3fff700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe8c54700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe4152ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effdc009d90 tx=0x7effdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f66bc1f65f743f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe2ffd700 1 -- 172.21.15.29:0/580005759 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00e070 con 0x7effe4150100 2023-10-16T19:41:01.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe2ffd700 1 -- 172.21.15.29:0/580005759 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc00bb20 con 0x7effe4150100 2023-10-16T19:41:01.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effe2ffd700 1 -- 172.21.15.29:0/580005759 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc012430 con 0x7effe4150100 2023-10-16T19:41:01.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effea6b7700 1 -- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 msgr2=0x7effe4152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.483+0000 7effea6b7700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe4152ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effdc009d90 tx=0x7effdc00b330 comp rx=0 tx=0).stop 2023-10-16T19:41:01.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 -- 172.21.15.29:0/580005759 shutdown_connections 2023-10-16T19:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe4152ba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 --2- 172.21.15.29:0/580005759 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 -- 172.21.15.29:0/580005759 >> 172.21.15.29:0/580005759 conn(0x7effe40c7110 msgr2=0x7effe40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 -- 172.21.15.29:0/580005759 shutdown_connections 2023-10-16T19:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.484+0000 7effea6b7700 1 -- 172.21.15.29:0/580005759 wait complete. 2023-10-16T19:41:01.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.485+0000 7effea6b7700 1 Processor -- start 2023-10-16T19:41:01.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.485+0000 7effea6b7700 1 -- start start 2023-10-16T19:41:01.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe41eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4153a90 con 0x7effe40c18b0 2023-10-16T19:41:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4154260 con 0x7effe4150100 2023-10-16T19:41:01.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effea6b7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe41eacf0 con 0x7effe406f6e0 2023-10-16T19:41:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effe37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effe37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53314/0 (socket says 172.21.15.29:53314) 2023-10-16T19:41:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.486+0000 7effe37fe700 1 -- 172.21.15.29:0/246815758 learned_addr learned my addr 172.21.15.29:0/246815758 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe3fff700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe8c54700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe41eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 -- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 msgr2=0x7effe4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 -- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 msgr2=0x7effe41eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe41eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 -- 172.21.15.29:0/246815758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc0094a0 con 0x7effe40c18b0 2023-10-16T19:41:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe8c54700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe41eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe3fff700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe37fe700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7effd400c4d0 tx=0x7effd400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4005d70 con 0x7effe40c18b0 2023-10-16T19:41:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40070d0 con 0x7effe40c18b0 2023-10-16T19:41:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effdc009a70 con 0x7effe40c18b0 2023-10-16T19:41:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4007440 con 0x7effe40c18b0 2023-10-16T19:41:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.487+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe4153f80 con 0x7effe40c18b0 2023-10-16T19:41:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.488+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe404f400 con 0x7effe40c18b0 2023-10-16T19:41:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.488+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7effd40075a0 con 0x7effe40c18b0 2023-10-16T19:41:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.489+0000 7effe0ff9700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 0x7effc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.489+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7effd4088760 con 0x7effe40c18b0 2023-10-16T19:41:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.489+0000 7effe3fff700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 0x7effc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.490+0000 7effe3fff700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 0x7effc406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effcc009cf0 tx=0x7effcc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.493+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7effd4053b60 con 0x7effe40c18b0 2023-10-16T19:41:01.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.779+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7effe4156ac0 con 0x7effe40c18b0 2023-10-16T19:41:01.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.781+0000 7effe0ff9700 1 -- 172.21.15.29:0/246815758 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7effd40170a0 con 0x7effe40c18b0 2023-10-16T19:41:01.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 msgr2=0x7effc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 0x7effc406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effcc009cf0 tx=0x7effcc008040 comp rx=0 tx=0).stop 2023-10-16T19:41:01.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 msgr2=0x7effe41e7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7effd400c4d0 tx=0x7effd400c890 comp rx=0 tx=0).stop 2023-10-16T19:41:01.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 shutdown_connections 2023-10-16T19:41:01.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7effc406af00 0x7effc406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe4150100 0x7effe41eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7effe406f6e0 0x7effe4154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 --2- 172.21.15.29:0/246815758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effe40c18b0 0x7effe41e7650 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 >> 172.21.15.29:0/246815758 conn(0x7effe40c7110 msgr2=0x7effe4149400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 shutdown_connections 2023-10-16T19:41:01.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.783+0000 7effea6b7700 1 -- 172.21.15.29:0/246815758 wait complete. 2023-10-16T19:41:01.797 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T19:41:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.921+0000 7fea61e64700 1 Processor -- start 2023-10-16T19:41:01.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.921+0000 7fea61e64700 1 -- start start 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea61e64700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea5c0c2d10 0x7fea5c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea61e64700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c154e10 con 0x7fea5c0c15f0 2023-10-16T19:41:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea61e64700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c155340 con 0x7fea5c14e460 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea61e64700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c150e10 con 0x7fea5c0c2d10 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea5affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea5c0c2d10 0x7fea5c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea5bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fea5c0c15f0 0x7fea5c15b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38768/0 (socket says 172.21.15.29:38768) 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea5bfff700 1 -- 172.21.15.29:0/1673272922 learned_addr learned my addr 172.21.15.29:0/1673272922 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.922+0000 7fea5affd700 1 --2- 172.21.15.29:0/1673272922 >> v2:172.21.15.29:3300/0 conn(0x7fea5c0c2d10 0x7fea5c070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53322/0 (socket says 172.21.15.29:53322) 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5affd700 1 -- 172.21.15.29:0/1673272922 >> v1:172.21.15.53:6789/0 conn(0x7fea5c14e460 legacy=0x7fea5c06d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5affd700 1 -- 172.21.15.29:0/1673272922 >> v1:172.21.15.29:6789/0 conn(0x7fea5c0c15f0 legacy=0x7fea5c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5affd700 1 -- 172.21.15.29:0/1673272922 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c14e840 con 0x7fea5c0c2d10 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5affd700 1 --2- 172.21.15.29:0/1673272922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c0c2d10 0x7fea5c070e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a9e0 tx=0x7fea4400acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4edd47a80999a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5a7fc700 1 -- 172.21.15.29:0/1673272922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400cb70 con 0x7fea5c0c2d10 2023-10-16T19:41:01.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5a7fc700 1 -- 172.21.15.29:0/1673272922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400ccd0 con 0x7fea5c0c2d10 2023-10-16T19:41:01.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.923+0000 7fea5a7fc700 1 -- 172.21.15.29:0/1673272922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44018620 con 0x7fea5c0c2d10 2023-10-16T19:41:01.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 -- 172.21.15.29:0/1673272922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c0c2d10 msgr2=0x7fea5c070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 --2- 172.21.15.29:0/1673272922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c0c2d10 0x7fea5c070e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a9e0 tx=0x7fea4400acf0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 -- 172.21.15.29:0/1673272922 shutdown_connections 2023-10-16T19:41:01.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 --2- 172.21.15.29:0/1673272922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c0c2d10 0x7fea5c070e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 -- 172.21.15.29:0/1673272922 >> 172.21.15.29:0/1673272922 conn(0x7fea5c0c66d0 msgr2=0x7fea5c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:01.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 -- 172.21.15.29:0/1673272922 shutdown_connections 2023-10-16T19:41:01.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.924+0000 7fea61e64700 1 -- 172.21.15.29:0/1673272922 wait complete. 2023-10-16T19:41:01.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.925+0000 7fea61e64700 1 Processor -- start 2023-10-16T19:41:01.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.925+0000 7fea61e64700 1 -- start start 2023-10-16T19:41:01.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea5c0c15f0 0x7fea5c141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 0x7fea5c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0aadb0 con 0x7fea5c14e460 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0a9e70 con 0x7fea5c0c2d10 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1e85c0 con 0x7fea5c0c15f0 2023-10-16T19:41:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53330/0 (socket says 172.21.15.29:53330) 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 -- 172.21.15.29:0/1797065990 learned_addr learned my addr 172.21.15.29:0/1797065990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5affd700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 0x7fea5c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5b7fe700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea5c0c15f0 0x7fea5c141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 -- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea5c0c15f0 msgr2=0x7fea5c141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea5c0c15f0 0x7fea5c141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 -- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 msgr2=0x7fea5c0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 0x7fea5c0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 -- 172.21.15.29:0/1797065990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4400a640 con 0x7fea5c14e460 2023-10-16T19:41:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5affd700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 0x7fea5c0aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea5bfff700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea5400caa0 tx=0x7fea5400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400aa20 con 0x7fea5c14e460 2023-10-16T19:41:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400ab80 con 0x7fea5c14e460 2023-10-16T19:41:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0ab390 con 0x7fea5c14e460 2023-10-16T19:41:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54012400 con 0x7fea5c14e460 2023-10-16T19:41:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.926+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c0ab950 con 0x7fea5c14e460 2023-10-16T19:41:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.927+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c0aa030 con 0x7fea5c14e460 2023-10-16T19:41:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.928+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea5401b3b0 con 0x7fea5c14e460 2023-10-16T19:41:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.928+0000 7fea53fff700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 0x7fea3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.929+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fea54088eb0 con 0x7fea5c14e460 2023-10-16T19:41:01.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.929+0000 7fea5b7fe700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 0x7fea3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:01.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.929+0000 7fea5b7fe700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 0x7fea3c06d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea4c000f60 tx=0x7fea4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:01.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:01.933+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea54054210 con 0x7fea5c14e460 2023-10-16T19:41:02.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.213+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fea5c04f400 con 0x7fea5c14e460 2023-10-16T19:41:02.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.215+0000 7fea53fff700 1 -- 172.21.15.29:0/1797065990 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fea54057830 con 0x7fea5c14e460 2023-10-16T19:41:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 msgr2=0x7fea3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 0x7fea3c06d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea4c000f60 tx=0x7fea4c009040 comp rx=0 tx=0).stop 2023-10-16T19:41:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 msgr2=0x7fea5c0aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea5400caa0 tx=0x7fea5400ce60 comp rx=0 tx=0).stop 2023-10-16T19:41:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 shutdown_connections 2023-10-16T19:41:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fea3c06af00 0x7fea3c06d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea5c14e460 0x7fea5c0aa870 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea5c0c15f0 0x7fea5c141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 --2- 172.21.15.29:0/1797065990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c0c2d10 0x7fea5c0aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 >> 172.21.15.29:0/1797065990 conn(0x7fea5c0c66d0 msgr2=0x7fea5c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 shutdown_connections 2023-10-16T19:41:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.218+0000 7fea61e64700 1 -- 172.21.15.29:0/1797065990 wait complete. 2023-10-16T19:41:02.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T19:41:02.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.356+0000 7f4be47c5700 1 Processor -- start 2023-10-16T19:41:02.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.356+0000 7f4be47c5700 1 -- start start 2023-10-16T19:41:02.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be47c5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc06aaf0 0x7f4bdc06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be47c5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bdc151cb0 0x7f4bdc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be47c5700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc06dcb0 con 0x7f4bdc0c2760 2023-10-16T19:41:02.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be47c5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc152610 con 0x7f4bdc151cb0 2023-10-16T19:41:02.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be47c5700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0c1b60 con 0x7f4bdc06aaf0 2023-10-16T19:41:02.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bdc151cb0 0x7f4bdc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bdc151cb0 0x7f4bdc1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53338/0 (socket says 172.21.15.29:53338) 2023-10-16T19:41:02.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 -- 172.21.15.29:0/277350127 learned_addr learned my addr 172.21.15.29:0/277350127 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:02.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2561700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc06aaf0 0x7f4bdc06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 -- 172.21.15.29:0/277350127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc06aaf0 msgr2=0x7f4bdc06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:02.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc06aaf0 0x7f4bdc06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 -- 172.21.15.29:0/277350127 >> v1:172.21.15.53:6789/0 conn(0x7f4bdc0c2760 legacy=0x7f4bdc158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.357+0000 7f4be2d62700 1 -- 172.21.15.29:0/277350127 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0c1e40 con 0x7f4bdc151cb0 2023-10-16T19:41:02.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be2d62700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc1520d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009e50 tx=0x7f4bd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69cb77c7b3487fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be155f700 1 -- 172.21.15.29:0/277350127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400e070 con 0x7f4bdc151cb0 2023-10-16T19:41:02.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be155f700 1 -- 172.21.15.29:0/277350127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd400b910 con 0x7f4bdc151cb0 2023-10-16T19:41:02.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be155f700 1 -- 172.21.15.29:0/277350127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400bcc0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 -- 172.21.15.29:0/277350127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 msgr2=0x7f4bdc1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc1520d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009e50 tx=0x7f4bd400b330 comp rx=0 tx=0).stop 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 -- 172.21.15.29:0/277350127 shutdown_connections 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc1520d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 --2- 172.21.15.29:0/277350127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc06aaf0 0x7f4bdc06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 -- 172.21.15.29:0/277350127 >> 172.21.15.29:0/277350127 conn(0x7f4bdc0c7100 msgr2=0x7f4bdc0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 -- 172.21.15.29:0/277350127 shutdown_connections 2023-10-16T19:41:02.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.358+0000 7f4be47c5700 1 -- 172.21.15.29:0/277350127 wait complete. 2023-10-16T19:41:02.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 Processor -- start 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 -- start start 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 0x7f4bdc153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc0c2760 0x7f4bdc14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1437e0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc142910 con 0x7f4bdc06aaf0 2023-10-16T19:41:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be47c5700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc143a30 con 0x7f4bdc0c2760 2023-10-16T19:41:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.360+0000 7f4be2d62700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2561700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 0x7f4bdc153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53344/0 (socket says 172.21.15.29:53344) 2023-10-16T19:41:02.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2561700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 0x7f4bdc153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:43626/0 (socket says 172.21.15.29:43626) 2023-10-16T19:41:02.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 -- 172.21.15.29:0/68140088 learned_addr learned my addr 172.21.15.29:0/68140088 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:02.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be1d60700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc0c2760 0x7f4bdc14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 -- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc0c2760 msgr2=0x7f4bdc14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc0c2760 0x7f4bdc14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 -- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 msgr2=0x7f4bdc153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 0x7f4bdc153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 -- 172.21.15.29:0/68140088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4009b30 con 0x7f4bdc151cb0 2023-10-16T19:41:02.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be2d62700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b370 tx=0x7f4bd4004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4004840 con 0x7f4bdc151cb0 2023-10-16T19:41:02.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd40092e0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc143d10 con 0x7f4bdc151cb0 2023-10-16T19:41:02.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40049c0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.361+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc0c5bc0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.362+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc04f400 con 0x7f4bdc151cb0 2023-10-16T19:41:02.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.363+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4bd401c680 con 0x7f4bdc151cb0 2023-10-16T19:41:02.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.363+0000 7f4bd2ffd700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 0x7f4bc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.363+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4bd408af30 con 0x7f4bdc151cb0 2023-10-16T19:41:02.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.363+0000 7f4be2561700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 0x7f4bc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.364+0000 7f4be2561700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 0x7f4bc006d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc147630 tx=0x7f4bcc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.367+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bd4056280 con 0x7f4bdc151cb0 2023-10-16T19:41:02.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.651+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4bdc0c4450 con 0x7f4bdc151cb0 2023-10-16T19:41:02.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.653+0000 7f4bd2ffd700 1 -- 172.21.15.29:0/68140088 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4bd40598a0 con 0x7f4bdc151cb0 2023-10-16T19:41:02.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 msgr2=0x7f4bc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 0x7f4bc006d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc147630 tx=0x7f4bcc009210 comp rx=0 tx=0).stop 2023-10-16T19:41:02.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 msgr2=0x7f4bdc14c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b370 tx=0x7f4bd4004b20 comp rx=0 tx=0).stop 2023-10-16T19:41:02.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 shutdown_connections 2023-10-16T19:41:02.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4bc006af00 0x7f4bc006d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bdc151cb0 0x7f4bdc14c390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bdc06aaf0 0x7f4bdc153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 --2- 172.21.15.29:0/68140088 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4bdc0c2760 0x7f4bdc14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 >> 172.21.15.29:0/68140088 conn(0x7f4bdc0c7100 msgr2=0x7f4bdc0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 shutdown_connections 2023-10-16T19:41:02.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.655+0000 7f4be47c5700 1 -- 172.21.15.29:0/68140088 wait complete. 2023-10-16T19:41:02.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T19:41:02.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 Processor -- start 2023-10-16T19:41:02.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 -- start start 2023-10-16T19:41:02.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9014ec50 0x7feb901555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb900c3350 0x7feb90071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb90155af0 con 0x7feb90071840 2023-10-16T19:41:02.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb90152300 con 0x7feb9014ec50 2023-10-16T19:41:02.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.795+0000 7feb97a27700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900c2e40 con 0x7feb900c3350 2023-10-16T19:41:02.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9014ec50 0x7feb901555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9014ec50 0x7feb901555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53348/0 (socket says 172.21.15.29:53348) 2023-10-16T19:41:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 -- 172.21.15.29:0/96054518 learned_addr learned my addr 172.21.15.29:0/96054518 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb94fc2700 1 --2- 172.21.15.29:0/96054518 >> v2:172.21.15.53:3300/0 conn(0x7feb900c3350 0x7feb90071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 -- 172.21.15.29:0/96054518 >> v2:172.21.15.53:3300/0 conn(0x7feb900c3350 msgr2=0x7feb90071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 --2- 172.21.15.29:0/96054518 >> v2:172.21.15.53:3300/0 conn(0x7feb900c3350 0x7feb90071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 -- 172.21.15.29:0/96054518 >> v1:172.21.15.53:6789/0 conn(0x7feb90071840 legacy=0x7feb9006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:02.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 -- 172.21.15.29:0/96054518 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9014f030 con 0x7feb9014ec50 2023-10-16T19:41:02.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb957c3700 1 --2- 172.21.15.29:0/96054518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9014ec50 0x7feb901555b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feb900c4ab0 tx=0x7feb8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a1b9a504c270d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb87fff700 1 -- 172.21.15.29:0/96054518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c004230 con 0x7feb9014ec50 2023-10-16T19:41:02.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb87fff700 1 -- 172.21.15.29:0/96054518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c004390 con 0x7feb9014ec50 2023-10-16T19:41:02.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.796+0000 7feb87fff700 1 -- 172.21.15.29:0/96054518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0036a0 con 0x7feb9014ec50 2023-10-16T19:41:02.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 -- 172.21.15.29:0/96054518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9014ec50 msgr2=0x7feb901555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 --2- 172.21.15.29:0/96054518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9014ec50 0x7feb901555b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feb900c4ab0 tx=0x7feb8c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 -- 172.21.15.29:0/96054518 shutdown_connections 2023-10-16T19:41:02.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 --2- 172.21.15.29:0/96054518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9014ec50 0x7feb901555b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 --2- 172.21.15.29:0/96054518 >> v2:172.21.15.53:3300/0 conn(0x7feb900c3350 0x7feb90071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 -- 172.21.15.29:0/96054518 >> 172.21.15.29:0/96054518 conn(0x7feb900c7110 msgr2=0x7feb900c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:02.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 -- 172.21.15.29:0/96054518 shutdown_connections 2023-10-16T19:41:02.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.797+0000 7feb97a27700 1 -- 172.21.15.29:0/96054518 wait complete. 2023-10-16T19:41:02.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.798+0000 7feb97a27700 1 Processor -- start 2023-10-16T19:41:02.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.798+0000 7feb97a27700 1 -- start start 2023-10-16T19:41:02.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb900c3350 0x7feb90149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feb9014ec50 0x7feb90147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900ab310 con 0x7feb90071840 2023-10-16T19:41:02.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900ac040 con 0x7feb900c3350 2023-10-16T19:41:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb97a27700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb90153a70 con 0x7feb9014ec50 2023-10-16T19:41:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53354/0 (socket says 172.21.15.29:53354) 2023-10-16T19:41:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 -- 172.21.15.29:0/2574423662 learned_addr learned my addr 172.21.15.29:0/2574423662 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:02.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb95fc4700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feb9014ec50 0x7feb90147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb94fc2700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb900c3350 0x7feb90149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 -- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feb9014ec50 msgr2=0x7feb90147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feb9014ec50 0x7feb90147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 -- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb900c3350 msgr2=0x7feb90149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:02.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb900c3350 0x7feb90149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.799+0000 7feb957c3700 1 -- 172.21.15.29:0/2574423662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009550 con 0x7feb90071840 2023-10-16T19:41:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb957c3700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009130 tx=0x7feb8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c01f070 con 0x7feb90071840 2023-10-16T19:41:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c003d10 con 0x7feb90071840 2023-10-16T19:41:02.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011850 con 0x7feb90071840 2023-10-16T19:41:02.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb90152e60 con 0x7feb90071840 2023-10-16T19:41:02.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.800+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb90153420 con 0x7feb90071840 2023-10-16T19:41:02.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.801+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9004f400 con 0x7feb90071840 2023-10-16T19:41:02.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.801+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb8c0119b0 con 0x7feb90071840 2023-10-16T19:41:02.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.802+0000 7feb85ffb700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 0x7feb7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:02.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.802+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7feb8c08beb0 con 0x7feb90071840 2023-10-16T19:41:02.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.802+0000 7feb94fc2700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 0x7feb7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:02.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.802+0000 7feb94fc2700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 0x7feb7406d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb9006fa00 tx=0x7feb80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:02.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:02.806+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb8c057200 con 0x7feb90071840 2023-10-16T19:41:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.092+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7feb90155af0 con 0x7feb90071840 2023-10-16T19:41:03.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.094+0000 7feb85ffb700 1 -- 172.21.15.29:0/2574423662 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb90155af0 con 0x7feb90071840 2023-10-16T19:41:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 msgr2=0x7feb7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 0x7feb7406d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb9006fa00 tx=0x7feb80008040 comp rx=0 tx=0).stop 2023-10-16T19:41:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 msgr2=0x7feb901e67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009130 tx=0x7feb8c004750 comp rx=0 tx=0).stop 2023-10-16T19:41:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 shutdown_connections 2023-10-16T19:41:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7feb7406aed0 0x7feb7406d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feb9014ec50 0x7feb90147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb90071840 0x7feb901e67e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 --2- 172.21.15.29:0/2574423662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb900c3350 0x7feb90149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 >> 172.21.15.29:0/2574423662 conn(0x7feb900c7110 msgr2=0x7feb900c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 shutdown_connections 2023-10-16T19:41:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.096+0000 7feb97a27700 1 -- 172.21.15.29:0/2574423662 wait complete. 2023-10-16T19:41:03.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T19:41:03.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.234+0000 7fe5cac14700 1 Processor -- start 2023-10-16T19:41:03.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 -- start start 2023-10-16T19:41:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe5c413d660 0x7fe5c406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5c4158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c406e780 con 0x7fe5c4154a50 2023-10-16T19:41:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c406d320 con 0x7fe5c413d660 2023-10-16T19:41:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.235+0000 7fe5cac14700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4154f10 con 0x7fe5c406adc0 2023-10-16T19:41:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe5c4154a50 0x7fe5c41583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38806/0 (socket says 172.21.15.29:38806) 2023-10-16T19:41:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c3fff700 1 -- 172.21.15.29:0/1803058035 learned_addr learned my addr 172.21.15.29:0/1803058035 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c91b1700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5c4158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c89b0700 1 --2- 172.21.15.29:0/1803058035 >> v2:172.21.15.53:3300/0 conn(0x7fe5c413d660 0x7fe5c406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541855034 0 0) 0x7fe5c406e780 con 0x7fe5c4154a50 2023-10-16T19:41:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b40035b0 con 0x7fe5c4154a50 2023-10-16T19:41:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537448227 0 0) 0x7fe5b40035b0 con 0x7fe5c4154a50 2023-10-16T19:41:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 msgr2=0x7fe5c4158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:03.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5c4158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 >> v2:172.21.15.53:3300/0 conn(0x7fe5c413d660 msgr2=0x7fe5c406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 --2- 172.21.15.29:0/1803058035 >> v2:172.21.15.53:3300/0 conn(0x7fe5c413d660 0x7fe5c406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c41551f0 con 0x7fe5c4154a50 2023-10-16T19:41:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fe5b0001670 con 0x7fe5c4154a50 2023-10-16T19:41:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 >> v1:172.21.15.29:6789/0 conn(0x7fe5c4154a50 legacy=0x7fe5c41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5b4003a00 0x7fe5b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c406d320 con 0x7fe5b4004850 2023-10-16T19:41:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4154f10 con 0x7fe5b4003a00 2023-10-16T19:41:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b400ba10 con 0x7fe5c406adc0 2023-10-16T19:41:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c89b0700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5b4003a00 0x7fe5b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.236+0000 7fe5c91b1700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 -- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 msgr2=0x7fe5b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 -- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5b4003a00 msgr2=0x7fe5b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5b4003a00 0x7fe5b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 -- 172.21.15.29:0/1803058035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40035b0 con 0x7fe5b4004850 2023-10-16T19:41:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c91b1700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c406adc0 0x7fe5b4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5b4004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000c370 tx=0x7fe5b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86df8c99e19386c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0007c60 con 0x7fe5b4004850 2023-10-16T19:41:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b0005960 con 0x7fe5b4004850 2023-10-16T19:41:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c37fe700 1 -- 172.21.15.29:0/1803058035 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0005d10 con 0x7fe5b4004850 2023-10-16T19:41:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5cac14700 1 -- 172.21.15.29:0/1803058035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 msgr2=0x7fe5b4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5cac14700 1 --2- 172.21.15.29:0/1803058035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5b4004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000c370 tx=0x7fe5b4005880 comp rx=0 tx=0).stop 2023-10-16T19:41:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5c91b1700 1 -- 172.21.15.29:0/1803058035 reap_dead start 2023-10-16T19:41:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5cac14700 1 -- 172.21.15.29:0/1803058035 shutdown_connections 2023-10-16T19:41:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.237+0000 7fe5cac14700 1 -- 172.21.15.29:0/1803058035 >> 172.21.15.29:0/1803058035 conn(0x7fe5c40c7110 msgr2=0x7fe5c40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.238+0000 7fe5cac14700 1 -- 172.21.15.29:0/1803058035 shutdown_connections 2023-10-16T19:41:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.238+0000 7fe5cac14700 1 -- 172.21.15.29:0/1803058035 wait complete. 2023-10-16T19:41:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.239+0000 7fe5cac14700 1 Processor -- start 2023-10-16T19:41:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.239+0000 7fe5cac14700 1 -- start start 2023-10-16T19:41:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.239+0000 7fe5cac14700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.239+0000 7fe5cac14700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 0x7fe5c4131280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.239+0000 7fe5cac14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 0x7fe5c41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5cac14700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4130990 con 0x7fe5b4004850 2023-10-16T19:41:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5cac14700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4157ad0 con 0x7fe5c41317c0 2023-10-16T19:41:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5cac14700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4157860 con 0x7fe5c4130e20 2023-10-16T19:41:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53374/0 (socket says 172.21.15.29:53374) 2023-10-16T19:41:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 -- 172.21.15.29:0/2422118134 learned_addr learned my addr 172.21.15.29:0/2422118134 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c91b1700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 0x7fe5c41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 0x7fe5c4131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 -- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 msgr2=0x7fe5c4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 0x7fe5c4131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 -- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 msgr2=0x7fe5c41518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 0x7fe5c41518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 -- 172.21.15.29:0/2422118134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40c1bb0 con 0x7fe5b4004850 2023-10-16T19:41:03.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c91b1700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 0x7fe5c41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:03.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 0x7fe5c4131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:03.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c89b0700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8011aa0 tx=0x7fe5b8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800f980 con 0x7fe5b4004850 2023-10-16T19:41:03.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800fb00 con 0x7fe5b4004850 2023-10-16T19:41:03.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800feb0 con 0x7fe5b4004850 2023-10-16T19:41:03.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4156fe0 con 0x7fe5b4004850 2023-10-16T19:41:03.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.240+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c413cd20 con 0x7fe5b4004850 2023-10-16T19:41:03.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.241+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c40c3740 con 0x7fe5b4004850 2023-10-16T19:41:03.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.242+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5b8014440 con 0x7fe5b4004850 2023-10-16T19:41:03.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.242+0000 7fe5c17fa700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 0x7fe5a806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.242+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe5b8089b50 con 0x7fe5b4004850 2023-10-16T19:41:03.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.242+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 0x7fe5a806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.243+0000 7fe5c3fff700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 0x7fe5a806d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0015040 tx=0x7fe5b000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.247+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5b8054f80 con 0x7fe5b4004850 2023-10-16T19:41:03.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.528+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe5c404f400 con 0x7fe5b4004850 2023-10-16T19:41:03.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.530+0000 7fe5c17fa700 1 -- 172.21.15.29:0/2422118134 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5b80585a0 con 0x7fe5b4004850 2023-10-16T19:41:03.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 msgr2=0x7fe5a806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 0x7fe5a806d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0015040 tx=0x7fe5b000a000 comp rx=0 tx=0).stop 2023-10-16T19:41:03.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 msgr2=0x7fe5c4153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8011aa0 tx=0x7fe5b8011e60 comp rx=0 tx=0).stop 2023-10-16T19:41:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 shutdown_connections 2023-10-16T19:41:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fe5a806af30 0x7fe5a806d3f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c41317c0 0x7fe5c41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b4004850 0x7fe5c4153620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.532+0000 7fe5cac14700 1 --2- 172.21.15.29:0/2422118134 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe5c4130e20 0x7fe5c4131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.533+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 >> 172.21.15.29:0/2422118134 conn(0x7fe5c40c7110 msgr2=0x7fe5c40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.533+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 shutdown_connections 2023-10-16T19:41:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.533+0000 7fe5cac14700 1 -- 172.21.15.29:0/2422118134 wait complete. 2023-10-16T19:41:03.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:03.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.670+0000 7f09980bd700 1 Processor -- start 2023-10-16T19:41:03.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.670+0000 7f09980bd700 1 -- start start 2023-10-16T19:41:03.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f09980bd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f09900c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f09980bd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09900c2a40 0x7f09900a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f09980bd700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0990158e30 con 0x7f09900c7c10 2023-10-16T19:41:03.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f09980bd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0990158b50 con 0x7f09900c2a40 2023-10-16T19:41:03.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f09980bd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099006ba30 con 0x7f09900be280 2023-10-16T19:41:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09900c2a40 0x7f09900a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09900c2a40 0x7f09900a6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53384/0 (socket says 172.21.15.29:53384) 2023-10-16T19:41:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 -- 172.21.15.29:0/1295461031 learned_addr learned my addr 172.21.15.29:0/1295461031 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995e59700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f09900c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 -- 172.21.15.29:0/1295461031 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 msgr2=0x7f09900c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:03.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f09900c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 -- 172.21.15.29:0/1295461031 >> v1:172.21.15.53:6789/0 conn(0x7f09900c7c10 legacy=0x7f09900a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 -- 172.21.15.29:0/1295461031 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099006bd10 con 0x7f09900c2a40 2023-10-16T19:41:03.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.671+0000 7f0995658700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c2a40 0x7f09900a6ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f098c0098f0 tx=0x7f098c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46399a5f46a68b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f0994e57700 1 -- 172.21.15.29:0/1295461031 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c011830 con 0x7f09900c2a40 2023-10-16T19:41:03.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f0994e57700 1 -- 172.21.15.29:0/1295461031 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c011990 con 0x7f09900c2a40 2023-10-16T19:41:03.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f0994e57700 1 -- 172.21.15.29:0/1295461031 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c011d20 con 0x7f09900c2a40 2023-10-16T19:41:03.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 -- 172.21.15.29:0/1295461031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c2a40 msgr2=0x7f09900a6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c2a40 0x7f09900a6ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f098c0098f0 tx=0x7f098c009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 -- 172.21.15.29:0/1295461031 shutdown_connections 2023-10-16T19:41:03.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f09900c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 --2- 172.21.15.29:0/1295461031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c2a40 0x7f09900a6ed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 -- 172.21.15.29:0/1295461031 >> 172.21.15.29:0/1295461031 conn(0x7f09900a9cd0 msgr2=0x7f09900aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:03.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 -- 172.21.15.29:0/1295461031 shutdown_connections 2023-10-16T19:41:03.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.672+0000 7f09980bd700 1 -- 172.21.15.29:0/1295461031 wait complete. 2023-10-16T19:41:03.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.673+0000 7f09980bd700 1 Processor -- start 2023-10-16T19:41:03.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 -- start start 2023-10-16T19:41:03.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f0990157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09900c2a40 0x7f09900ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900ac7f0 con 0x7f09900c7c10 2023-10-16T19:41:03.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09901e9ad0 con 0x7f09900c2a40 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f09980bd700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099006e6a0 con 0x7f09900be280 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f099665a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f099665a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53392/0 (socket says 172.21.15.29:53392) 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f099665a700 1 -- 172.21.15.29:0/351782968 learned_addr learned my addr 172.21.15.29:0/351782968 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f0995658700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09900c2a40 0x7f09900ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.674+0000 7f0995e59700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f0990157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 -- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 msgr2=0x7f0990157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f0990157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 -- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09900c2a40 msgr2=0x7f09900ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09900c2a40 0x7f09900ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 -- 172.21.15.29:0/351782968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009550 con 0x7f09900c7c10 2023-10-16T19:41:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f099665a700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f098800cb50 tx=0x7f098800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988003c00 con 0x7f09900c7c10 2023-10-16T19:41:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988003d60 con 0x7f09900c7c10 2023-10-16T19:41:03.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0990158150 con 0x7f09900c7c10 2023-10-16T19:41:03.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800a9c0 con 0x7f09900c7c10 2023-10-16T19:41:03.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.675+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990156a90 con 0x7f09900c7c10 2023-10-16T19:41:03.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.676+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09901e9c40 con 0x7f09900c7c10 2023-10-16T19:41:03.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.676+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f098800ab20 con 0x7f09900c7c10 2023-10-16T19:41:03.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.677+0000 7f09867fc700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:03.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.677+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f09880892d0 con 0x7f09900c7c10 2023-10-16T19:41:03.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.677+0000 7f0995e59700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:03.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.678+0000 7f0995e59700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 0x7f097406d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0980009be0 tx=0x7f0980009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:03.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.682+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09901e9c40 con 0x7f09900c7c10 2023-10-16T19:41:03.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.883+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09901e9c40 con 0x7f09900c7c10 2023-10-16T19:41:03.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.884+0000 7f09867fc700 1 -- 172.21.15.29:0/351782968 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+12990 (secure 0 0 0) 0x7f09901e9c40 con 0x7f09900c7c10 2023-10-16T19:41:03.888 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:03.888 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:41:00.425522+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:03.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 msgr2=0x7f097406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 0x7f097406d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0980009be0 tx=0x7f0980009210 comp rx=0 tx=0).stop 2023-10-16T19:41:03.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 msgr2=0x7f099014e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:03.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f098800cb50 tx=0x7f098800ce60 comp rx=0 tx=0).stop 2023-10-16T19:41:03.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 shutdown_connections 2023-10-16T19:41:03.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09900c7c10 0x7f099014e9f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f09900be280 0x7f0990157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 --2- 172.21.15.29:0/351782968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09900c2a40 0x7f09900ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:03.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 >> 172.21.15.29:0/351782968 conn(0x7f09900a9cd0 msgr2=0x7f09900c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:03.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 shutdown_connections 2023-10-16T19:41:03.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:03.886+0000 7f09980bd700 1 -- 172.21.15.29:0/351782968 wait complete. 2023-10-16T19:41:03.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:39:46.612204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:41:03.902 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:41:04.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.027+0000 7fde368fb700 1 Processor -- start 2023-10-16T19:41:04.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.027+0000 7fde368fb700 1 -- start start 2023-10-16T19:41:04.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde3013d660 0x7fde3006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 0x7fde301583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde3006adc0 0x7fde30158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3006d320 con 0x7fde3013d660 2023-10-16T19:41:04.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde30158e40 con 0x7fde3006adc0 2023-10-16T19:41:04.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde368fb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3006e780 con 0x7fde30154a50 2023-10-16T19:41:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde3013d660 0x7fde3006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde3013d660 0x7fde3006a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53396/0 (socket says 172.21.15.29:53396) 2023-10-16T19:41:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 -- 172.21.15.29:0/4091410127 learned_addr learned my addr 172.21.15.29:0/4091410127 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2f7fe700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 0x7fde301583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde34e98700 1 --2- 172.21.15.29:0/4091410127 >> v2:172.21.15.53:3300/0 conn(0x7fde3006adc0 0x7fde30158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 -- 172.21.15.29:0/4091410127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 msgr2=0x7fde301583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 0x7fde301583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 -- 172.21.15.29:0/4091410127 >> v2:172.21.15.53:3300/0 conn(0x7fde3006adc0 msgr2=0x7fde30158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 --2- 172.21.15.29:0/4091410127 >> v2:172.21.15.53:3300/0 conn(0x7fde3006adc0 0x7fde30158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2ffff700 1 -- 172.21.15.29:0/4091410127 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30154f10 con 0x7fde3013d660 2023-10-16T19:41:04.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.028+0000 7fde2f7fe700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 0x7fde301583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:04.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde2ffff700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde3013d660 0x7fde3006a880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fde30071a70 tx=0x7fde18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54607afe42d52637 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde2effd700 1 -- 172.21.15.29:0/4091410127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800b870 con 0x7fde3013d660 2023-10-16T19:41:04.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde2effd700 1 -- 172.21.15.29:0/4091410127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800b9d0 con 0x7fde3013d660 2023-10-16T19:41:04.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde2effd700 1 -- 172.21.15.29:0/4091410127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800bd60 con 0x7fde3013d660 2023-10-16T19:41:04.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 -- 172.21.15.29:0/4091410127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde3013d660 msgr2=0x7fde3006a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde3013d660 0x7fde3006a880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fde30071a70 tx=0x7fde18009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 -- 172.21.15.29:0/4091410127 shutdown_connections 2023-10-16T19:41:04.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde3013d660 0x7fde3006a880 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 --2- 172.21.15.29:0/4091410127 >> v2:172.21.15.53:3300/0 conn(0x7fde3006adc0 0x7fde30158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 --2- 172.21.15.29:0/4091410127 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde30154a50 0x7fde301583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 -- 172.21.15.29:0/4091410127 >> 172.21.15.29:0/4091410127 conn(0x7fde300c7110 msgr2=0x7fde300c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 -- 172.21.15.29:0/4091410127 shutdown_connections 2023-10-16T19:41:04.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.029+0000 7fde368fb700 1 -- 172.21.15.29:0/4091410127 wait complete. 2023-10-16T19:41:04.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 Processor -- start 2023-10-16T19:41:04.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 -- start start 2023-10-16T19:41:04.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 0x7fde301e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 0x7fde301575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde301391e0 con 0x7fde30154a50 2023-10-16T19:41:04.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30139940 con 0x7fde3006adc0 2023-10-16T19:41:04.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.031+0000 7fde368fb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde30137d80 con 0x7fde3013d660 2023-10-16T19:41:04.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53406/0 (socket says 172.21.15.29:53406) 2023-10-16T19:41:04.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 -- 172.21.15.29:0/3624530630 learned_addr learned my addr 172.21.15.29:0/3624530630 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:04.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2ffff700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 0x7fde301e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2f7fe700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 0x7fde301575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 -- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 msgr2=0x7fde301575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 0x7fde301575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 -- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 msgr2=0x7fde301e9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 0x7fde301e9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 -- 172.21.15.29:0/3624530630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009550 con 0x7fde30154a50 2023-10-16T19:41:04.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2f7fe700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 0x7fde301575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:04.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2ffff700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 0x7fde301e9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:04.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde34e98700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fde2800cbb0 tx=0x7fde2800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28003c70 con 0x7fde30154a50 2023-10-16T19:41:04.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28003df0 con 0x7fde30154a50 2023-10-16T19:41:04.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30139430 con 0x7fde30154a50 2023-10-16T19:41:04.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800a880 con 0x7fde30154a50 2023-10-16T19:41:04.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.032+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30139e70 con 0x7fde30154a50 2023-10-16T19:41:04.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.033+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde300c3760 con 0x7fde30154a50 2023-10-16T19:41:04.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.034+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde2800a9e0 con 0x7fde30154a50 2023-10-16T19:41:04.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.034+0000 7fde2cff9700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 0x7fde1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.034+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fde28088ed0 con 0x7fde30154a50 2023-10-16T19:41:04.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.034+0000 7fde2ffff700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 0x7fde1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.035+0000 7fde2ffff700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 0x7fde1006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde18000c00 tx=0x7fde18008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.039+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde28054220 con 0x7fde30154a50 2023-10-16T19:41:04.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.239+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde3004f400 con 0x7fde30154a50 2023-10-16T19:41:04.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.239+0000 7fde2cff9700 1 -- 172.21.15.29:0/3624530630 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde2801e0a0 con 0x7fde30154a50 2023-10-16T19:41:04.243 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-16T19:41:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.241+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 msgr2=0x7fde1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.241+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 0x7fde1006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde18000c00 tx=0x7fde18008030 comp rx=0 tx=0).stop 2023-10-16T19:41:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.241+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 msgr2=0x7fde30138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.241+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fde2800cbb0 tx=0x7fde2800cf70 comp rx=0 tx=0).stop 2023-10-16T19:41:04.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.241+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 shutdown_connections 2023-10-16T19:41:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fde1006af00 0x7fde1006d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde30154a50 0x7fde30138210 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3006adc0 0x7fde301e9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 --2- 172.21.15.29:0/3624530630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fde3013d660 0x7fde301575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 >> 172.21.15.29:0/3624530630 conn(0x7fde300c7110 msgr2=0x7fde300c28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 shutdown_connections 2023-10-16T19:41:04.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.242+0000 7fde368fb700 1 -- 172.21.15.29:0/3624530630 wait complete. 2023-10-16T19:41:04.257 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T19:41:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.380+0000 7f7338af6700 1 Processor -- start 2023-10-16T19:41:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.380+0000 7f7338af6700 1 -- start start 2023-10-16T19:41:04.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7338af6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733413d660 0x7f733406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7338af6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7334154a50 0x7f73341583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7338af6700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733406e780 con 0x7f733406adc0 2023-10-16T19:41:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7338af6700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733406d320 con 0x7f7334154a50 2023-10-16T19:41:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7338af6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7334154f10 con 0x7f733413d660 2023-10-16T19:41:04.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7334154a50 0x7f73341583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7334154a50 0x7f73341583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53412/0 (socket says 172.21.15.29:53412) 2023-10-16T19:41:04.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 -- 172.21.15.29:0/548730365 learned_addr learned my addr 172.21.15.29:0/548730365 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:04.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f733259c700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733413d660 0x7f733406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 -- 172.21.15.29:0/548730365 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733413d660 msgr2=0x7f733406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733413d660 0x7f733406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 -- 172.21.15.29:0/548730365 >> v1:172.21.15.53:6789/0 conn(0x7f733406adc0 legacy=0x7f7334158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 -- 172.21.15.29:0/548730365 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73341551f0 con 0x7f7334154a50 2023-10-16T19:41:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f7331d9b700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7334154a50 0x7f73341583c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f73280098f0 tx=0x7f7328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a1494747213daf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.381+0000 7f733159a700 1 -- 172.21.15.29:0/548730365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800b8a0 con 0x7f7334154a50 2023-10-16T19:41:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f733159a700 1 -- 172.21.15.29:0/548730365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800ba00 con 0x7f7334154a50 2023-10-16T19:41:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f733159a700 1 -- 172.21.15.29:0/548730365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800bd90 con 0x7f7334154a50 2023-10-16T19:41:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 -- 172.21.15.29:0/548730365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7334154a50 msgr2=0x7f73341583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7334154a50 0x7f73341583c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f73280098f0 tx=0x7f7328009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:04.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 -- 172.21.15.29:0/548730365 shutdown_connections 2023-10-16T19:41:04.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733413d660 0x7f733406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 --2- 172.21.15.29:0/548730365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7334154a50 0x7f73341583c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 -- 172.21.15.29:0/548730365 >> 172.21.15.29:0/548730365 conn(0x7f73340c7110 msgr2=0x7f73340c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 -- 172.21.15.29:0/548730365 shutdown_connections 2023-10-16T19:41:04.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.382+0000 7f7338af6700 1 -- 172.21.15.29:0/548730365 wait complete. 2023-10-16T19:41:04.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.383+0000 7f7338af6700 1 Processor -- start 2023-10-16T19:41:04.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.383+0000 7f7338af6700 1 -- start start 2023-10-16T19:41:04.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733406adc0 0x7f7334139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 0x7f7334157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73341e9c50 con 0x7f733413d660 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73341559f0 con 0x7f7334154a50 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7338af6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73341e9e40 con 0x7f733406adc0 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53418/0 (socket says 172.21.15.29:53418) 2023-10-16T19:41:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 -- 172.21.15.29:0/1048869373 learned_addr learned my addr 172.21.15.29:0/1048869373 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:04.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f733259c700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733406adc0 0x7f7334139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7332d9d700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 0x7f7334157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 -- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733406adc0 msgr2=0x7f7334139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733406adc0 0x7f7334139080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 -- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 msgr2=0x7f7334157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 0x7f7334157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.384+0000 7f7331d9b700 1 -- 172.21.15.29:0/1048869373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328009550 con 0x7f733413d660 2023-10-16T19:41:04.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7332d9d700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 0x7f7334157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:04.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7331d9b700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7328014040 tx=0x7f7328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280036a0 con 0x7f733413d660 2023-10-16T19:41:04.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732801e070 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73340c6b10 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328003a40 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.385+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73341395c0 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.386+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334155e80 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.387+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7328003ba0 con 0x7f733413d660 2023-10-16T19:41:04.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.387+0000 7f7322ffd700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 0x7f731406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.387+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7328020070 con 0x7f733413d660 2023-10-16T19:41:04.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.387+0000 7f733259c700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 0x7f731406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.388+0000 7f733259c700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 0x7f731406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7324009930 tx=0x7f7324008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.391+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7328055be0 con 0x7f733413d660 2023-10-16T19:41:04.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.599+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f73340c3780 con 0x7f733413d660 2023-10-16T19:41:04.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.599+0000 7f7322ffd700 1 -- 172.21.15.29:0/1048869373 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7328059200 con 0x7f733413d660 2023-10-16T19:41:04.602 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:04.602 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-16T19:41:04.602 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-16T19:41:04.602 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-16T19:41:04.603 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-16T19:41:04.603 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-16T19:41:04.603 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-16T19:41:04.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 msgr2=0x7f731406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 0x7f731406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7324009930 tx=0x7f7324008040 comp rx=0 tx=0).stop 2023-10-16T19:41:04.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 msgr2=0x7f73341ea340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7328014040 tx=0x7f7328004750 comp rx=0 tx=0).stop 2023-10-16T19:41:04.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 shutdown_connections 2023-10-16T19:41:04.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f731406af00 0x7f731406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7334154a50 0x7f7334157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f733406adc0 0x7f7334139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 --2- 172.21.15.29:0/1048869373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f733413d660 0x7f73341ea340 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 >> 172.21.15.29:0/1048869373 conn(0x7f73340c7110 msgr2=0x7f73340c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.601+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 shutdown_connections 2023-10-16T19:41:04.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.602+0000 7f7338af6700 1 -- 172.21.15.29:0/1048869373 wait complete. 2023-10-16T19:41:04.617 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-16T19:41:04.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-16T19:41:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.745+0000 7fc4d88af700 1 Processor -- start 2023-10-16T19:41:04.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.745+0000 7fc4d88af700 1 -- start start 2023-10-16T19:41:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.746+0000 7fc4d88af700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc4d4152000 0x7fc4d4071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.746+0000 7fc4d88af700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 0x7fc4d406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.746+0000 7fc4d88af700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4157ed0 con 0x7fc4d406adc0 2023-10-16T19:41:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.746+0000 7fc4d88af700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d41523e0 con 0x7fc4d4152000 2023-10-16T19:41:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.746+0000 7fc4d88af700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40c1a80 con 0x7fc4d4158c00 2023-10-16T19:41:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d2d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc4d406adc0 0x7fc4d41548e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38872/0 (socket says 172.21.15.29:38872) 2023-10-16T19:41:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d2d9d700 1 -- 172.21.15.29:0/1975544067 learned_addr learned my addr 172.21.15.29:0/1975544067 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1975544067 >> v2:172.21.15.53:3300/0 conn(0x7fc4d4152000 0x7fc4d4071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d1d9b700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 0x7fc4d406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546902236 0 0) 0x7fc4d4157ed0 con 0x7fc4d406adc0 2023-10-16T19:41:04.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc0035b0 con 0x7fc4d406adc0 2023-10-16T19:41:04.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 -- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 msgr2=0x7fc4d406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:04.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 0x7fc4d406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 -- 172.21.15.29:0/1975544067 >> v1:172.21.15.29:6789/0 conn(0x7fc4d406adc0 legacy=0x7fc4d41548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348058391 0 0) 0x7fc4bc0035b0 con 0x7fc4d406adc0 2023-10-16T19:41:04.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 -- 172.21.15.29:0/1975544067 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4158770 con 0x7fc4d4152000 2023-10-16T19:41:04.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d1d9b700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 0x7fc4d406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:41:04.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.747+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4152000 0x7fc4d4071c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009840 tx=0x7fc4c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde63bb3551d8014 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0019f0 con 0x7fc4d4152000 2023-10-16T19:41:04.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8004030 con 0x7fc4d4152000 2023-10-16T19:41:04.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d159a700 1 -- 172.21.15.29:0/1975544067 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80043a0 con 0x7fc4d4152000 2023-10-16T19:41:04.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 -- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4152000 msgr2=0x7fc4d4071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4152000 0x7fc4d4071c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009840 tx=0x7fc4c8009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:04.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 -- 172.21.15.29:0/1975544067 shutdown_connections 2023-10-16T19:41:04.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4152000 0x7fc4d4071c70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1975544067 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d4158c00 0x7fc4d406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 -- 172.21.15.29:0/1975544067 >> 172.21.15.29:0/1975544067 conn(0x7fc4d40c7150 msgr2=0x7fc4d40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 -- 172.21.15.29:0/1975544067 shutdown_connections 2023-10-16T19:41:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.748+0000 7fc4d88af700 1 -- 172.21.15.29:0/1975544067 wait complete. 2023-10-16T19:41:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.749+0000 7fc4d88af700 1 Processor -- start 2023-10-16T19:41:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 -- start start 2023-10-16T19:41:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d406adc0 0x7fc4d4150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4158c00 0x7fc4d41edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d41ee2d0 con 0x7fc4d4152000 2023-10-16T19:41:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40c5910 con 0x7fc4d4158c00 2023-10-16T19:41:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d88af700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d41eabe0 con 0x7fc4d406adc0 2023-10-16T19:41:04.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53432/0 (socket says 172.21.15.29:53432) 2023-10-16T19:41:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.750+0000 7fc4d1d9b700 1 -- 172.21.15.29:0/1599468728 learned_addr learned my addr 172.21.15.29:0/1599468728 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d406adc0 0x7fc4d4150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d2d9d700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4158c00 0x7fc4d41edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 -- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d406adc0 msgr2=0x7fc4d4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d406adc0 0x7fc4d4150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 -- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4158c00 msgr2=0x7fc4d41edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4158c00 0x7fc4d41edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 -- 172.21.15.29:0/1599468728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40094a0 con 0x7fc4d4152000 2023-10-16T19:41:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d1d9b700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ebe0 tx=0x7fc4c4009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400c8b0 con 0x7fc4d4152000 2023-10-16T19:41:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c400ca10 con 0x7fc4d4152000 2023-10-16T19:41:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80094a0 con 0x7fc4d4152000 2023-10-16T19:41:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400cda0 con 0x7fc4d4152000 2023-10-16T19:41:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.751+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d40c5e90 con 0x7fc4d4152000 2023-10-16T19:41:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.752+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d41ed6a0 con 0x7fc4d4152000 2023-10-16T19:41:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.753+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4c4013470 con 0x7fc4d4152000 2023-10-16T19:41:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.753+0000 7fc4c2ffd700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 0x7fc4b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.753+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4c4089550 con 0x7fc4d4152000 2023-10-16T19:41:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.753+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 0x7fc4b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:04.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.754+0000 7fc4d259c700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 0x7fc4b406d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80090b0 tx=0x7fc4c8013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:04.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.758+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4c4054820 con 0x7fc4d4152000 2023-10-16T19:41:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:04.960+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc4d404f400 con 0x7fc4d4152000 2023-10-16T19:41:05.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.727+0000 7fc4c2ffd700 1 -- 172.21.15.29:0/1599468728 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v37) v1 ==== 148+0+0 (secure 0 0 0) 0x7fc4c4057e40 con 0x7fc4d4152000 2023-10-16T19:41:05.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 msgr2=0x7fc4b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 0x7fc4b406d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80090b0 tx=0x7fc4c8013040 comp rx=0 tx=0).stop 2023-10-16T19:41:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 msgr2=0x7fc4d41ed850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ebe0 tx=0x7fc4c4009e20 comp rx=0 tx=0).stop 2023-10-16T19:41:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 shutdown_connections 2023-10-16T19:41:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc4b406af00 0x7fc4b406d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d4158c00 0x7fc4d41edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc4d406adc0 0x7fc4d4150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 --2- 172.21.15.29:0/1599468728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d4152000 0x7fc4d41ed850 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.731+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 >> 172.21.15.29:0/1599468728 conn(0x7fc4d40c7150 msgr2=0x7fc4d406f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:05.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.732+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 shutdown_connections 2023-10-16T19:41:05.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.732+0000 7fc4d88af700 1 -- 172.21.15.29:0/1599468728 wait complete. 2023-10-16T19:41:05.736 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'testcephfs1_metadata' created 2023-10-16T19:41:05.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T19:41:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.889+0000 7f27a699c700 1 Processor -- start 2023-10-16T19:41:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.889+0000 7f27a699c700 1 -- start start 2023-10-16T19:41:05.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a699c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27a00c3350 0x7f27a01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a699c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0155af0 con 0x7f27a006db00 2023-10-16T19:41:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a699c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0152300 con 0x7f27a014ec50 2023-10-16T19:41:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a699c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00c2e40 con 0x7f27a00c3350 2023-10-16T19:41:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f279f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27a00c3350 0x7f27a01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a4f39700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f27a006db00 0x7f27a006df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38886/0 (socket says 172.21.15.29:38886) 2023-10-16T19:41:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f27a4f39700 1 -- 172.21.15.29:0/1377621412 learned_addr learned my addr 172.21.15.29:0/1377621412 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.890+0000 7f279f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27a00c3350 0x7f27a01555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53440/0 (socket says 172.21.15.29:53440) 2023-10-16T19:41:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279f7fe700 1 -- 172.21.15.29:0/1377621412 >> v1:172.21.15.53:6789/0 conn(0x7f27a014ec50 legacy=0x7f27a0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279f7fe700 1 -- 172.21.15.29:0/1377621412 >> v1:172.21.15.29:6789/0 conn(0x7f27a006db00 legacy=0x7f27a006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279effd700 1 -- 172.21.15.29:0/1377621412 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90807484 0 0) 0x7f27980014e0 con 0x7f27a006db00 2023-10-16T19:41:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279f7fe700 1 -- 172.21.15.29:0/1377621412 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a014f030 con 0x7f27a00c3350 2023-10-16T19:41:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279f7fe700 1 --2- 172.21.15.29:0/1377621412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a00c3350 0x7f27a01555b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697d9d5045d11d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279effd700 1 -- 172.21.15.29:0/1377621412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790011830 con 0x7f27a00c3350 2023-10-16T19:41:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279effd700 1 -- 172.21.15.29:0/1377621412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790011990 con 0x7f27a00c3350 2023-10-16T19:41:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f279effd700 1 -- 172.21.15.29:0/1377621412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790011d20 con 0x7f27a00c3350 2023-10-16T19:41:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f27a699c700 1 -- 172.21.15.29:0/1377621412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a00c3350 msgr2=0x7f27a01555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.891+0000 7f27a699c700 1 --2- 172.21.15.29:0/1377621412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a00c3350 0x7f27a01555b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.892+0000 7f27a699c700 1 -- 172.21.15.29:0/1377621412 shutdown_connections 2023-10-16T19:41:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.892+0000 7f27a699c700 1 --2- 172.21.15.29:0/1377621412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a00c3350 0x7f27a01555b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.892+0000 7f27a699c700 1 -- 172.21.15.29:0/1377621412 >> 172.21.15.29:0/1377621412 conn(0x7f27a00c7110 msgr2=0x7f27a00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.892+0000 7f27a699c700 1 -- 172.21.15.29:0/1377621412 shutdown_connections 2023-10-16T19:41:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.892+0000 7f27a699c700 1 -- 172.21.15.29:0/1377621412 wait complete. 2023-10-16T19:41:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.893+0000 7f27a699c700 1 Processor -- start 2023-10-16T19:41:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.893+0000 7f27a699c700 1 -- start start 2023-10-16T19:41:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.893+0000 7f27a699c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a00c3350 0x7f27a00ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 0x7f27a00abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00aa6c0 con 0x7f27a006db00 2023-10-16T19:41:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a01ebfd0 con 0x7f27a00c3350 2023-10-16T19:41:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a01ec270 con 0x7f27a014ec50 2023-10-16T19:41:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53444/0 (socket says 172.21.15.29:53444) 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 -- 172.21.15.29:0/4036374245 learned_addr learned my addr 172.21.15.29:0/4036374245 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a4f39700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 0x7f27a00abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279f7fe700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a00c3350 0x7f27a00ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 -- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 msgr2=0x7f27a00abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 0x7f27a00abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 -- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a00c3350 msgr2=0x7f27a00ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:05.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a00c3350 0x7f27a00ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:05.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 -- 172.21.15.29:0/4036374245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900094a0 con 0x7f27a006db00 2023-10-16T19:41:05.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a4f39700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 0x7f27a00abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:05.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279ffff700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f279400c450 tx=0x7f279400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27940052d0 con 0x7f27a006db00 2023-10-16T19:41:05.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2794005430 con 0x7f27a006db00 2023-10-16T19:41:05.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27940038c0 con 0x7f27a006db00 2023-10-16T19:41:05.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a00ab080 con 0x7f27a006db00 2023-10-16T19:41:05.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.894+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00aad10 con 0x7f27a006db00 2023-10-16T19:41:05.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.895+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00ab2c0 con 0x7f27a006db00 2023-10-16T19:41:05.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.896+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2794003a20 con 0x7f27a006db00 2023-10-16T19:41:05.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.896+0000 7f279cff9700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 0x7f278c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:05.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.897+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5552+0+0 (secure 0 0 0) 0x7f2794088880 con 0x7f27a006db00 2023-10-16T19:41:05.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.897+0000 7f279f7fe700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 0x7f278c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:05.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.897+0000 7f279f7fe700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 0x7f278c06d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:05.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:05.901+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27a00ab2c0 con 0x7f27a006db00 2023-10-16T19:41:06.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.103+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f27a004f400 con 0x7f27a006db00 2023-10-16T19:41:06.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.733+0000 7f279cff9700 1 -- 172.21.15.29:0/4036374245 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v38) v1 ==== 180+0+0 (secure 0 0 0) 0x7f27940539e0 con 0x7f27a006db00 2023-10-16T19:41:06.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.737+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 msgr2=0x7f278c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.737+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 0x7f278c06d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2790009840 tx=0x7f2790008030 comp rx=0 tx=0).stop 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.737+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 msgr2=0x7f27a01df3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.737+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f279400c450 tx=0x7f279400c810 comp rx=0 tx=0).stop 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 shutdown_connections 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f278c06af00 0x7f278c06d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27a014ec50 0x7f27a00abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a006db00 0x7f27a01df3e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 --2- 172.21.15.29:0/4036374245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a00c3350 0x7f27a00ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 >> 172.21.15.29:0/4036374245 conn(0x7f27a00c7110 msgr2=0x7f27a00c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:06.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 shutdown_connections 2023-10-16T19:41:06.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.738+0000 7f27a699c700 1 -- 172.21.15.29:0/4036374245 wait complete. 2023-10-16T19:41:06.747 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'testcephfs1_data' created 2023-10-16T19:41:06.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-16T19:41:06.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.897+0000 7f2b439ad700 1 Processor -- start 2023-10-16T19:41:06.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.897+0000 7f2b439ad700 1 -- start start 2023-10-16T19:41:06.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b439ad700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b3c0c3350 0x7f2b3c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:06.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b439ad700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c155af0 con 0x7f2b3c14ec50 2023-10-16T19:41:06.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b439ad700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c152300 con 0x7f2b3c06db00 2023-10-16T19:41:06.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b439ad700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c2e40 con 0x7f2b3c0c3350 2023-10-16T19:41:06.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b40f48700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b3c0c3350 0x7f2b3c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:06.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b41749700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2b3c14ec50 0x7f2b3c071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38896/0 (socket says 172.21.15.29:38896) 2023-10-16T19:41:06.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b41749700 1 -- 172.21.15.29:0/3304088425 learned_addr learned my addr 172.21.15.29:0/3304088425 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:06.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b40f48700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b3c0c3350 0x7f2b3c1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53454/0 (socket says 172.21.15.29:53454) 2023-10-16T19:41:06.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b40f48700 1 -- 172.21.15.29:0/3304088425 >> v1:172.21.15.53:6789/0 conn(0x7f2b3c06db00 legacy=0x7f2b3c06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:06.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b40f48700 1 -- 172.21.15.29:0/3304088425 >> v1:172.21.15.29:6789/0 conn(0x7f2b3c14ec50 legacy=0x7f2b3c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b33fff700 1 -- 172.21.15.29:0/3304088425 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245400172 0 0) 0x7f2b2c001110 con 0x7f2b3c14ec50 2023-10-16T19:41:06.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.898+0000 7f2b40f48700 1 -- 172.21.15.29:0/3304088425 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c14f030 con 0x7f2b3c0c3350 2023-10-16T19:41:06.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b40f48700 1 --2- 172.21.15.29:0/3304088425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c1555b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009840 tx=0x7f2b38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbad96fc3473fa41 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:06.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b33fff700 1 -- 172.21.15.29:0/3304088425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38004230 con 0x7f2b3c0c3350 2023-10-16T19:41:06.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b33fff700 1 -- 172.21.15.29:0/3304088425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38004390 con 0x7f2b3c0c3350 2023-10-16T19:41:06.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b33fff700 1 -- 172.21.15.29:0/3304088425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380036a0 con 0x7f2b3c0c3350 2023-10-16T19:41:06.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 -- 172.21.15.29:0/3304088425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c0c3350 msgr2=0x7f2b3c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3304088425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c1555b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009840 tx=0x7f2b38009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:06.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 -- 172.21.15.29:0/3304088425 shutdown_connections 2023-10-16T19:41:06.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3304088425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c1555b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 -- 172.21.15.29:0/3304088425 >> 172.21.15.29:0/3304088425 conn(0x7f2b3c0c7110 msgr2=0x7f2b3c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:06.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 -- 172.21.15.29:0/3304088425 shutdown_connections 2023-10-16T19:41:06.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.899+0000 7f2b439ad700 1 -- 172.21.15.29:0/3304088425 wait complete. 2023-10-16T19:41:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 Processor -- start 2023-10-16T19:41:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 -- start start 2023-10-16T19:41:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b3c14ec50 0x7f2b3c13d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1edc50 con 0x7f2b3c06db00 2023-10-16T19:41:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c64e0 con 0x7f2b3c0c3350 2023-10-16T19:41:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b439ad700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c6780 con 0x7f2b3c14ec50 2023-10-16T19:41:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b41749700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b41749700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53458/0 (socket says 172.21.15.29:53458) 2023-10-16T19:41:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b41749700 1 -- 172.21.15.29:0/3529964105 learned_addr learned my addr 172.21.15.29:0/3529964105 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.901+0000 7f2b40f48700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41f4a700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b3c14ec50 0x7f2b3c13d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 -- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b3c14ec50 msgr2=0x7f2b3c13d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b3c14ec50 0x7f2b3c13d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 -- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 msgr2=0x7f2b3c153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:06.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:06.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 -- 172.21.15.29:0/3529964105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380094a0 con 0x7f2b3c06db00 2023-10-16T19:41:06.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b40f48700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:06.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b41749700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00c730 tx=0x7f2b2c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c004c80 con 0x7f2b3c06db00 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c004e00 con 0x7f2b3c06db00 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c007310 con 0x7f2b3c06db00 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c1ed2b0 con 0x7f2b3c06db00 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.902+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c1ed870 con 0x7f2b3c06db00 2023-10-16T19:41:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.903+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c1edd90 con 0x7f2b3c06db00 2023-10-16T19:41:06.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.904+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2b2c007470 con 0x7f2b3c06db00 2023-10-16T19:41:06.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.904+0000 7f2b31ffb700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 0x7f2b2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:06.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.904+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f2b2c089290 con 0x7f2b3c06db00 2023-10-16T19:41:06.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.904+0000 7f2b40f48700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 0x7f2b2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:06.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.905+0000 7f2b40f48700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 0x7f2b2006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009840 tx=0x7f2b3801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:06.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:06.909+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b3c1edd90 con 0x7f2b3c06db00 2023-10-16T19:41:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.154+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f2b3c155af0 con 0x7f2b3c06db00 2023-10-16T19:41:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.734+0000 7f2b31ffb700 1 -- 172.21.15.29:0/3529964105 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7f2b3c155af0 con 0x7f2b3c06db00 2023-10-16T19:41:07.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 msgr2=0x7f2b2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 0x7f2b2006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009840 tx=0x7f2b3801c040 comp rx=0 tx=0).stop 2023-10-16T19:41:07.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 msgr2=0x7f2b3c0c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00c730 tx=0x7f2b2c00caf0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 shutdown_connections 2023-10-16T19:41:07.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f2b2006af00 0x7f2b2006d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2b3c14ec50 0x7f2b3c13d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b3c06db00 0x7f2b3c0c5fa0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.739+0000 7f2b439ad700 1 --2- 172.21.15.29:0/3529964105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b3c0c3350 0x7f2b3c153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.740+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 >> 172.21.15.29:0/3529964105 conn(0x7f2b3c0c7110 msgr2=0x7f2b3c06e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:07.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.740+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 shutdown_connections 2023-10-16T19:41:07.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.740+0000 7f2b439ad700 1 -- 172.21.15.29:0/3529964105 wait complete. 2023-10-16T19:41:07.746 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 5 and data pool 6 2023-10-16T19:41:07.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.905+0000 7f7101ef7700 1 Processor -- start 2023-10-16T19:41:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.905+0000 7f7101ef7700 1 -- start start 2023-10-16T19:41:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f7101ef7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70fc0c4f50 0x7f70fc153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f7101ef7700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70fc0c7bb0 0x7f70fc070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f7101ef7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0bd0e0 con 0x7f70fc070ac0 2023-10-16T19:41:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f7101ef7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0c3000 con 0x7f70fc0c4f50 2023-10-16T19:41:07.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f7101ef7700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0c5330 con 0x7f70fc0c7bb0 2023-10-16T19:41:07.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70fc0c4f50 0x7f70fc153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70fc0c4f50 0x7f70fc153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53466/0 (socket says 172.21.15.29:53466) 2023-10-16T19:41:07.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fbfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f70fc070ac0 0x7f70fc155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38914/0 (socket says 172.21.15.29:38914) 2023-10-16T19:41:07.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 -- 172.21.15.29:0/3750938659 learned_addr learned my addr 172.21.15.29:0/3750938659 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:07.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70faffd700 1 --2- 172.21.15.29:0/3750938659 >> v2:172.21.15.53:3300/0 conn(0x7f70fc0c7bb0 0x7f70fc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 -- 172.21.15.29:0/3750938659 >> v2:172.21.15.53:3300/0 conn(0x7f70fc0c7bb0 msgr2=0x7f70fc070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:07.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 --2- 172.21.15.29:0/3750938659 >> v2:172.21.15.53:3300/0 conn(0x7f70fc0c7bb0 0x7f70fc070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 -- 172.21.15.29:0/3750938659 >> v1:172.21.15.29:6789/0 conn(0x7f70fc070ac0 legacy=0x7f70fc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fb7fe700 1 -- 172.21.15.29:0/3750938659 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0c2a40 con 0x7f70fc0c4f50 2023-10-16T19:41:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.906+0000 7f70fa7fc700 1 -- 172.21.15.29:0/3750938659 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889407435 0 0) 0x7f70fc0bd0e0 con 0x7f70fc070ac0 2023-10-16T19:41:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f70fb7fe700 1 --2- 172.21.15.29:0/3750938659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc153290 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70e40098f0 tx=0x7f70e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cd1040d498ac2c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f70fa7fc700 1 -- 172.21.15.29:0/3750938659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400b860 con 0x7f70fc0c4f50 2023-10-16T19:41:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f70fa7fc700 1 -- 172.21.15.29:0/3750938659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e400b9c0 con 0x7f70fc0c4f50 2023-10-16T19:41:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f70fa7fc700 1 -- 172.21.15.29:0/3750938659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400bd50 con 0x7f70fc0c4f50 2023-10-16T19:41:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 -- 172.21.15.29:0/3750938659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 msgr2=0x7f70fc153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3750938659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc153290 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70e40098f0 tx=0x7f70e4009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 -- 172.21.15.29:0/3750938659 shutdown_connections 2023-10-16T19:41:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3750938659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc153290 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3750938659 >> v2:172.21.15.53:3300/0 conn(0x7f70fc0c7bb0 0x7f70fc070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 -- 172.21.15.29:0/3750938659 >> 172.21.15.29:0/3750938659 conn(0x7f70fc0a9cd0 msgr2=0x7f70fc0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 -- 172.21.15.29:0/3750938659 shutdown_connections 2023-10-16T19:41:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.907+0000 7f7101ef7700 1 -- 172.21.15.29:0/3750938659 wait complete. 2023-10-16T19:41:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 Processor -- start 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 -- start start 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f70fc070ac0 0x7f70fc06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 0x7f70fc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0a9720 con 0x7f70fc0c4f50 2023-10-16T19:41:07.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc151fa0 con 0x7f70fc0c7bb0 2023-10-16T19:41:07.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.909+0000 7f7101ef7700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0a9380 con 0x7f70fc070ac0 2023-10-16T19:41:07.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53474/0 (socket says 172.21.15.29:53474) 2023-10-16T19:41:07.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 -- 172.21.15.29:0/3604043682 learned_addr learned my addr 172.21.15.29:0/3604043682 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70fbfff700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 0x7f70fc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70fb7fe700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f70fc070ac0 0x7f70fc06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 -- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f70fc070ac0 msgr2=0x7f70fc06ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f70fc070ac0 0x7f70fc06ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 -- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 msgr2=0x7f70fc156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 0x7f70fc156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 -- 172.21.15.29:0/3604043682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4009550 con 0x7f70fc0c4f50 2023-10-16T19:41:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70fbfff700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 0x7f70fc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70faffd700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d800 tx=0x7f70ec00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0125f0 con 0x7f70fc0c4f50 2023-10-16T19:41:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec012750 con 0x7f70fc0c4f50 2023-10-16T19:41:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0a90a0 con 0x7f70fc0c4f50 2023-10-16T19:41:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec012b00 con 0x7f70fc0c4f50 2023-10-16T19:41:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.910+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc0adc10 con 0x7f70fc0c4f50 2023-10-16T19:41:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.911+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc04f400 con 0x7f70fc0c4f50 2023-10-16T19:41:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.912+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70ec012c60 con 0x7f70fc0c4f50 2023-10-16T19:41:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.912+0000 7f70f3fff700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 0x7f70dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.912+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f70ec089960 con 0x7f70fc0c4f50 2023-10-16T19:41:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.912+0000 7f70fb7fe700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 0x7f70dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.913+0000 7f70fb7fe700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 0x7f70dc06d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009c40 tx=0x7f70e4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:07.917+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70ec054940 con 0x7f70fc0c4f50 2023-10-16T19:41:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.115+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70fc150c00 con 0x7f70fc0c4f50 2023-10-16T19:41:08.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.117+0000 7f70f3fff700 1 -- 172.21.15.29:0/3604043682 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16735 (secure 0 0 0) 0x7f70ec057f60 con 0x7f70fc0c4f50 2023-10-16T19:41:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:08.119 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:41:07.155419+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:41:04.991651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:41:06.133968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:08.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 msgr2=0x7f70dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 0x7f70dc06d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009c40 tx=0x7f70e4008030 comp rx=0 tx=0).stop 2023-10-16T19:41:08.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 msgr2=0x7f70fc155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d800 tx=0x7f70ec00db10 comp rx=0 tx=0).stop 2023-10-16T19:41:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 shutdown_connections 2023-10-16T19:41:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f70dc06af00 0x7f70dc06d3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70fc0c7bb0 0x7f70fc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f70fc070ac0 0x7f70fc06ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 --2- 172.21.15.29:0/3604043682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70fc0c4f50 0x7f70fc155e50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 >> 172.21.15.29:0/3604043682 conn(0x7f70fc0a9cd0 msgr2=0x7f70fc14f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:08.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 shutdown_connections 2023-10-16T19:41:08.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.119+0000 7f7101ef7700 1 -- 172.21.15.29:0/3604043682 wait complete. 2023-10-16T19:41:08.133 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:08.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.256+0000 7f64499a0700 1 Processor -- start 2023-10-16T19:41:08.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.256+0000 7f64499a0700 1 -- start start 2023-10-16T19:41:08.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64499a0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6444151ea0 0x7f64440c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64499a0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64440bd8c0 0x7f6444155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64499a0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440ca540 con 0x7f64440c8130 2023-10-16T19:41:08.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64499a0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6444158c80 con 0x7f64440bd8c0 2023-10-16T19:41:08.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64499a0700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64440ca790 con 0x7f6444151ea0 2023-10-16T19:41:08.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64440bd8c0 0x7f6444155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64427fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f64440c8130 0x7f6444154b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38924/0 (socket says 172.21.15.29:38924) 2023-10-16T19:41:08.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64427fc700 1 -- 172.21.15.29:0/4001748512 learned_addr learned my addr 172.21.15.29:0/4001748512 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:08.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f6442ffd700 1 --2- 172.21.15.29:0/4001748512 >> v2:172.21.15.53:3300/0 conn(0x7f6444151ea0 0x7f64440c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 -- 172.21.15.29:0/4001748512 >> v2:172.21.15.53:3300/0 conn(0x7f6444151ea0 msgr2=0x7f64440c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:08.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f6441ffb700 1 -- 172.21.15.29:0/4001748512 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118477218 0 0) 0x7f64440ca540 con 0x7f64440c8130 2023-10-16T19:41:08.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 --2- 172.21.15.29:0/4001748512 >> v2:172.21.15.53:3300/0 conn(0x7f6444151ea0 0x7f64440c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 -- 172.21.15.29:0/4001748512 >> v1:172.21.15.29:6789/0 conn(0x7f64440c8130 legacy=0x7f6444154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 -- 172.21.15.29:0/4001748512 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440caa70 con 0x7f64440bd8c0 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f64437fe700 1 --2- 172.21.15.29:0/4001748512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64440bd8c0 0x7f6444155260 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64440cb1a0 tx=0x7f643c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2be1b3792e6686 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f6441ffb700 1 -- 172.21.15.29:0/4001748512 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c00e070 con 0x7f64440bd8c0 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f6441ffb700 1 -- 172.21.15.29:0/4001748512 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c00bbd0 con 0x7f64440bd8c0 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.257+0000 7f6441ffb700 1 -- 172.21.15.29:0/4001748512 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c012430 con 0x7f64440bd8c0 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 -- 172.21.15.29:0/4001748512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64440bd8c0 msgr2=0x7f6444155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 --2- 172.21.15.29:0/4001748512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64440bd8c0 0x7f6444155260 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64440cb1a0 tx=0x7f643c00b330 comp rx=0 tx=0).stop 2023-10-16T19:41:08.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 -- 172.21.15.29:0/4001748512 shutdown_connections 2023-10-16T19:41:08.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 --2- 172.21.15.29:0/4001748512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64440bd8c0 0x7f6444155260 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 --2- 172.21.15.29:0/4001748512 >> v2:172.21.15.53:3300/0 conn(0x7f6444151ea0 0x7f64440c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 -- 172.21.15.29:0/4001748512 >> 172.21.15.29:0/4001748512 conn(0x7f6444072190 msgr2=0x7f64440725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:08.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 -- 172.21.15.29:0/4001748512 shutdown_connections 2023-10-16T19:41:08.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.258+0000 7f64499a0700 1 -- 172.21.15.29:0/4001748512 wait complete. 2023-10-16T19:41:08.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.259+0000 7f64499a0700 1 Processor -- start 2023-10-16T19:41:08.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.259+0000 7f64499a0700 1 -- start start 2023-10-16T19:41:08.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 0x7f64441eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 0x7f6444152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64441538a0 con 0x7f6444151ea0 2023-10-16T19:41:08.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444154780 con 0x7f64440bd8c0 2023-10-16T19:41:08.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64499a0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440af550 con 0x7f64440c8130 2023-10-16T19:41:08.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53488/0 (socket says 172.21.15.29:53488) 2023-10-16T19:41:08.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 -- 172.21.15.29:0/1473154294 learned_addr learned my addr 172.21.15.29:0/1473154294 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:08.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64427fc700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 0x7f6444152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f6442ffd700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 0x7f64441eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 -- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 msgr2=0x7f6444152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 0x7f6444152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 -- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 msgr2=0x7f64441eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 0x7f64441eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64437fe700 1 -- 172.21.15.29:0/1473154294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009a70 con 0x7f6444151ea0 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f6442ffd700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 0x7f64441eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.260+0000 7f64427fc700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 0x7f6444152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f64437fe700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b370 tx=0x7f643c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c012430 con 0x7f6444151ea0 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c020070 con 0x7f6444151ea0 2023-10-16T19:41:08.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64440af270 con 0x7f6444151ea0 2023-10-16T19:41:08.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c004260 con 0x7f6444151ea0 2023-10-16T19:41:08.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.261+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6444153530 con 0x7f6444151ea0 2023-10-16T19:41:08.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.262+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644404f400 con 0x7f6444151ea0 2023-10-16T19:41:08.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.262+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f643c0043c0 con 0x7f6444151ea0 2023-10-16T19:41:08.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.263+0000 7f642bfff700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 0x7f643006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.263+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f643c022070 con 0x7f6444151ea0 2023-10-16T19:41:08.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.263+0000 7f6442ffd700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 0x7f643006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.263+0000 7f6442ffd700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 0x7f643006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6434009820 tx=0x7f6434008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.267+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f643c0568e0 con 0x7f6444151ea0 2023-10-16T19:41:08.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.467+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64441539e0 con 0x7f6444151ea0 2023-10-16T19:41:08.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.468+0000 7f642bfff700 1 -- 172.21.15.29:0/1473154294 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16735 (secure 0 0 0) 0x7f643c059f00 con 0x7f6444151ea0 2023-10-16T19:41:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:08.471 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:41:07.155419+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:41:04.991651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:41:06.133968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:08.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 msgr2=0x7f643006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 0x7f643006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6434009820 tx=0x7f6434008040 comp rx=0 tx=0).stop 2023-10-16T19:41:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 msgr2=0x7f6444153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b370 tx=0x7f643c004ad0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 shutdown_connections 2023-10-16T19:41:08.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f643006af00 0x7f643006d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6444151ea0 0x7f6444153d30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64440bd8c0 0x7f64441eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 --2- 172.21.15.29:0/1473154294 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64440c8130 0x7f6444152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.470+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 >> 172.21.15.29:0/1473154294 conn(0x7f6444072190 msgr2=0x7f64440c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.471+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 shutdown_connections 2023-10-16T19:41:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.471+0000 7f64499a0700 1 -- 172.21.15.29:0/1473154294 wait complete. 2023-10-16T19:41:08.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-16T19:41:08.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.611+0000 7f59bf98b700 1 Processor -- start 2023-10-16T19:41:08.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.612+0000 7f59bf98b700 1 -- start start 2023-10-16T19:41:08.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.612+0000 7f59bf98b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59b813dd00 0x7f59b8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.612+0000 7f59bf98b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b806e780 con 0x7f59b813d660 2023-10-16T19:41:08.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.612+0000 7f59bf98b700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b8154f10 con 0x7f59b8154a50 2023-10-16T19:41:08.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.612+0000 7f59bf98b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b806d320 con 0x7f59b813dd00 2023-10-16T19:41:08.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59b813dd00 0x7f59b8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bd727700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f59b813d660 0x7f59b806a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38938/0 (socket says 172.21.15.29:38938) 2023-10-16T19:41:08.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59b813dd00 0x7f59b8158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53498/0 (socket says 172.21.15.29:53498) 2023-10-16T19:41:08.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bd727700 1 -- 172.21.15.29:0/2359682985 learned_addr learned my addr 172.21.15.29:0/2359682985 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:08.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 -- 172.21.15.29:0/2359682985 >> v1:172.21.15.53:6789/0 conn(0x7f59b8154a50 legacy=0x7f59b81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 -- 172.21.15.29:0/2359682985 >> v1:172.21.15.29:6789/0 conn(0x7f59b813d660 legacy=0x7f59b806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59affff700 1 -- 172.21.15.29:0/2359682985 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053898537 0 0) 0x7f59b806e780 con 0x7f59b813d660 2023-10-16T19:41:08.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 -- 172.21.15.29:0/2359682985 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b81551f0 con 0x7f59b813dd00 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59bdf28700 1 --2- 172.21.15.29:0/2359682985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b8158ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19254da35bad859 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59affff700 1 -- 172.21.15.29:0/2359682985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000e070 con 0x7f59b813dd00 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59affff700 1 -- 172.21.15.29:0/2359682985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000bbd0 con 0x7f59b813dd00 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.613+0000 7f59affff700 1 -- 172.21.15.29:0/2359682985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0012430 con 0x7f59b813dd00 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 -- 172.21.15.29:0/2359682985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 msgr2=0x7f59b8158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 --2- 172.21.15.29:0/2359682985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b8158ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b000b330 comp rx=0 tx=0).stop 2023-10-16T19:41:08.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 -- 172.21.15.29:0/2359682985 shutdown_connections 2023-10-16T19:41:08.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 --2- 172.21.15.29:0/2359682985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b8158ad0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 -- 172.21.15.29:0/2359682985 >> 172.21.15.29:0/2359682985 conn(0x7f59b80c7110 msgr2=0x7f59b80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:08.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 -- 172.21.15.29:0/2359682985 shutdown_connections 2023-10-16T19:41:08.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.614+0000 7f59bf98b700 1 -- 172.21.15.29:0/2359682985 wait complete. 2023-10-16T19:41:08.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.615+0000 7f59bf98b700 1 Processor -- start 2023-10-16T19:41:08.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.615+0000 7f59bf98b700 1 -- start start 2023-10-16T19:41:08.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59b813d660 0x7f59b81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59b8154a50 0x7f59b80ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8157f10 con 0x7f59b813dd00 2023-10-16T19:41:08.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8139c60 con 0x7f59b8154a50 2023-10-16T19:41:08.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bf98b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81e99d0 con 0x7f59b813d660 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53502/0 (socket says 172.21.15.29:53502) 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 -- 172.21.15.29:0/1391251826 learned_addr learned my addr 172.21.15.29:0/1391251826 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bd727700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59b813d660 0x7f59b81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bdf28700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59b8154a50 0x7f59b80ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 -- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59b813d660 msgr2=0x7f59b81576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59b813d660 0x7f59b81576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 -- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59b8154a50 msgr2=0x7f59b80ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59b8154a50 0x7f59b80ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 -- 172.21.15.29:0/1391251826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009a70 con 0x7f59b813dd00 2023-10-16T19:41:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.616+0000 7f59bcf26700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c450 tx=0x7f59b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.617+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40052d0 con 0x7f59b813dd00 2023-10-16T19:41:08.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.617+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4005430 con 0x7f59b813dd00 2023-10-16T19:41:08.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.617+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40038c0 con 0x7f59b813dd00 2023-10-16T19:41:08.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.617+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b81ea9a0 con 0x7f59b813dd00 2023-10-16T19:41:08.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.617+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b81ea1a0 con 0x7f59b813dd00 2023-10-16T19:41:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.618+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80c3780 con 0x7f59b813dd00 2023-10-16T19:41:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.618+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59b4003a20 con 0x7f59b813dd00 2023-10-16T19:41:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.619+0000 7f59adffb700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 0x7f599c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.619+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f59b4088a00 con 0x7f59b813dd00 2023-10-16T19:41:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.619+0000 7f59bd727700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 0x7f599c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.619+0000 7f59bd727700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 0x7f599c06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007fd0 tx=0x7f59a8007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.623+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59b40539e0 con 0x7f59b813dd00 2023-10-16T19:41:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:08.877+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59b804f400 con 0x7f59b813dd00 2023-10-16T19:41:09.723 INFO:tasks.ceph.mds.b.smithi053.stderr:2023-10-16T19:41:09.721+0000 7f284d63b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T19:41:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.755+0000 7f59adffb700 1 -- 172.21.15.29:0/1391251826 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f59b4057000 con 0x7f59b813dd00 2023-10-16T19:41:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.758+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 msgr2=0x7f599c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.758+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 0x7f599c06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007fd0 tx=0x7f59a8007c20 comp rx=0 tx=0).stop 2023-10-16T19:41:09.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.758+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 msgr2=0x7f59b80c2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.758+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c450 tx=0x7f59b400c810 comp rx=0 tx=0).stop 2023-10-16T19:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 shutdown_connections 2023-10-16T19:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f599c06af00 0x7f599c06d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59b8154a50 0x7f59b80ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59b813d660 0x7f59b81576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 --2- 172.21.15.29:0/1391251826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59b813dd00 0x7f59b80c2280 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 >> 172.21.15.29:0/1391251826 conn(0x7f59b80c7110 msgr2=0x7f59b81582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 shutdown_connections 2023-10-16T19:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.759+0000 7f59bf98b700 1 -- 172.21.15.29:0/1391251826 wait complete. 2023-10-16T19:41:09.775 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T19:41:09.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-16T19:41:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.910+0000 7fdef0c2c700 1 Processor -- start 2023-10-16T19:41:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.910+0000 7fdef0c2c700 1 -- start start 2023-10-16T19:41:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdef0c2c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdeec154a50 0x7fdeec1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdef0c2c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec06e780 con 0x7fdeec13d660 2023-10-16T19:41:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdef0c2c700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec154f10 con 0x7fdeec13dd00 2023-10-16T19:41:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdef0c2c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec06d320 con 0x7fdeec154a50 2023-10-16T19:41:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdeec154a50 0x7fdeec1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdeec154a50 0x7fdeec1583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53510/0 (socket says 172.21.15.29:53510) 2023-10-16T19:41:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 -- 172.21.15.29:0/1832245538 learned_addr learned my addr 172.21.15.29:0/1832245538 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 -- 172.21.15.29:0/1832245538 >> v1:172.21.15.53:6789/0 conn(0x7fdeec13dd00 legacy=0x7fdeec158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 -- 172.21.15.29:0/1832245538 >> v1:172.21.15.29:6789/0 conn(0x7fdeec13d660 legacy=0x7fdeec06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 -- 172.21.15.29:0/1832245538 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec1551f0 con 0x7fdeec154a50 2023-10-16T19:41:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee959a700 1 -- 172.21.15.29:0/1832245538 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792760342 0 0) 0x7fdeec06e780 con 0x7fdeec13d660 2023-10-16T19:41:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee9d9b700 1 --2- 172.21.15.29:0/1832245538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec154a50 0x7fdeec1583c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fded40098f0 tx=0x7fded4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312dd8a62d1e47ba server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee959a700 1 -- 172.21.15.29:0/1832245538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400b8a0 con 0x7fdeec154a50 2023-10-16T19:41:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee959a700 1 -- 172.21.15.29:0/1832245538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400ba00 con 0x7fdeec154a50 2023-10-16T19:41:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.911+0000 7fdee959a700 1 -- 172.21.15.29:0/1832245538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400bd90 con 0x7fdeec154a50 2023-10-16T19:41:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1832245538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec154a50 msgr2=0x7fdeec1583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1832245538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec154a50 0x7fdeec1583c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fded40098f0 tx=0x7fded4009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1832245538 shutdown_connections 2023-10-16T19:41:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1832245538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec154a50 0x7fdeec1583c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1832245538 >> 172.21.15.29:0/1832245538 conn(0x7fdeec0c7110 msgr2=0x7fdeec0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1832245538 shutdown_connections 2023-10-16T19:41:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.912+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1832245538 wait complete. 2023-10-16T19:41:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.913+0000 7fdef0c2c700 1 Processor -- start 2023-10-16T19:41:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.913+0000 7fdef0c2c700 1 -- start start 2023-10-16T19:41:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdeec13dd00 0x7fdeec0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 0x7fdeec1378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0ac440 con 0x7fdeec13d660 2023-10-16T19:41:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0abdc0 con 0x7fdeec154a50 2023-10-16T19:41:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdef0c2c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec1edf70 con 0x7fdeec13dd00 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53514/0 (socket says 172.21.15.29:53514) 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 -- 172.21.15.29:0/1651937735 learned_addr learned my addr 172.21.15.29:0/1651937735 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeead9d700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 0x7fdeec1378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdee9d9b700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdeec13dd00 0x7fdeec0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 -- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdeec13dd00 msgr2=0x7fdeec0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdeec13dd00 0x7fdeec0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 -- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 msgr2=0x7fdeec1378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 0x7fdeec1378c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeea59c700 1 -- 172.21.15.29:0/1651937735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009550 con 0x7fdeec13d660 2023-10-16T19:41:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.914+0000 7fdeead9d700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 0x7fdeec1378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdeea59c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdedc001eb0 tx=0x7fdedc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0054e0 con 0x7fdeec13d660 2023-10-16T19:41:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc003680 con 0x7fdeec13d660 2023-10-16T19:41:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec155d20 con 0x7fdeec13d660 2023-10-16T19:41:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0039f0 con 0x7fdeec13d660 2023-10-16T19:41:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.915+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec1559f0 con 0x7fdeec13d660 2023-10-16T19:41:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.916+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec0c5c80 con 0x7fdeec13d660 2023-10-16T19:41:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.917+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdedc003b70 con 0x7fdeec13d660 2023-10-16T19:41:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.917+0000 7fdee2ffd700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 0x7fdecc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.917+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdedc088a90 con 0x7fdeec13d660 2023-10-16T19:41:09.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.918+0000 7fdee9d9b700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 0x7fdecc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:09.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.918+0000 7fdee9d9b700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 0x7fdecc06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fded4014040 tx=0x7fded4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:09.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:09.922+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdedc053b20 con 0x7fdeec13d660 2023-10-16T19:41:10.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.166+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdeec0c3760 con 0x7fdeec13d660 2023-10-16T19:41:10.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.761+0000 7fdee2ffd700 1 -- 172.21.15.29:0/1651937735 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7fdedc017020 con 0x7fdeec13d660 2023-10-16T19:41:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.763+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 msgr2=0x7fdecc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.763+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 0x7fdecc06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fded4014040 tx=0x7fded4008030 comp rx=0 tx=0).stop 2023-10-16T19:41:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.763+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 msgr2=0x7fdeec1eda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.763+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdedc001eb0 tx=0x7fdedc00c8b0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.763+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 shutdown_connections 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fdecc06af00 0x7fdecc06d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeec154a50 0x7fdeec1378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdeec13d660 0x7fdeec1eda30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 --2- 172.21.15.29:0/1651937735 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdeec13dd00 0x7fdeec0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 >> 172.21.15.29:0/1651937735 conn(0x7fdeec0c7110 msgr2=0x7fdeec071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:10.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 shutdown_connections 2023-10-16T19:41:10.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.764+0000 7fdef0c2c700 1 -- 172.21.15.29:0/1651937735 wait complete. 2023-10-16T19:41:10.780 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-16T19:41:10.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:10.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.907+0000 7f04e3cd2700 1 Processor -- start 2023-10-16T19:41:10.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 -- start start 2023-10-16T19:41:10.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04dc06a880 0x7f04dc06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc156c60 con 0x7f04dc14c780 2023-10-16T19:41:10.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0ac7d0 con 0x7f04dc06a880 2023-10-16T19:41:10.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.908+0000 7f04e3cd2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1537d0 con 0x7f04dc0ac0a0 2023-10-16T19:41:10.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04dc06a880 0x7f04dc06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04dc06a880 0x7f04dc06ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53526/0 (socket says 172.21.15.29:53526) 2023-10-16T19:41:10.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e1a6e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f04dc14c780 0x7f04dc06d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38966/0 (socket says 172.21.15.29:38966) 2023-10-16T19:41:10.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 -- 172.21.15.29:0/1370470029 learned_addr learned my addr 172.21.15.29:0/1370470029 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:10.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e126d700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 -- 172.21.15.29:0/1370470029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 msgr2=0x7f04dc153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:10.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 -- 172.21.15.29:0/1370470029 >> v1:172.21.15.29:6789/0 conn(0x7f04dc14c780 legacy=0x7f04dc06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 -- 172.21.15.29:0/1370470029 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0ac500 con 0x7f04dc06a880 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e0a6c700 1 -- 172.21.15.29:0/1370470029 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337687313 0 0) 0x7f04dc156c60 con 0x7f04dc14c780 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e226f700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc06ad10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009e80 tx=0x7f04d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8f5d99725864ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e0a6c700 1 -- 172.21.15.29:0/1370470029 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400e070 con 0x7f04dc06a880 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e0a6c700 1 -- 172.21.15.29:0/1370470029 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400b980 con 0x7f04dc06a880 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.909+0000 7f04e0a6c700 1 -- 172.21.15.29:0/1370470029 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400bd30 con 0x7f04dc06a880 2023-10-16T19:41:10.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 -- 172.21.15.29:0/1370470029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 msgr2=0x7f04dc06ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc06ad10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009e80 tx=0x7f04d400b330 comp rx=0 tx=0).stop 2023-10-16T19:41:10.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 -- 172.21.15.29:0/1370470029 shutdown_connections 2023-10-16T19:41:10.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc06ad10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/1370470029 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 -- 172.21.15.29:0/1370470029 >> 172.21.15.29:0/1370470029 conn(0x7f04dc0c66d0 msgr2=0x7f04dc0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:10.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 -- 172.21.15.29:0/1370470029 shutdown_connections 2023-10-16T19:41:10.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.910+0000 7f04e3cd2700 1 -- 172.21.15.29:0/1370470029 wait complete. 2023-10-16T19:41:10.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.911+0000 7f04e3cd2700 1 Processor -- start 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.911+0000 7f04e3cd2700 1 -- start start 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04dc14c780 0x7f04dc1ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1ecfd0 con 0x7f04dc06a880 2023-10-16T19:41:10.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1ed2b0 con 0x7f04dc14c780 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e3cd2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c00f0 con 0x7f04dc0ac0a0 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53528/0 (socket says 172.21.15.29:53528) 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 -- 172.21.15.29:0/2764991716 learned_addr learned my addr 172.21.15.29:0/2764991716 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e126d700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e226f700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04dc14c780 0x7f04dc1ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 -- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 msgr2=0x7f04dc0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 -- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04dc14c780 msgr2=0x7f04dc1ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:10.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04dc14c780 0x7f04dc1ed740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 -- 172.21.15.29:0/2764991716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009b30 con 0x7f04dc06a880 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04e1a6e700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c580 tx=0x7f04d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.912+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004c80 con 0x7f04dc06a880 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.913+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8004e00 con 0x7f04dc06a880 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.913+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0c03d0 con 0x7f04dc06a880 2023-10-16T19:41:10.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.913+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8007310 con 0x7f04dc06a880 2023-10-16T19:41:10.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.913+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc144360 con 0x7f04dc06a880 2023-10-16T19:41:10.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.913+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc066df0 con 0x7f04dc06a880 2023-10-16T19:41:10.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.914+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04d8007470 con 0x7f04dc06a880 2023-10-16T19:41:10.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.914+0000 7f04d27fc700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 0x7f04c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:10.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.914+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f04d8089510 con 0x7f04dc06a880 2023-10-16T19:41:10.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.915+0000 7f04e126d700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 0x7f04c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:10.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.915+0000 7f04e126d700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 0x7f04c006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04dc152750 tx=0x7f04cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:10.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:10.919+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04d80543c0 con 0x7f04dc06a880 2023-10-16T19:41:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.165+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04dc1ed590 con 0x7f04dc06a880 2023-10-16T19:41:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.165+0000 7f04d27fc700 1 -- 172.21.15.29:0/2764991716 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f04d80579e0 con 0x7f04dc06a880 2023-10-16T19:41:11.168 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:11.168 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/628400601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":628400601},{"type":"v1","addr":"172.21.15.29:6835","nonce":628400601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/2394385366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2394385366},{"type":"v1","addr":"172.21.15.53:6836","nonce":2394385366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/848265449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":848265449},{"type":"v1","addr":"172.21.15.29:6834","nonce":848265449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:41:07.155742+0000","modified":"2023-10-16T19:41:10.167877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/4202647706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":4202647706},{"type":"v1","addr":"172.21.15.53:6837","nonce":4202647706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:41:11.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 msgr2=0x7f04c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 0x7f04c006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04dc152750 tx=0x7f04cc008040 comp rx=0 tx=0).stop 2023-10-16T19:41:11.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 msgr2=0x7f04dc070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c580 tx=0x7f04d800c940 comp rx=0 tx=0).stop 2023-10-16T19:41:11.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 shutdown_connections 2023-10-16T19:41:11.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f04c006af00 0x7f04c006d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04dc14c780 0x7f04dc1ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04dc06a880 0x7f04dc070aa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 --2- 172.21.15.29:0/2764991716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f04dc0ac0a0 0x7f04dc0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.167+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 >> 172.21.15.29:0/2764991716 conn(0x7f04dc0c66d0 msgr2=0x7f04dc148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.168+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 shutdown_connections 2023-10-16T19:41:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.168+0000 7f04e3cd2700 1 -- 172.21.15.29:0/2764991716 wait complete. 2023-10-16T19:41:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-16T19:41:11.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.305+0000 7f85f9504700 1 Processor -- start 2023-10-16T19:41:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.305+0000 7f85f9504700 1 -- start start 2023-10-16T19:41:11.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f9504700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85f40c8130 0x7f85f4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f9504700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85f40bd8c0 0x7f85f4155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f9504700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f40ca540 con 0x7f85f4151ea0 2023-10-16T19:41:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f9504700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f4158c80 con 0x7f85f40c8130 2023-10-16T19:41:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f9504700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f40ca790 con 0x7f85f40bd8c0 2023-10-16T19:41:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85f40c8130 0x7f85f4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f2ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f85f4151ea0 0x7f85f40c4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38980/0 (socket says 172.21.15.29:38980) 2023-10-16T19:41:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85f40c8130 0x7f85f4154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53538/0 (socket says 172.21.15.29:53538) 2023-10-16T19:41:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.306+0000 7f85f2ffd700 1 -- 172.21.15.29:0/2310011303 learned_addr learned my addr 172.21.15.29:0/2310011303 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f37fe700 1 --2- 172.21.15.29:0/2310011303 >> v2:172.21.15.53:3300/0 conn(0x7f85f40bd8c0 0x7f85f4155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f27fc700 1 -- 172.21.15.29:0/2310011303 >> v2:172.21.15.53:3300/0 conn(0x7f85f40bd8c0 msgr2=0x7f85f4155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f27fc700 1 --2- 172.21.15.29:0/2310011303 >> v2:172.21.15.53:3300/0 conn(0x7f85f40bd8c0 0x7f85f4155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f27fc700 1 -- 172.21.15.29:0/2310011303 >> v1:172.21.15.29:6789/0 conn(0x7f85f4151ea0 legacy=0x7f85f40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f1ffb700 1 -- 172.21.15.29:0/2310011303 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269420886 0 0) 0x7f85f40ca540 con 0x7f85f4151ea0 2023-10-16T19:41:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f27fc700 1 -- 172.21.15.29:0/2310011303 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40caa70 con 0x7f85f40c8130 2023-10-16T19:41:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f27fc700 1 --2- 172.21.15.29:0/2310011303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40c8130 0x7f85f4154b50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c8510 tx=0x7f85e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c41a91fc88d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f1ffb700 1 -- 172.21.15.29:0/2310011303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4011830 con 0x7f85f40c8130 2023-10-16T19:41:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f1ffb700 1 -- 172.21.15.29:0/2310011303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4011990 con 0x7f85f40c8130 2023-10-16T19:41:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f1ffb700 1 -- 172.21.15.29:0/2310011303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4011d20 con 0x7f85f40c8130 2023-10-16T19:41:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.307+0000 7f85f9504700 1 -- 172.21.15.29:0/2310011303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40c8130 msgr2=0x7f85f4154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 --2- 172.21.15.29:0/2310011303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40c8130 0x7f85f4154b50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c8510 tx=0x7f85e4009b20 comp rx=0 tx=0).stop 2023-10-16T19:41:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 -- 172.21.15.29:0/2310011303 shutdown_connections 2023-10-16T19:41:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 --2- 172.21.15.29:0/2310011303 >> v2:172.21.15.53:3300/0 conn(0x7f85f40bd8c0 0x7f85f4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 --2- 172.21.15.29:0/2310011303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40c8130 0x7f85f4154b50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 -- 172.21.15.29:0/2310011303 >> 172.21.15.29:0/2310011303 conn(0x7f85f4072190 msgr2=0x7f85f40725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 -- 172.21.15.29:0/2310011303 shutdown_connections 2023-10-16T19:41:11.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.308+0000 7f85f9504700 1 -- 172.21.15.29:0/2310011303 wait complete. 2023-10-16T19:41:11.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.309+0000 7f85f9504700 1 Processor -- start 2023-10-16T19:41:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.309+0000 7f85f9504700 1 -- start start 2023-10-16T19:41:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 0x7f85f40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 0x7f85f414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414d120 con 0x7f85f40bd8c0 2023-10-16T19:41:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f41edc70 con 0x7f85f40c8130 2023-10-16T19:41:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f41ed060 con 0x7f85f4151ea0 2023-10-16T19:41:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53542/0 (socket says 172.21.15.29:53542) 2023-10-16T19:41:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 -- 172.21.15.29:0/1263249260 learned_addr learned my addr 172.21.15.29:0/1263249260 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f27fc700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 0x7f85f40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f37fe700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 0x7f85f414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 -- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 msgr2=0x7f85f414c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 0x7f85f414c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 -- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 msgr2=0x7f85f40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 0x7f85f40af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 -- 172.21.15.29:0/1263249260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40094a0 con 0x7f85f40bd8c0 2023-10-16T19:41:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f27fc700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 0x7f85f40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f37fe700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 0x7f85f414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f2ffd700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85e80011e0 tx=0x7f85e800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8004c80 con 0x7f85f40bd8c0 2023-10-16T19:41:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e8004e00 con 0x7f85f40bd8c0 2023-10-16T19:41:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8007310 con 0x7f85f40bd8c0 2023-10-16T19:41:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f41ed340 con 0x7f85f40bd8c0 2023-10-16T19:41:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.310+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f41ed900 con 0x7f85f40bd8c0 2023-10-16T19:41:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.311+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f40b0210 con 0x7f85f40bd8c0 2023-10-16T19:41:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.312+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f85e8007470 con 0x7f85f40bd8c0 2023-10-16T19:41:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.312+0000 7f85db7fe700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 0x7f85e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.312+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f85e80894b0 con 0x7f85f40bd8c0 2023-10-16T19:41:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.313+0000 7f85f27fc700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 0x7f85e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.313+0000 7f85f27fc700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 0x7f85e006d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c8510 tx=0x7f85e401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.317+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85e8054410 con 0x7f85f40bd8c0 2023-10-16T19:41:11.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.519+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f404f400 con 0x7f85f40bd8c0 2023-10-16T19:41:11.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.520+0000 7f85db7fe700 1 -- 172.21.15.29:0/1263249260 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f85e8057a30 con 0x7f85f40bd8c0 2023-10-16T19:41:11.522 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:11.523 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":40,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:41:08.746449+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:41:04.991651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:41:06.133968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:11.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 msgr2=0x7f85e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 0x7f85e006d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c8510 tx=0x7f85e401c040 comp rx=0 tx=0).stop 2023-10-16T19:41:11.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 msgr2=0x7f85f40c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85e80011e0 tx=0x7f85e800cae0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 shutdown_connections 2023-10-16T19:41:11.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f85e006af00 0x7f85e006d3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85f4151ea0 0x7f85f414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85f40bd8c0 0x7f85f40c91f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 --2- 172.21.15.29:0/1263249260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85f40c8130 0x7f85f40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 >> 172.21.15.29:0/1263249260 conn(0x7f85f4072190 msgr2=0x7f85f40c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 shutdown_connections 2023-10-16T19:41:11.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.522+0000 7f85f9504700 1 -- 172.21.15.29:0/1263249260 wait complete. 2023-10-16T19:41:11.537 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T19:41:11.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:11.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.661+0000 7f449089d700 1 Processor -- start 2023-10-16T19:41:11.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.661+0000 7f449089d700 1 -- start start 2023-10-16T19:41:11.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c14ec50 0x7f448c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f448c0c3350 0x7f448c071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f448c071840 0x7f448c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c155af0 con 0x7f448c0c3350 2023-10-16T19:41:11.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c152300 con 0x7f448c071840 2023-10-16T19:41:11.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f449089d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0c2e40 con 0x7f448c14ec50 2023-10-16T19:41:11.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f448c0c3350 0x7f448c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f448c0c3350 0x7f448c071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53550/0 (socket says 172.21.15.29:53550) 2023-10-16T19:41:11.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 -- 172.21.15.29:0/3647944777 learned_addr learned my addr 172.21.15.29:0/3647944777 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:11.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f448a59c700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c14ec50 0x7f448c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f448ad9d700 1 --2- 172.21.15.29:0/3647944777 >> v2:172.21.15.53:3300/0 conn(0x7f448c071840 0x7f448c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 -- 172.21.15.29:0/3647944777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c14ec50 msgr2=0x7f448c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c14ec50 0x7f448c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 -- 172.21.15.29:0/3647944777 >> v2:172.21.15.53:3300/0 conn(0x7f448c071840 msgr2=0x7f448c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 --2- 172.21.15.29:0/3647944777 >> v2:172.21.15.53:3300/0 conn(0x7f448c071840 0x7f448c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 -- 172.21.15.29:0/3647944777 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c14f030 con 0x7f448c0c3350 2023-10-16T19:41:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f4489d9b700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c071300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f448c0c2d20 tx=0x7f4480009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5d28c83ece7d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f448959a700 1 -- 172.21.15.29:0/3647944777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480011830 con 0x7f448c0c3350 2023-10-16T19:41:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f448959a700 1 -- 172.21.15.29:0/3647944777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480011990 con 0x7f448c0c3350 2023-10-16T19:41:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.662+0000 7f448959a700 1 -- 172.21.15.29:0/3647944777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480011d20 con 0x7f448c0c3350 2023-10-16T19:41:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 -- 172.21.15.29:0/3647944777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 msgr2=0x7f448c071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c071300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f448c0c2d20 tx=0x7f4480009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 -- 172.21.15.29:0/3647944777 shutdown_connections 2023-10-16T19:41:11.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 --2- 172.21.15.29:0/3647944777 >> v2:172.21.15.53:3300/0 conn(0x7f448c071840 0x7f448c06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c14ec50 0x7f448c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 --2- 172.21.15.29:0/3647944777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c071300 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 -- 172.21.15.29:0/3647944777 >> 172.21.15.29:0/3647944777 conn(0x7f448c0c7110 msgr2=0x7f448c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 -- 172.21.15.29:0/3647944777 shutdown_connections 2023-10-16T19:41:11.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.663+0000 7f449089d700 1 -- 172.21.15.29:0/3647944777 wait complete. 2023-10-16T19:41:11.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.664+0000 7f449089d700 1 Processor -- start 2023-10-16T19:41:11.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.664+0000 7f449089d700 1 -- start start 2023-10-16T19:41:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c071840 0x7f448c1ea710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 0x7f448c06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0c5970 con 0x7f448c0c3350 2023-10-16T19:41:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1ed090 con 0x7f448c14ec50 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f449089d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1e9c30 con 0x7f448c071840 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f4489d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f4489d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53560/0 (socket says 172.21.15.29:53560) 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f4489d9b700 1 -- 172.21.15.29:0/565035361 learned_addr learned my addr 172.21.15.29:0/565035361 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f448a59c700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c071840 0x7f448c1ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.665+0000 7f448ad9d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 0x7f448c06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 -- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c071840 msgr2=0x7f448c1ea710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c071840 0x7f448c1ea710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 -- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 msgr2=0x7f448c06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 0x7f448c06de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 -- 172.21.15.29:0/565035361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009550 con 0x7f448c0c3350 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f448ad9d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 0x7f448c06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f4489d9b700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4480014040 tx=0x7f4480004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480004450 con 0x7f448c0c3350 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448001e070 con 0x7f448c0c3350 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800038e0 con 0x7f448c0c3350 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c1e9f10 con 0x7f448c0c3350 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.666+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0c52b0 con 0x7f448c0c3350 2023-10-16T19:41:11.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.667+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c04f400 con 0x7f448c0c3350 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.668+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4480003a40 con 0x7f448c0c3350 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.668+0000 7f447affd700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 0x7f446c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.668+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f448008a470 con 0x7f448c0c3350 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.668+0000 7f448a59c700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 0x7f446c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:11.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.669+0000 7f448a59c700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 0x7f446c06d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f448c14d7e0 tx=0x7f447c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:11.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.672+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4480055450 con 0x7f448c0c3350 2023-10-16T19:41:11.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.867+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f448c1519d0 con 0x7f446c06af00 2023-10-16T19:41:11.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.876+0000 7f447affd700 1 -- 172.21.15.29:0/565035361 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274507 (secure 0 0 0) 0x7f447c0117b0 con 0x7f446c06af00 2023-10-16T19:41:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 msgr2=0x7f446c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 0x7f446c06d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f448c14d7e0 tx=0x7f447c009210 comp rx=0 tx=0).stop 2023-10-16T19:41:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 msgr2=0x7f448c0c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4480014040 tx=0x7f4480004750 comp rx=0 tx=0).stop 2023-10-16T19:41:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 shutdown_connections 2023-10-16T19:41:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f446c06af00 0x7f446c06d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c14ec50 0x7f448c06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f448c071840 0x7f448c1ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 --2- 172.21.15.29:0/565035361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f448c0c3350 0x7f448c0c4d70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 >> 172.21.15.29:0/565035361 conn(0x7f448c0c7110 msgr2=0x7f448c14d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 shutdown_connections 2023-10-16T19:41:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:11.879+0000 7f449089d700 1 -- 172.21.15.29:0/565035361 wait complete. 2023-10-16T19:41:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:11.893 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-16T19:41:10.576371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220604,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754116,"statfs":{"total":773094113280,"available":772868214784,"internally_reserved":0,"allocated":4497408,"data_stored":2564952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.846848"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.012640+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:00.012640+0000","last_peered":"2023-10-16T19:41:00.012640+0000","last_clean":"2023-10-16T19:41:00.012640+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:00.012640+0000","last_undegraded":"2023-10-16T19:41:00.012640+0000","last_fullsized":"2023-10-16T19:41:00.012640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":763395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.502}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.746}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.623}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.435},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.5},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":763395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.309},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.37}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.39800000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.44},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.5}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.87},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.442}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.626},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:11.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:12.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.056+0000 7fac5f4ab700 1 Processor -- start 2023-10-16T19:41:12.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.056+0000 7fac5f4ab700 1 -- start start 2023-10-16T19:41:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5f4ab700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac580c3350 0x7fac581555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5f4ab700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac5806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5f4ab700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac58155af0 con 0x7fac5814ec50 2023-10-16T19:41:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5f4ab700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac58152300 con 0x7fac580c3350 2023-10-16T19:41:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5f4ab700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c2e40 con 0x7fac5806db00 2023-10-16T19:41:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5d247700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fac5814ec50 0x7fac58071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39008/0 (socket says 172.21.15.29:39008) 2023-10-16T19:41:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.057+0000 7fac5d247700 1 -- 172.21.15.29:0/1645703646 learned_addr learned my addr 172.21.15.29:0/1645703646 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 --2- 172.21.15.29:0/1645703646 >> v2:172.21.15.53:3300/0 conn(0x7fac580c3350 0x7fac581555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5da48700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac5806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052884847 0 0) 0x7fac48001110 con 0x7fac5814ec50 2023-10-16T19:41:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac440035b0 con 0x7fac5814ec50 2023-10-16T19:41:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1210080290 0 0) 0x7fac440035b0 con 0x7fac5814ec50 2023-10-16T19:41:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 msgr2=0x7fac5806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac5806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 >> v2:172.21.15.53:3300/0 conn(0x7fac580c3350 msgr2=0x7fac581555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 --2- 172.21.15.29:0/1645703646 >> v2:172.21.15.53:3300/0 conn(0x7fac580c3350 0x7fac581555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5814f030 con 0x7fac5814ec50 2023-10-16T19:41:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fac48001800 con 0x7fac5814ec50 2023-10-16T19:41:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 >> v1:172.21.15.29:6789/0 conn(0x7fac5814ec50 legacy=0x7fac58071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac44003a00 0x7fac44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac44004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac44005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac58152300 con 0x7fac44004850 2023-10-16T19:41:12.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c2e40 con 0x7fac44003a00 2023-10-16T19:41:12.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400ba10 con 0x7fac5806db00 2023-10-16T19:41:12.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac44004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5d247700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac44003a00 0x7fac44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5da48700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac44005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 -- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 msgr2=0x7fac44005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac5806db00 0x7fac44005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 -- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac44003a00 msgr2=0x7fac44003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac44003a00 0x7fac44003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.058+0000 7fac5ca46700 1 -- 172.21.15.29:0/1645703646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440035b0 con 0x7fac44004850 2023-10-16T19:41:12.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5ca46700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac44004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fac54009b60 tx=0x7fac44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9709a9981a963468 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400e6c0 con 0x7fac44004850 2023-10-16T19:41:12.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400e820 con 0x7fac44004850 2023-10-16T19:41:12.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac4ffff700 1 -- 172.21.15.29:0/1645703646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400eb90 con 0x7fac44004850 2023-10-16T19:41:12.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5f4ab700 1 -- 172.21.15.29:0/1645703646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 msgr2=0x7fac44004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/1645703646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac44004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fac54009b60 tx=0x7fac44005880 comp rx=0 tx=0).stop 2023-10-16T19:41:12.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5da48700 1 -- 172.21.15.29:0/1645703646 reap_dead start 2023-10-16T19:41:12.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5f4ab700 1 -- 172.21.15.29:0/1645703646 shutdown_connections 2023-10-16T19:41:12.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.059+0000 7fac5f4ab700 1 -- 172.21.15.29:0/1645703646 >> 172.21.15.29:0/1645703646 conn(0x7fac580c7110 msgr2=0x7fac580c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.060+0000 7fac5f4ab700 1 -- 172.21.15.29:0/1645703646 shutdown_connections 2023-10-16T19:41:12.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.060+0000 7fac5f4ab700 1 -- 172.21.15.29:0/1645703646 wait complete. 2023-10-16T19:41:12.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.061+0000 7fac5f4ab700 1 Processor -- start 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.061+0000 7fac5f4ab700 1 -- start start 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 0x7fac581448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 0x7fac581e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac581e9450 con 0x7fac44004850 2023-10-16T19:41:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac58145260 con 0x7fac58144de0 2023-10-16T19:41:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5f4ab700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac581e8e20 con 0x7fac581dac40 2023-10-16T19:41:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53576/0 (socket says 172.21.15.29:53576) 2023-10-16T19:41:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 -- 172.21.15.29:0/2924255030 learned_addr learned my addr 172.21.15.29:0/2924255030 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5da48700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 0x7fac581e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5ca46700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 0x7fac581448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 -- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 msgr2=0x7fac581448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 0x7fac581448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 -- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 msgr2=0x7fac581e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 0x7fac581e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5d247700 1 -- 172.21.15.29:0/2924255030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac581eb9d0 con 0x7fac44004850 2023-10-16T19:41:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5da48700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 0x7fac581e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.062+0000 7fac5ca46700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 0x7fac581448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac5d247700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac48007310 tx=0x7fac48007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800f6c0 con 0x7fac44004850 2023-10-16T19:41:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800f860 con 0x7fac44004850 2023-10-16T19:41:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac581ebcb0 con 0x7fac44004850 2023-10-16T19:41:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800fc10 con 0x7fac44004850 2023-10-16T19:41:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.063+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac581513f0 con 0x7fac44004850 2023-10-16T19:41:12.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.064+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac581e96c0 con 0x7fac44004850 2023-10-16T19:41:12.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.064+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac4800fd70 con 0x7fac44004850 2023-10-16T19:41:12.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.065+0000 7fac4dffb700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 0x7fac3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.065+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fac48089580 con 0x7fac44004850 2023-10-16T19:41:12.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.065+0000 7fac5ca46700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 0x7fac3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.066+0000 7fac5ca46700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 0x7fac3c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac58155900 tx=0x7fac5401e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.069+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac48054620 con 0x7fac44004850 2023-10-16T19:41:12.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.265+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac581519d0 con 0x7fac3c06af00 2023-10-16T19:41:12.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.273+0000 7fac4dffb700 1 -- 172.21.15.29:0/2924255030 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274507 (secure 0 0 0) 0x7fac5400ea90 con 0x7fac3c06af00 2023-10-16T19:41:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:12.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.276+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 msgr2=0x7fac3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.276+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 0x7fac3c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac58155900 tx=0x7fac5401e040 comp rx=0 tx=0).stop 2023-10-16T19:41:12.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.276+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 msgr2=0x7fac58150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.276+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac48007310 tx=0x7fac48007620 comp rx=0 tx=0).stop 2023-10-16T19:41:12.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 shutdown_connections 2023-10-16T19:41:12.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fac3c06af00 0x7fac3c06d3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac58144de0 0x7fac581e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac44004850 0x7fac58150eb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 --2- 172.21.15.29:0/2924255030 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fac581dac40 0x7fac581448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 >> 172.21.15.29:0/2924255030 conn(0x7fac580c7110 msgr2=0x7fac580c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 shutdown_connections 2023-10-16T19:41:12.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.277+0000 7fac5f4ab700 1 -- 172.21.15.29:0/2924255030 wait complete. 2023-10-16T19:41:12.283 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:12.291 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-16T19:41:10.576371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220604,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754116,"statfs":{"total":773094113280,"available":772868214784,"internally_reserved":0,"allocated":4497408,"data_stored":2564952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.846848"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:06.729245+0000","last_change":"2023-10-16T19:41:06.729245+0000","last_active":"2023-10-16T19:41:06.729245+0000","last_peered":"2023-10-16T19:41:06.729245+0000","last_clean":"2023-10-16T19:41:06.729245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:06.729245+0000","last_undegraded":"2023-10-16T19:41:06.729245+0000","last_fullsized":"2023-10-16T19:41:06.729245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:41:05.724433+0000","last_change":"2023-10-16T19:41:05.724433+0000","last_active":"2023-10-16T19:41:05.724433+0000","last_peered":"2023-10-16T19:41:05.724433+0000","last_clean":"2023-10-16T19:41:05.724433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:41:05.724433+0000","last_undegraded":"2023-10-16T19:41:05.724433+0000","last_fullsized":"2023-10-16T19:41:05.724433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-16T19:41:00.012640+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:00.012640+0000","last_peered":"2023-10-16T19:41:00.012640+0000","last_clean":"2023-10-16T19:41:00.012640+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:00.012640+0000","last_undegraded":"2023-10-16T19:41:00.012640+0000","last_fullsized":"2023-10-16T19:41:00.012640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":763395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.502}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.746}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.623}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.435},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.5},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":763395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.29199999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.309},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.37}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.39800000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.44},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41199999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.26100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.435}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.5}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.87},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.442}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.626},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:12.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:12.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.453+0000 7f212ddae700 1 Processor -- start 2023-10-16T19:41:12.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 -- start start 2023-10-16T19:41:12.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f212806f6e0 0x7f2128156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21280c18b0 0x7f212814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 0x7f2128152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2128152780 con 0x7f212806f6e0 2023-10-16T19:41:12.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21281503c0 con 0x7f21280c18b0 2023-10-16T19:41:12.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f212ddae700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280724a0 con 0x7f212814ff30 2023-10-16T19:41:12.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.454+0000 7f21277fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f212806f6e0 0x7f2128156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f212806f6e0 0x7f2128156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53582/0 (socket says 172.21.15.29:53582) 2023-10-16T19:41:12.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 -- 172.21.15.29:0/341684900 learned_addr learned my addr 172.21.15.29:0/341684900 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:12.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f2126ffd700 1 --2- 172.21.15.29:0/341684900 >> v2:172.21.15.53:3300/0 conn(0x7f21280c18b0 0x7f212814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f2127fff700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 0x7f2128152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 -- 172.21.15.29:0/341684900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 msgr2=0x7f2128152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 0x7f2128152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 -- 172.21.15.29:0/341684900 >> v2:172.21.15.53:3300/0 conn(0x7f21280c18b0 msgr2=0x7f212814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 --2- 172.21.15.29:0/341684900 >> v2:172.21.15.53:3300/0 conn(0x7f21280c18b0 0x7f212814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 -- 172.21.15.29:0/341684900 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280c2660 con 0x7f212806f6e0 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f2127fff700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 0x7f2128152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21277fe700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212806f6e0 0x7f2128156670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f212806b8c0 tx=0x7f2118009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886431dbb27c1365 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21267fc700 1 -- 172.21.15.29:0/341684900 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011830 con 0x7f212806f6e0 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21267fc700 1 -- 172.21.15.29:0/341684900 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011990 con 0x7f212806f6e0 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.455+0000 7f21267fc700 1 -- 172.21.15.29:0/341684900 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011d20 con 0x7f212806f6e0 2023-10-16T19:41:12.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 -- 172.21.15.29:0/341684900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212806f6e0 msgr2=0x7f2128156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212806f6e0 0x7f2128156670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f212806b8c0 tx=0x7f2118009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 -- 172.21.15.29:0/341684900 shutdown_connections 2023-10-16T19:41:12.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212806f6e0 0x7f2128156670 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 --2- 172.21.15.29:0/341684900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212814ff30 0x7f2128152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 --2- 172.21.15.29:0/341684900 >> v2:172.21.15.53:3300/0 conn(0x7f21280c18b0 0x7f212814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 -- 172.21.15.29:0/341684900 >> 172.21.15.29:0/341684900 conn(0x7f21280c7110 msgr2=0x7f21280c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 -- 172.21.15.29:0/341684900 shutdown_connections 2023-10-16T19:41:12.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.456+0000 7f212ddae700 1 -- 172.21.15.29:0/341684900 wait complete. 2023-10-16T19:41:12.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.457+0000 7f212ddae700 1 Processor -- start 2023-10-16T19:41:12.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 -- start start 2023-10-16T19:41:12.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212806f6e0 0x7f21281565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280c18b0 0x7f21281eb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128156160 con 0x7f212814ff30 2023-10-16T19:41:12.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281eb660 con 0x7f21280c18b0 2023-10-16T19:41:12.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.458+0000 7f212ddae700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6ce0 con 0x7f212806f6e0 2023-10-16T19:41:12.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53592/0 (socket says 172.21.15.29:53592) 2023-10-16T19:41:12.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 -- 172.21.15.29:0/902041441 learned_addr learned my addr 172.21.15.29:0/902041441 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:12.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f21277fe700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212806f6e0 0x7f21281565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2126ffd700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280c18b0 0x7f21281eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 -- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212806f6e0 msgr2=0x7f21281565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212806f6e0 0x7f21281565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 -- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280c18b0 msgr2=0x7f21281eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280c18b0 0x7f21281eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 -- 172.21.15.29:0/902041441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009550 con 0x7f212814ff30 2023-10-16T19:41:12.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f2127fff700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2120007df0 tx=0x7f212000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000dd20 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000f040 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c6a00 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120003cb0 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.459+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128155df0 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.460+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128156310 con 0x7f212814ff30 2023-10-16T19:41:12.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.461+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2120004030 con 0x7f212814ff30 2023-10-16T19:41:12.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.461+0000 7f210ffff700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 0x7f211406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.461+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2120089630 con 0x7f212814ff30 2023-10-16T19:41:12.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.462+0000 7f21277fe700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 0x7f211406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.462+0000 7f21277fe700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 0x7f211406d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2118009c10 tx=0x7f2118008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.466+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2128156310 con 0x7f212814ff30 2023-10-16T19:41:12.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.661+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21280a8770 con 0x7f211406af30 2023-10-16T19:41:12.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.669+0000 7f210ffff700 1 -- 172.21.15.29:0/902041441 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289343 (secure 0 0 0) 0x7f2118011b00 con 0x7f211406af30 2023-10-16T19:41:12.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:12.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 msgr2=0x7f211406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 0x7f211406d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2118009c10 tx=0x7f2118008030 comp rx=0 tx=0).stop 2023-10-16T19:41:12.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 msgr2=0x7f212814d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2120007df0 tx=0x7f212000d3b0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 shutdown_connections 2023-10-16T19:41:12.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f211406af30 0x7f211406d3f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f212814ff30 0x7f212814d990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f212806f6e0 0x7f21281565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 --2- 172.21.15.29:0/902041441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280c18b0 0x7f21281eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 >> 172.21.15.29:0/902041441 conn(0x7f21280c7110 msgr2=0x7f212814ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 shutdown_connections 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.673+0000 7f212ddae700 1 -- 172.21.15.29:0/902041441 wait complete. 2023-10-16T19:41:12.679 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:12.687 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-16T19:41:12.576967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.70299999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.433},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.628},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.379},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.433},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.504},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.378}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.434},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.81699999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70099999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.747}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.627},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.222},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.31900000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.379},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67500000000000004}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53000000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:12.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T19:41:12.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.850+0000 7f536efa3700 1 Processor -- start 2023-10-16T19:41:12.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.850+0000 7f536efa3700 1 -- start start 2023-10-16T19:41:12.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536efa3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5368158570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536efa3700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5368158ab0 0x7f5368151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536efa3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5368158eb0 con 0x7f536806aaf0 2023-10-16T19:41:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536efa3700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680c1b60 con 0x7f5368158ab0 2023-10-16T19:41:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536efa3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c1e40 con 0x7f53680c2760 2023-10-16T19:41:12.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536cd3f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f536806aaf0 0x7f536806d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39040/0 (socket says 172.21.15.29:39040) 2023-10-16T19:41:12.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.851+0000 7f536cd3f700 1 -- 172.21.15.29:0/1380818348 learned_addr learned my addr 172.21.15.29:0/1380818348 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:12.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 --2- 172.21.15.29:0/1380818348 >> v2:172.21.15.53:3300/0 conn(0x7f5368158ab0 0x7f5368151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f5367fff700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5368158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208531898 0 0) 0x7f5368158eb0 con 0x7f536806aaf0 2023-10-16T19:41:12.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53580035b0 con 0x7f536806aaf0 2023-10-16T19:41:12.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148939298 0 0) 0x7f53580035b0 con 0x7f536806aaf0 2023-10-16T19:41:12.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 msgr2=0x7f5368158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5368158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 >> v2:172.21.15.53:3300/0 conn(0x7f5368158ab0 msgr2=0x7f5368151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 --2- 172.21.15.29:0/1380818348 >> v2:172.21.15.53:3300/0 conn(0x7f5368158ab0 0x7f5368151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680c2120 con 0x7f536806aaf0 2023-10-16T19:41:12.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f535c001670 con 0x7f536806aaf0 2023-10-16T19:41:12.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 >> v1:172.21.15.29:6789/0 conn(0x7f536806aaf0 legacy=0x7f536806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5358003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5358003f80 0x7f5358004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5358004d90 0x7f5358005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c1b60 con 0x7f5358004d90 2023-10-16T19:41:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c1e40 con 0x7f5358003f80 2023-10-16T19:41:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535800ba10 con 0x7f53680c2760 2023-10-16T19:41:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5358004d90 0x7f5358005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536cd3f700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5358003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f5367fff700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5358003f80 0x7f5358004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 -- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 msgr2=0x7f5358003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53680c2760 0x7f5358003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 -- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5358003f80 msgr2=0x7f5358004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5358003f80 0x7f5358004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.852+0000 7f536d540700 1 -- 172.21.15.29:0/1380818348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580035b0 con 0x7f5358004d90 2023-10-16T19:41:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536d540700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5358004d90 0x7f5358005210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5360009fc0 tx=0x7f5358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec2817fccaa19b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000ebd0 con 0x7f5358004d90 2023-10-16T19:41:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536000f040 con 0x7f5358004d90 2023-10-16T19:41:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f53677fe700 1 -- 172.21.15.29:0/1380818348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360014480 con 0x7f5358004d90 2023-10-16T19:41:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 -- 172.21.15.29:0/1380818348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5358004d90 msgr2=0x7f5358005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 --2- 172.21.15.29:0/1380818348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5358004d90 0x7f5358005210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5360009fc0 tx=0x7f5358005880 comp rx=0 tx=0).stop 2023-10-16T19:41:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536d540700 1 -- 172.21.15.29:0/1380818348 reap_dead start 2023-10-16T19:41:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 -- 172.21.15.29:0/1380818348 shutdown_connections 2023-10-16T19:41:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 -- 172.21.15.29:0/1380818348 >> 172.21.15.29:0/1380818348 conn(0x7f53680c7100 msgr2=0x7f53680c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 -- 172.21.15.29:0/1380818348 shutdown_connections 2023-10-16T19:41:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.853+0000 7f536efa3700 1 -- 172.21.15.29:0/1380818348 wait complete. 2023-10-16T19:41:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.855+0000 7f536efa3700 1 Processor -- start 2023-10-16T19:41:12.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.855+0000 7f536efa3700 1 -- start start 2023-10-16T19:41:12.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.855+0000 7f536efa3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.855+0000 7f536efa3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53681eccb0 0x7f53681ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.855+0000 7f536efa3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53681502a0 0x7f53680be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536efa3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681e9970 con 0x7f536814fec0 2023-10-16T19:41:12.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536efa3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c1110 con 0x7f53681eccb0 2023-10-16T19:41:12.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536efa3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c0870 con 0x7f53681502a0 2023-10-16T19:41:12.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53608/0 (socket says 172.21.15.29:53608) 2023-10-16T19:41:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 -- 172.21.15.29:0/2480083778 learned_addr learned my addr 172.21.15.29:0/2480083778 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f5367fff700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53681eccb0 0x7f53681ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536d540700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53681502a0 0x7f53680be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 -- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53681502a0 msgr2=0x7f53680be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53681502a0 0x7f53680be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 -- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53681eccb0 msgr2=0x7f53681ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:12.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53681eccb0 0x7f53681ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:12.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 -- 172.21.15.29:0/2480083778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680c0b50 con 0x7f536814fec0 2023-10-16T19:41:12.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536cd3f700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f535c000fb0 tx=0x7f535c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c004e60 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00f8a0 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53680c0e30 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00fc50 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.856+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368157e80 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.857+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53681542c0 con 0x7f536814fec0 2023-10-16T19:41:12.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.858+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f535c01d460 con 0x7f536814fec0 2023-10-16T19:41:12.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.858+0000 7f53657fa700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:12.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.858+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f535c089680 con 0x7f536814fec0 2023-10-16T19:41:12.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.859+0000 7f5367fff700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:12.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.859+0000 7f5367fff700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 0x7f534c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5354009be0 tx=0x7f5354009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:12.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:12.863+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f535c0545d0 con 0x7f536814fec0 2023-10-16T19:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.151+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5368157e80 con 0x7f536814fec0 2023-10-16T19:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.151+0000 7f53657fa700 1 -- 172.21.15.29:0/2480083778 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7f5368157e80 con 0x7f536814fec0 2023-10-16T19:41:13.153 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:13.154 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1697485184,"num_in_osds":8,"osd_in_since":1697485177,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226328576,"bytes_avail":772867784704,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5247}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-16T19:40:54.572425+0000","services":{}},"progress_events":{}} 2023-10-16T19:41:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 msgr2=0x7f534c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 0x7f534c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5354009be0 tx=0x7f5354009210 comp rx=0 tx=0).stop 2023-10-16T19:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 msgr2=0x7f53681e9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f535c000fb0 tx=0x7f535c007eb0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 shutdown_connections 2023-10-16T19:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f534c06af00 0x7f534c06d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53681502a0 0x7f53680be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536814fec0 0x7f53681e9dc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 --2- 172.21.15.29:0/2480083778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53681eccb0 0x7f53681ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 >> 172.21.15.29:0/2480083778 conn(0x7f53680c7100 msgr2=0x7f5368153bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:13.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 shutdown_connections 2023-10-16T19:41:13.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.153+0000 7f536efa3700 1 -- 172.21.15.29:0/2480083778 wait complete. 2023-10-16T19:41:13.167 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T19:41:13.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:13.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.291+0000 7f178a5d2700 1 Processor -- start 2023-10-16T19:41:13.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.291+0000 7f178a5d2700 1 -- start start 2023-10-16T19:41:13.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f178a5d2700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1784072b00 0x7f1784158860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f178a5d2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840bfa20 con 0x7f178406a8f0 2023-10-16T19:41:13.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f178a5d2700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840c05a0 con 0x7f178406b8a0 2023-10-16T19:41:13.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f178a5d2700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840bfc70 con 0x7f1784072b00 2023-10-16T19:41:13.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f17837fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f178406a8f0 0x7f1784158150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39060/0 (socket says 172.21.15.29:39060) 2023-10-16T19:41:13.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f17837fe700 1 -- 172.21.15.29:0/4164999105 learned_addr learned my addr 172.21.15.29:0/4164999105 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:13.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1788b6f700 1 --2- 172.21.15.29:0/4164999105 >> v2:172.21.15.53:3300/0 conn(0x7f1784072b00 0x7f1784158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980241645 0 0) 0x7f17840bfa20 con 0x7f178406a8f0 2023-10-16T19:41:13.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17700035b0 con 0x7f178406a8f0 2023-10-16T19:41:13.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653508116 0 0) 0x7f17700035b0 con 0x7f178406a8f0 2023-10-16T19:41:13.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 >> v2:172.21.15.53:3300/0 conn(0x7f1784072b00 msgr2=0x7f1784158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:13.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 --2- 172.21.15.29:0/4164999105 >> v2:172.21.15.53:3300/0 conn(0x7f1784072b00 0x7f1784158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 >> v1:172.21.15.53:6789/0 conn(0x7f178406b8a0 legacy=0x7f1784151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840bff50 con 0x7f178406a8f0 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f1774001670 con 0x7f178406a8f0 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 >> v1:172.21.15.29:6789/0 conn(0x7f178406a8f0 legacy=0x7f1784158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.292+0000 7f1782ffd700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 0x7f1770003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1770004850 0x7f1770004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770005210 0x7f177000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840bfc70 con 0x7f1770003a00 2023-10-16T19:41:13.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177000c1b0 con 0x7f1770004850 2023-10-16T19:41:13.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177000c370 con 0x7f1770005210 2023-10-16T19:41:13.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 0x7f1770003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f17837fe700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1770004850 0x7f1770004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1788b6f700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770005210 0x7f177000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 -- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770005210 msgr2=0x7f177000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770005210 0x7f177000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 -- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1770004850 msgr2=0x7f1770004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1770004850 0x7f1770004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 -- 172.21.15.29:0/4164999105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700035b0 con 0x7f1770003a00 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f17837fe700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1770004850 0x7f1770004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1788b6f700 1 -- 172.21.15.29:0/4164999105 reap_dead start 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1783fff700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 0x7f1770003e20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f176c0017c0 tx=0x7f1770005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebacb1a1fed502b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0052d0 con 0x7f1770003a00 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c005430 con 0x7f1770003a00 2023-10-16T19:41:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.293+0000 7f1782ffd700 1 -- 172.21.15.29:0/4164999105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0038c0 con 0x7f1770003a00 2023-10-16T19:41:13.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 -- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 msgr2=0x7f1770003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 0x7f1770003e20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f176c0017c0 tx=0x7f1770005880 comp rx=0 tx=0).stop 2023-10-16T19:41:13.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 -- 172.21.15.29:0/4164999105 shutdown_connections 2023-10-16T19:41:13.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 --2- 172.21.15.29:0/4164999105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1770003a00 0x7f1770003e20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 -- 172.21.15.29:0/4164999105 >> 172.21.15.29:0/4164999105 conn(0x7f17840c66d0 msgr2=0x7f17840c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 -- 172.21.15.29:0/4164999105 shutdown_connections 2023-10-16T19:41:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.294+0000 7f178a5d2700 1 -- 172.21.15.29:0/4164999105 wait complete. 2023-10-16T19:41:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.295+0000 7f178a5d2700 1 Processor -- start 2023-10-16T19:41:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.295+0000 7f178a5d2700 1 -- start start 2023-10-16T19:41:13.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770003a00 0x7f17841562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17840c5c90 0x7f1784147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784156ec0 con 0x7f17840abf70 2023-10-16T19:41:13.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784156c20 con 0x7f17840c5c90 2023-10-16T19:41:13.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f178a5d2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17841ed790 con 0x7f1770003a00 2023-10-16T19:41:13.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f17837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17840c5c90 0x7f1784147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53632/0 (socket says 172.21.15.29:53632) 2023-10-16T19:41:13.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 -- 172.21.15.29:0/2360279727 learned_addr learned my addr 172.21.15.29:0/2360279727 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:13.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1783fff700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770003a00 0x7f17841562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 -- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770003a00 msgr2=0x7f17841562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770003a00 0x7f17841562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 -- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17840c5c90 msgr2=0x7f1784147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17840c5c90 0x7f1784147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.296+0000 7f1788b6f700 1 -- 172.21.15.29:0/2360279727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840c48f0 con 0x7f17840abf70 2023-10-16T19:41:13.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f1788b6f700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f178406b3c0 tx=0x7f177c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00e070 con 0x7f17840abf70 2023-10-16T19:41:13.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c003cf0 con 0x7f17840abf70 2023-10-16T19:41:13.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784150690 con 0x7f17840abf70 2023-10-16T19:41:13.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0116d0 con 0x7f17840abf70 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.297+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784156820 con 0x7f17840abf70 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.298+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17841ed5f0 con 0x7f17840abf70 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.298+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f177c011830 con 0x7f17840abf70 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.298+0000 7f1780ff9700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 0x7f176406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.299+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f177c0899e0 con 0x7f17840abf70 2023-10-16T19:41:13.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.299+0000 7f1783fff700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 0x7f176406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:13.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.299+0000 7f1783fff700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 0x7f176406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f176c000c00 tx=0x7f176c009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:13.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.303+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17841ed5f0 con 0x7f17840abf70 2023-10-16T19:41:13.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.499+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1784156a10 con 0x7f176406af00 2023-10-16T19:41:13.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.508+0000 7f1780ff9700 1 -- 172.21.15.29:0/2360279727 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289343 (secure 0 0 0) 0x7f1784156a10 con 0x7f176406af00 2023-10-16T19:41:13.515 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:13.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 msgr2=0x7f176406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 0x7f176406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f176c000c00 tx=0x7f176c009030 comp rx=0 tx=0).stop 2023-10-16T19:41:13.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 msgr2=0x7f1784147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:13.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f178406b3c0 tx=0x7f177c009f70 comp rx=0 tx=0).stop 2023-10-16T19:41:13.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 shutdown_connections 2023-10-16T19:41:13.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f176406af00 0x7f176406d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17840abf70 0x7f1784147540 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1770003a00 0x7f17841562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 --2- 172.21.15.29:0/2360279727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17840c5c90 0x7f1784147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 >> 172.21.15.29:0/2360279727 conn(0x7f17840c66d0 msgr2=0x7f17840718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 shutdown_connections 2023-10-16T19:41:13.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:13.511+0000 7f178a5d2700 1 -- 172.21.15.29:0/2360279727 wait complete. 2023-10-16T19:41:13.522 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:13.525 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-16T19:41:12.576967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.70299999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.433},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.628},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.379},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.433},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.47099999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.504},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.378}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.434},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.81699999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70099999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.747}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.627},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.222},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.31900000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.379},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67500000000000004}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53000000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:16.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:16.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.677+0000 7fbd35cf8700 1 Processor -- start 2023-10-16T19:41:16.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.677+0000 7fbd35cf8700 1 -- start start 2023-10-16T19:41:16.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd35cf8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd301583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd35cf8700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd3013dd00 0x7fbd30158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd35cf8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd30158e40 con 0x7fbd3013d660 2023-10-16T19:41:16.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd35cf8700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3006d320 con 0x7fbd3013dd00 2023-10-16T19:41:16.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd35cf8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3006e780 con 0x7fbd30154a50 2023-10-16T19:41:16.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd2f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd3013d660 0x7fbd3006a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39080/0 (socket says 172.21.15.29:39080) 2023-10-16T19:41:16.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.678+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/3198446324 learned_addr learned my addr 172.21.15.29:0/3198446324 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:16.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723502840 0 0) 0x7fbd30158e40 con 0x7fbd3013d660 2023-10-16T19:41:16.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2effd700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd301583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2ffff700 1 --2- 172.21.15.29:0/3198446324 >> v2:172.21.15.53:3300/0 conn(0x7fbd3013dd00 0x7fbd30158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd180035b0 con 0x7fbd3013d660 2023-10-16T19:41:16.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934052574 0 0) 0x7fbd180035b0 con 0x7fbd3013d660 2023-10-16T19:41:16.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 msgr2=0x7fbd301583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:16.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd301583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 >> v2:172.21.15.53:3300/0 conn(0x7fbd3013dd00 msgr2=0x7fbd30158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:16.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 --2- 172.21.15.29:0/3198446324 >> v2:172.21.15.53:3300/0 conn(0x7fbd3013dd00 0x7fbd30158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30154f10 con 0x7fbd3013d660 2023-10-16T19:41:16.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fbd20001670 con 0x7fbd3013d660 2023-10-16T19:41:16.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 >> v1:172.21.15.29:6789/0 conn(0x7fbd3013d660 legacy=0x7fbd3006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18004d90 0x7fbd18005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3006d320 con 0x7fbd18003a00 2023-10-16T19:41:16.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3006e780 con 0x7fbd18004d90 2023-10-16T19:41:16.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1800ba10 con 0x7fbd30154a50 2023-10-16T19:41:16.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2ffff700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18004d90 0x7fbd18005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.679+0000 7fbd2effd700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 msgr2=0x7fbd18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:16.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18004d90 msgr2=0x7fbd18005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:16.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18004d90 0x7fbd18005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/3198446324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180035b0 con 0x7fbd18003a00 2023-10-16T19:41:16.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2ffff700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18004d90 0x7fbd18005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:16.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2effd700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd30154a50 0x7fbd18004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:16.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd18003e20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c370 tx=0x7fbd18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e084c554d82f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007c60 con 0x7fbd18003a00 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20005960 con 0x7fbd18003a00 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2e7fc700 1 -- 172.21.15.29:0/3198446324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20005d10 con 0x7fbd18003a00 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd35cf8700 1 -- 172.21.15.29:0/3198446324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 msgr2=0x7fbd18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/3198446324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd18003e20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c370 tx=0x7fbd18005880 comp rx=0 tx=0).stop 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd2ffff700 1 -- 172.21.15.29:0/3198446324 reap_dead start 2023-10-16T19:41:16.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd35cf8700 1 -- 172.21.15.29:0/3198446324 shutdown_connections 2023-10-16T19:41:16.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.680+0000 7fbd35cf8700 1 -- 172.21.15.29:0/3198446324 >> 172.21.15.29:0/3198446324 conn(0x7fbd300c7110 msgr2=0x7fbd300c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:16.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.681+0000 7fbd35cf8700 1 -- 172.21.15.29:0/3198446324 shutdown_connections 2023-10-16T19:41:16.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.681+0000 7fbd35cf8700 1 -- 172.21.15.29:0/3198446324 wait complete. 2023-10-16T19:41:16.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.682+0000 7fbd35cf8700 1 Processor -- start 2023-10-16T19:41:16.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.682+0000 7fbd35cf8700 1 -- start start 2023-10-16T19:41:16.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd301eaa20 0x7fbd30155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd301326f0 0x7fbd30132b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301eaea0 con 0x7fbd18003a00 2023-10-16T19:41:16.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30155cc0 con 0x7fbd301eaa20 2023-10-16T19:41:16.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301330b0 con 0x7fbd301326f0 2023-10-16T19:41:16.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53648/0 (socket says 172.21.15.29:53648) 2023-10-16T19:41:16.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/1794136268 learned_addr learned my addr 172.21.15.29:0/1794136268 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:16.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2effd700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd301eaa20 0x7fbd30155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2ffff700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd301326f0 0x7fbd30132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd301326f0 msgr2=0x7fbd30132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd301326f0 0x7fbd30132b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd301eaa20 msgr2=0x7fbd30155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd301eaa20 0x7fbd30155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 -- 172.21.15.29:0/1794136268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30157720 con 0x7fbd18003a00 2023-10-16T19:41:16.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd2f7fe700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c960 tx=0x7fbd20000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004a70 con 0x7fbd18003a00 2023-10-16T19:41:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20004bf0 con 0x7fbd18003a00 2023-10-16T19:41:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd30157970 con 0x7fbd18003a00 2023-10-16T19:41:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.683+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20005b50 con 0x7fbd18003a00 2023-10-16T19:41:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.684+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301e9f40 con 0x7fbd18003a00 2023-10-16T19:41:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.685+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd300c3780 con 0x7fbd18003a00 2023-10-16T19:41:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.685+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd200070d0 con 0x7fbd18003a00 2023-10-16T19:41:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.685+0000 7fbd17fff700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 0x7fbd1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.685+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbd2008abe0 con 0x7fbd18003a00 2023-10-16T19:41:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.686+0000 7fbd2effd700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 0x7fbd1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.686+0000 7fbd2effd700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 0x7fbd1c06d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd301e7c70 tx=0x7fbd24008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:16.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.690+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd20055bc0 con 0x7fbd18003a00 2023-10-16T19:41:16.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.886+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd301554d0 con 0x7fbd1c06af00 2023-10-16T19:41:16.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.895+0000 7fbd17fff700 1 -- 172.21.15.29:0/1794136268 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289219 (secure 0 0 0) 0x7fbd240137d0 con 0x7fbd1c06af00 2023-10-16T19:41:16.902 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:16.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 msgr2=0x7fbd1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 0x7fbd1c06d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd301e7c70 tx=0x7fbd24008040 comp rx=0 tx=0).stop 2023-10-16T19:41:16.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 msgr2=0x7fbd30151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:16.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c960 tx=0x7fbd20000fe0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 shutdown_connections 2023-10-16T19:41:16.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd1c06af00 0x7fbd1c06d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd301326f0 0x7fbd30132b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd18003a00 0x7fbd30151330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 --2- 172.21.15.29:0/1794136268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd301eaa20 0x7fbd30155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:16.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 >> 172.21.15.29:0/1794136268 conn(0x7fbd300c7110 msgr2=0x7fbd301583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:16.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 shutdown_connections 2023-10-16T19:41:16.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:16.899+0000 7fbd35cf8700 1 -- 172.21.15.29:0/1794136268 wait complete. 2023-10-16T19:41:16.907 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:16.913 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-10-16T19:41:16.578045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.840347"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.505}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.374},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.26300000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.745}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.436}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.627}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.746}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.441}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:16.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T19:41:16.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-16T19:41:17.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.084+0000 7fa154832700 1 Processor -- start 2023-10-16T19:41:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.084+0000 7fa154832700 1 -- start start 2023-10-16T19:41:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa154832700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa15013d660 0x7fa15006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa154832700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa154832700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15006e780 con 0x7fa15006adc0 2023-10-16T19:41:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa154832700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15006d320 con 0x7fa15013d660 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa154832700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150154f10 con 0x7fa150154a50 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa14e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa15013d660 0x7fa15006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa14e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa15013d660 0x7fa15006a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53656/0 (socket says 172.21.15.29:53656) 2023-10-16T19:41:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.085+0000 7fa14e59c700 1 -- 172.21.15.29:0/3099642881 learned_addr learned my addr 172.21.15.29:0/3099642881 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14dd9b700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14e59c700 1 -- 172.21.15.29:0/3099642881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 msgr2=0x7fa1501583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14e59c700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14e59c700 1 -- 172.21.15.29:0/3099642881 >> v1:172.21.15.53:6789/0 conn(0x7fa15006adc0 legacy=0x7fa150158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14e59c700 1 -- 172.21.15.29:0/3099642881 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1501551f0 con 0x7fa15013d660 2023-10-16T19:41:17.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14e59c700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15013d660 0x7fa15006a880 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa1440098f0 tx=0x7fa144009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac2d7dc70caa587 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14d59a700 1 -- 172.21.15.29:0/3099642881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400b8a0 con 0x7fa15013d660 2023-10-16T19:41:17.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14d59a700 1 -- 172.21.15.29:0/3099642881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400ba00 con 0x7fa15013d660 2023-10-16T19:41:17.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa14d59a700 1 -- 172.21.15.29:0/3099642881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400bd90 con 0x7fa15013d660 2023-10-16T19:41:17.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa154832700 1 -- 172.21.15.29:0/3099642881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15013d660 msgr2=0x7fa15006a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.086+0000 7fa154832700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15013d660 0x7fa15006a880 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa1440098f0 tx=0x7fa144009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 -- 172.21.15.29:0/3099642881 shutdown_connections 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15013d660 0x7fa15006a880 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 --2- 172.21.15.29:0/3099642881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 -- 172.21.15.29:0/3099642881 >> 172.21.15.29:0/3099642881 conn(0x7fa1500c7110 msgr2=0x7fa1500c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 -- 172.21.15.29:0/3099642881 shutdown_connections 2023-10-16T19:41:17.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.087+0000 7fa154832700 1 -- 172.21.15.29:0/3099642881 wait complete. 2023-10-16T19:41:17.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.088+0000 7fa154832700 1 Processor -- start 2023-10-16T19:41:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.088+0000 7fa154832700 1 -- start start 2023-10-16T19:41:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa15013d660 0x7fa150133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500c66f0 con 0x7fa15006adc0 2023-10-16T19:41:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15013b330 con 0x7fa15013d660 2023-10-16T19:41:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15013ca20 con 0x7fa150154a50 2023-10-16T19:41:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53662/0 (socket says 172.21.15.29:53662) 2023-10-16T19:41:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 -- 172.21.15.29:0/545276386 learned_addr learned my addr 172.21.15.29:0/545276386 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14dd9b700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa15013d660 0x7fa150133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14ed9d700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 -- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 msgr2=0x7fa1501e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 -- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa15013d660 msgr2=0x7fa150133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa15013d660 0x7fa150133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 -- 172.21.15.29:0/545276386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009550 con 0x7fa15006adc0 2023-10-16T19:41:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa14e59c700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004380 con 0x7fa15006adc0 2023-10-16T19:41:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14401f070 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440036a0 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.089+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15013c290 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.090+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa150157ad0 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.090+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500c6b40 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.091+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa144021030 con 0x7fa15006adc0 2023-10-16T19:41:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.091+0000 7fa13effd700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 0x7fa13006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.091+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa14408ad40 con 0x7fa15006adc0 2023-10-16T19:41:17.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.091+0000 7fa14dd9b700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 0x7fa13006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.092+0000 7fa14dd9b700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 0x7fa13006d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa1501ee1b0 tx=0x7fa140008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.096+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1500c6b40 con 0x7fa15006adc0 2023-10-16T19:41:17.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.375+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7fa1500c6b40 con 0x7fa15006adc0 2023-10-16T19:41:17.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.377+0000 7fa13effd700 1 -- 172.21.15.29:0/545276386 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 195+0+152 (secure 0 0 0) 0x7fa1500c6b40 con 0x7fa15006adc0 2023-10-16T19:41:17.379 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-16T19:41:17.379 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUkS1lF9wWDxAAg1bVqXLjGOgEIq3Eu3eYsQ== 2023-10-16T19:41:17.380 INFO:teuthology.orchestra.run.smithi029.stdout: caps mds = "allow" 2023-10-16T19:41:17.380 INFO:teuthology.orchestra.run.smithi029.stdout: caps mon = "allow r" 2023-10-16T19:41:17.380 INFO:teuthology.orchestra.run.smithi029.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-16T19:41:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 msgr2=0x7fa13006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 0x7fa13006d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa1501ee1b0 tx=0x7fa140008040 comp rx=0 tx=0).stop 2023-10-16T19:41:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 msgr2=0x7fa150157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144004750 comp rx=0 tx=0).stop 2023-10-16T19:41:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 shutdown_connections 2023-10-16T19:41:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa13006af00 0x7fa13006d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa150154a50 0x7fa1501e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15006adc0 0x7fa150157590 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 --2- 172.21.15.29:0/545276386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa15013d660 0x7fa150133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 >> 172.21.15.29:0/545276386 conn(0x7fa1500c7110 msgr2=0x7fa15006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 shutdown_connections 2023-10-16T19:41:17.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.380+0000 7fa154832700 1 -- 172.21.15.29:0/545276386 wait complete. 2023-10-16T19:41:17.385 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-16T19:41:17.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:41:17.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.518+0000 7fb07c1a3700 1 Processor -- start 2023-10-16T19:41:17.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.518+0000 7fb07c1a3700 1 -- start start 2023-10-16T19:41:17.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07c1a3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb07413dd00 0x7fb074158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07c1a3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07406e780 con 0x7fb074154a50 2023-10-16T19:41:17.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07c1a3700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb074154f10 con 0x7fb07413d660 2023-10-16T19:41:17.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07c1a3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07406d320 con 0x7fb07413dd00 2023-10-16T19:41:17.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07a740700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb07413dd00 0x7fb074158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07973e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb074154a50 0x7fb0741583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39114/0 (socket says 172.21.15.29:39114) 2023-10-16T19:41:17.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07a740700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb07413dd00 0x7fb074158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53674/0 (socket says 172.21.15.29:53674) 2023-10-16T19:41:17.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.519+0000 7fb07973e700 1 -- 172.21.15.29:0/3595821012 learned_addr learned my addr 172.21.15.29:0/3595821012 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:17.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07a740700 1 -- 172.21.15.29:0/3595821012 >> v1:172.21.15.53:6789/0 conn(0x7fb07413d660 legacy=0x7fb07406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:17.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07a740700 1 -- 172.21.15.29:0/3595821012 >> v1:172.21.15.29:6789/0 conn(0x7fb074154a50 legacy=0x7fb0741583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07a740700 1 -- 172.21.15.29:0/3595821012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0741551f0 con 0x7fb07413dd00 2023-10-16T19:41:17.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb078f3d700 1 -- 172.21.15.29:0/3595821012 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469566791 0 0) 0x7fb07406e780 con 0x7fb074154a50 2023-10-16T19:41:17.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07a740700 1 --2- 172.21.15.29:0/3595821012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb07413dd00 0x7fb074158ad0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009d90 tx=0x7fb06c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7a821a55fddd1c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb078f3d700 1 -- 172.21.15.29:0/3595821012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00e070 con 0x7fb07413dd00 2023-10-16T19:41:17.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb078f3d700 1 -- 172.21.15.29:0/3595821012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00bb90 con 0x7fb07413dd00 2023-10-16T19:41:17.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb078f3d700 1 -- 172.21.15.29:0/3595821012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c003a70 con 0x7fb07413dd00 2023-10-16T19:41:17.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07c1a3700 1 -- 172.21.15.29:0/3595821012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb07413dd00 msgr2=0x7fb074158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.520+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/3595821012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb07413dd00 0x7fb074158ad0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009d90 tx=0x7fb06c00b330 comp rx=0 tx=0).stop 2023-10-16T19:41:17.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.521+0000 7fb07c1a3700 1 -- 172.21.15.29:0/3595821012 shutdown_connections 2023-10-16T19:41:17.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.521+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/3595821012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb07413dd00 0x7fb074158ad0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.521+0000 7fb07c1a3700 1 -- 172.21.15.29:0/3595821012 >> 172.21.15.29:0/3595821012 conn(0x7fb0740c7110 msgr2=0x7fb0740c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.521+0000 7fb07c1a3700 1 -- 172.21.15.29:0/3595821012 shutdown_connections 2023-10-16T19:41:17.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.521+0000 7fb07c1a3700 1 -- 172.21.15.29:0/3595821012 wait complete. 2023-10-16T19:41:17.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 Processor -- start 2023-10-16T19:41:17.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 -- start start 2023-10-16T19:41:17.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07413d660 0x7fb074153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 0x7fb074150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07413ae80 con 0x7fb074154a50 2023-10-16T19:41:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0741512c0 con 0x7fb07413d660 2023-10-16T19:41:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.522+0000 7fb07c1a3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb074137770 con 0x7fb07413dd00 2023-10-16T19:41:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53680/0 (socket says 172.21.15.29:53680) 2023-10-16T19:41:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 -- 172.21.15.29:0/2134277937 learned_addr learned my addr 172.21.15.29:0/2134277937 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07973e700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 0x7fb074150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 -- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 msgr2=0x7fb074150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 0x7fb074150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 -- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07413d660 msgr2=0x7fb074153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb079f3f700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07413d660 0x7fb074153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07413d660 0x7fb074153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 -- 172.21.15.29:0/2134277937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c009a70 con 0x7fb074154a50 2023-10-16T19:41:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07973e700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 0x7fb074150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07a740700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00b370 tx=0x7fb06c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c012640 con 0x7fb074154a50 2023-10-16T19:41:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c0127a0 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07413c870 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.523+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c012b30 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.524+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0741535b0 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.525+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0740c3780 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.525+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb06c012c90 con 0x7fb074154a50 2023-10-16T19:41:17.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.525+0000 7fb06a7fc700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 0x7fb05806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.525+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb06c08bd90 con 0x7fb074154a50 2023-10-16T19:41:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.526+0000 7fb079f3f700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 0x7fb05806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.526+0000 7fb079f3f700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 0x7fb05806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb064003e60 tx=0x7fb064009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.530+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb06c056d70 con 0x7fb074154a50 2023-10-16T19:41:17.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.775+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb07404f400 con 0x7fb074154a50 2023-10-16T19:41:17.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.775+0000 7fb06a7fc700 1 -- 172.21.15.29:0/2134277937 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fb06c05a390 con 0x7fb074154a50 2023-10-16T19:41:17.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:17.779 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/628400601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":628400601},{"type":"v1","addr":"172.21.15.29:6835","nonce":628400601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/2394385366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2394385366},{"type":"v1","addr":"172.21.15.53:6836","nonce":2394385366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/848265449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":848265449},{"type":"v1","addr":"172.21.15.29:6834","nonce":848265449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:41:07.155742+0000","modified":"2023-10-16T19:41:10.167877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/4202647706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":4202647706},{"type":"v1","addr":"172.21.15.53:6837","nonce":4202647706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:41:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.777+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 msgr2=0x7fb05806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.777+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 0x7fb05806d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb064003e60 tx=0x7fb064009040 comp rx=0 tx=0).stop 2023-10-16T19:41:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.777+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 msgr2=0x7fb074150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.777+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00b370 tx=0x7fb06c004b20 comp rx=0 tx=0).stop 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 shutdown_connections 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb05806af00 0x7fb05806d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb074154a50 0x7fb074150d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07413d660 0x7fb074153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 --2- 172.21.15.29:0/2134277937 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb07413dd00 0x7fb074150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:17.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 >> 172.21.15.29:0/2134277937 conn(0x7fb0740c7110 msgr2=0x7fb074136eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:17.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 shutdown_connections 2023-10-16T19:41:17.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:17.778+0000 7fb07c1a3700 1 -- 172.21.15.29:0/2134277937 wait complete. 2023-10-16T19:41:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-16T19:41:18.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:41:07.155742+0000', 'modified': '2023-10-16T19:41:10.167877+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5247}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5247': {'gid': 5247, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.53:6837/4202647706', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6835', 'nonce': 4202647706}, {'type': 'v1', 'addr': '172.21.15.53:6837', 'nonce': 4202647706}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T19:41:18.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T19:41:18.195 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T19:41:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.323+0000 7feebff8d700 1 Processor -- start 2023-10-16T19:41:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.323+0000 7feebff8d700 1 -- start start 2023-10-16T19:41:18.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebff8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feeb81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebff8d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feeb806db00 0x7feeb806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebff8d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb8155af0 con 0x7feeb80c3350 2023-10-16T19:41:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebff8d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb8152300 con 0x7feeb806db00 2023-10-16T19:41:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebff8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c2e40 con 0x7feeb814ec50 2023-10-16T19:41:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebd528700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7feeb80c3350 0x7feeb8071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39130/0 (socket says 172.21.15.29:39130) 2023-10-16T19:41:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebd528700 1 -- 172.21.15.29:0/3743718267 learned_addr learned my addr 172.21.15.29:0/3743718267 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398362131 0 0) 0x7feea8001110 con 0x7feeb80c3350 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebe52a700 1 --2- 172.21.15.29:0/3743718267 >> v2:172.21.15.53:3300/0 conn(0x7feeb806db00 0x7feeb806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebdd29700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feeb81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea40035b0 con 0x7feeb80c3350 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384637561 0 0) 0x7feea40035b0 con 0x7feeb80c3350 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 msgr2=0x7feeb81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feeb81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 >> v2:172.21.15.53:3300/0 conn(0x7feeb806db00 msgr2=0x7feeb806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 --2- 172.21.15.29:0/3743718267 >> v2:172.21.15.53:3300/0 conn(0x7feeb806db00 0x7feeb806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb814f030 con 0x7feeb80c3350 2023-10-16T19:41:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7feea8001800 con 0x7feeb80c3350 2023-10-16T19:41:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 >> v1:172.21.15.29:6789/0 conn(0x7feeb80c3350 legacy=0x7feeb8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feea4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4003f80 0x7feea4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea4004d90 0x7feea4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8152300 con 0x7feea4004d90 2023-10-16T19:41:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c2e40 con 0x7feea4003f80 2023-10-16T19:41:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.324+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea400ba60 con 0x7feeb814ec50 2023-10-16T19:41:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea4004d90 0x7feea4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebd528700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4003f80 0x7feea4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebdd29700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feea4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 -- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 msgr2=0x7feea4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb814ec50 0x7feea4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 -- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4003f80 msgr2=0x7feea4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4003f80 0x7feea4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 -- 172.21.15.29:0/3743718267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40035b0 con 0x7feea4004d90 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebe52a700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea4004d90 0x7feea4005210 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e170 tx=0x7feea4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d0c29ed9f0a76c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000ec90 con 0x7feea4004d90 2023-10-16T19:41:18.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000f040 con 0x7feea4004d90 2023-10-16T19:41:18.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.325+0000 7feebcd27700 1 -- 172.21.15.29:0/3743718267 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0014480 con 0x7feea4004d90 2023-10-16T19:41:18.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 -- 172.21.15.29:0/3743718267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea4004d90 msgr2=0x7feea4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 --2- 172.21.15.29:0/3743718267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea4004d90 0x7feea4005210 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e170 tx=0x7feea4005880 comp rx=0 tx=0).stop 2023-10-16T19:41:18.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebe52a700 1 -- 172.21.15.29:0/3743718267 reap_dead start 2023-10-16T19:41:18.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 -- 172.21.15.29:0/3743718267 shutdown_connections 2023-10-16T19:41:18.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 -- 172.21.15.29:0/3743718267 >> 172.21.15.29:0/3743718267 conn(0x7feeb80c7110 msgr2=0x7feeb80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 -- 172.21.15.29:0/3743718267 shutdown_connections 2023-10-16T19:41:18.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.326+0000 7feebff8d700 1 -- 172.21.15.29:0/3743718267 wait complete. 2023-10-16T19:41:18.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.327+0000 7feebff8d700 1 Processor -- start 2023-10-16T19:41:18.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.327+0000 7feebff8d700 1 -- start start 2023-10-16T19:41:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeb814b100 0x7feeb80abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb8149020 0x7feeb81ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81468b0 con 0x7feeb814ce70 2023-10-16T19:41:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8146610 con 0x7feeb814b100 2023-10-16T19:41:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81ee370 con 0x7feeb8149020 2023-10-16T19:41:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53696/0 (socket says 172.21.15.29:53696) 2023-10-16T19:41:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 -- 172.21.15.29:0/2265013659 learned_addr learned my addr 172.21.15.29:0/2265013659 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 -- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb8149020 msgr2=0x7feeb81ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb8149020 0x7feeb81ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 -- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeb814b100 msgr2=0x7feeb80abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebd528700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeb814b100 0x7feeb80abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeb814b100 0x7feeb80abb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 -- 172.21.15.29:0/2265013659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb81ee610 con 0x7feeb814ce70 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebdd29700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7feeb4011a20 tx=0x7feeb4011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feeae7fc700 1 -- 172.21.15.29:0/2265013659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400f940 con 0x7feeb814ce70 2023-10-16T19:41:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feeae7fc700 1 -- 172.21.15.29:0/2265013659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb400faa0 con 0x7feeb814ce70 2023-10-16T19:41:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.328+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb8149570 con 0x7feeb814ce70 2023-10-16T19:41:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.329+0000 7feeae7fc700 1 -- 172.21.15.29:0/2265013659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400fe50 con 0x7feeb814ce70 2023-10-16T19:41:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.329+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb8149a90 con 0x7feeb814ce70 2023-10-16T19:41:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.330+0000 7feeae7fc700 1 -- 172.21.15.29:0/2265013659 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feeb4014440 con 0x7feeb814ce70 2023-10-16T19:41:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.330+0000 7feeae7fc700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 0x7fee9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.331+0000 7feeae7fc700 1 -- 172.21.15.29:0/2265013659 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7feeb4089e50 con 0x7feeb814ce70 2023-10-16T19:41:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.331+0000 7feebd528700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 0x7fee9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.331+0000 7feebd528700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 0x7fee9c06d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feea8001050 tx=0x7feea8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.332+0000 7feecc177b80 1 Processor -- start 2023-10-16T19:41:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 -- start start 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b8fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 0x561a2b8dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b832c20 con 0x561a2b8be6b0 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b817c10 con 0x561a2b8b8c90 2023-10-16T19:41:18.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2b815530 con 0x561a2b8bea90 2023-10-16T19:41:18.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53704/0 (socket says 172.21.15.29:53704) 2023-10-16T19:41:18.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feebdd29700 1 -- 172.21.15.29:0/2564989801 learned_addr learned my addr 172.21.15.29:0/2564989801 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feebe52a700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 0x561a2b8dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.333+0000 7feebd528700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b8fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 -- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 msgr2=0x561a2b8fcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b8fcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 -- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 msgr2=0x561a2b8dc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 0x561a2b8dc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 -- 172.21.15.29:0/2564989801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a2b7ce3a0 con 0x561a2b8be6b0 2023-10-16T19:41:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebe52a700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 0x561a2b8dc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feebdd29700 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feeb40608f0 tx=0x7feeb4058ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174db2327ea5b3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7fee9b7fe700 1 -- 172.21.15.29:0/2564989801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4056f70 con 0x561a2b8be6b0 2023-10-16T19:41:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7fee9b7fe700 1 -- 172.21.15.29:0/2564989801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4083030 con 0x561a2b8be6b0 2023-10-16T19:41:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7fee9b7fe700 1 -- 172.21.15.29:0/2564989801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4059050 con 0x561a2b8be6b0 2023-10-16T19:41:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feecc177b80 1 -- 172.21.15.29:0/2564989801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 msgr2=0x561a2b8fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.334+0000 7feecc177b80 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feeb40608f0 tx=0x7feeb4058ca0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 -- 172.21.15.29:0/2564989801 shutdown_connections 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8b8c90 0x561a2b8dc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8be6b0 0x561a2b8fc620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 --2- 172.21.15.29:0/2564989801 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b8fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 -- 172.21.15.29:0/2564989801 >> 172.21.15.29:0/2564989801 conn(0x561a2b7ebd80 msgr2=0x561a2b8bc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 -- 172.21.15.29:0/2564989801 shutdown_connections 2023-10-16T19:41:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 -- 172.21.15.29:0/2564989801 wait complete. 2023-10-16T19:41:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 -- start start 2023-10-16T19:41:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.335+0000 7feecc177b80 1 Processor -- start 2023-10-16T19:41:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 0x561a2b8dc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b8fa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b810e20 con 0x561a2b8bea90 2023-10-16T19:41:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b7ad6c0 con 0x561a2b8be6b0 2023-10-16T19:41:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2b7ad360 con 0x561a2b8b8c90 2023-10-16T19:41:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 10 client.0 _ll_register_callbacks cb 0x561a2b60a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53714/0 (socket says 172.21.15.29:53714) 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 -- 172.21.15.29:0/3173867505 learned_addr learned my addr 172.21.15.29:0/3173867505 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebd528700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b8fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebdd29700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 0x561a2b8dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 -- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 msgr2=0x561a2b8dc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 0x561a2b8dc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 -- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 msgr2=0x561a2b8fa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b8fa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 -- 172.21.15.29:0/3173867505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb8149a90 con 0x561a2b8bea90 2023-10-16T19:41:18.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebd528700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b8fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:18.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebdd29700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 0x561a2b8dc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:18.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feebe52a700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e760 tx=0x7feeb0004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd00eb37daa5195f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7fee98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:41:18.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0023070 con 0x561a2b8bea90 2023-10-16T19:41:18.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7feeb0014690 con 0x561a2b8bea90 2023-10-16T19:41:18.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.337+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a2b8b15b0 con 0x561a2b8bea90 2023-10-16T19:41:18.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb0007000 con 0x561a2b8bea90 2023-10-16T19:41:18.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 10 client.5460 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:18.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561a2b63bd90 con 0x561a2b8bea90 2023-10-16T19:41:18.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a2b8b15b0 con 0x561a2b8bea90 2023-10-16T19:41:18.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7feeb0014850 con 0x561a2b8bea90 2023-10-16T19:41:18.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 10 client.5460 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:18.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 10 client.5460 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T19:41:18.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 20 client.5460 populate_metadata read hostname 'smithi029' 2023-10-16T19:41:18.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8e2ca0 0x561a2b8e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 4 client.5460 mds_command: new command op to 5247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 --> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a2b809e00 con 0x561a2b8e2ca0 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.338+0000 7feebdd29700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8e2ca0 0x561a2b8e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7fee98ff9700 10 client.5460 ms_handle_connect on v2:172.21.15.53:6835/4202647706 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7feebdd29700 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8e2ca0 0x561a2b8e3080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=540446b5796cadbe server_cookie=12be7c47e4a919b1 in_seq=0 out_seq=0 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7fee98ff9700 1 -- 172.21.15.29:0/3173867505 <== mds.0 v2:172.21.15.53:6835/4202647706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a2b809e00 con 0x561a2b8e2ca0 2023-10-16T19:41:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7fee98ff9700 10 client.5460 handle_command_reply: tid=0 2023-10-16T19:41:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7feecc177b80 1 client.5460 shutdown 2023-10-16T19:41:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 msgr2=0x561a2b907320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e760 tx=0x7feeb0004b90 comp rx=0 tx=0).stop 2023-10-16T19:41:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.339+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 shutdown_connections 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8e2ca0 0x561a2b8e3080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8bea90 0x561a2b907320 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8b8c90 0x561a2b8dc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7fee98ff9700 0 client.5460 ms_handle_reset on v2:172.21.15.53:6835/4202647706 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 --2- 172.21.15.29:0/3173867505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b8fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 >> 172.21.15.29:0/3173867505 conn(0x561a2b7ebd80 msgr2=0x561a2b8df860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 shutdown_connections 2023-10-16T19:41:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 1 -- 172.21.15.29:0/3173867505 wait complete. 2023-10-16T19:41:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.340+0000 7feecc177b80 20 client.5460 trim_cache size 0 max 16384 2023-10-16T19:41:18.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.357+0000 7feecc177b80 1 Processor -- start 2023-10-16T19:41:18.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 -- start start 2023-10-16T19:41:18.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8be6b0 0x561a2b90a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 0x561a2b8dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b6918d0 con 0x561a2b8b8c90 2023-10-16T19:41:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b8faef0 con 0x561a2b8bea90 2023-10-16T19:41:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2b89b420 con 0x561a2b8be6b0 2023-10-16T19:41:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53720/0 (socket says 172.21.15.29:53720) 2023-10-16T19:41:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feebdd29700 1 -- 172.21.15.29:0/3120412428 learned_addr learned my addr 172.21.15.29:0/3120412428 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feebe52a700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 0x561a2b8dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.358+0000 7feebd528700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8be6b0 0x561a2b90a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 -- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8be6b0 msgr2=0x561a2b90a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8be6b0 0x561a2b90a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 -- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 msgr2=0x561a2b8dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 0x561a2b8dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 -- 172.21.15.29:0/3120412428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80c4820 con 0x561a2b8b8c90 2023-10-16T19:41:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebe52a700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 0x561a2b8dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feebdd29700 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7feeb4058ce0 tx=0x7feeb405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d441f19b99b5d3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7fee9bfff700 1 -- 172.21.15.29:0/3120412428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4075040 con 0x561a2b8b8c90 2023-10-16T19:41:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7fee9bfff700 1 -- 172.21.15.29:0/3120412428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4077040 con 0x561a2b8b8c90 2023-10-16T19:41:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7fee9bfff700 1 -- 172.21.15.29:0/3120412428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40773d0 con 0x561a2b8b8c90 2023-10-16T19:41:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 -- 172.21.15.29:0/3120412428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 msgr2=0x561a2b8bca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7feeb4058ce0 tx=0x7feeb405b000 comp rx=0 tx=0).stop 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 -- 172.21.15.29:0/3120412428 shutdown_connections 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8bea90 0x561a2b8dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b8bca80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 --2- 172.21.15.29:0/3120412428 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8be6b0 0x561a2b90a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.359+0000 7feecc177b80 1 -- 172.21.15.29:0/3120412428 >> 172.21.15.29:0/3120412428 conn(0x561a2b7ebd80 msgr2=0x561a2b9070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.360+0000 7feecc177b80 1 -- 172.21.15.29:0/3120412428 shutdown_connections 2023-10-16T19:41:18.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.360+0000 7feecc177b80 1 -- 172.21.15.29:0/3120412428 wait complete. 2023-10-16T19:41:18.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.360+0000 7feecc177b80 1 -- start start 2023-10-16T19:41:18.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.360+0000 7feecc177b80 1 Processor -- start 2023-10-16T19:41:18.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.361+0000 7feecc177b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b965820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b90a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b8f0e80 con 0x561a2b8b8c90 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2b8e24d0 con 0x561a2b8be6b0 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2b8e2930 con 0x561a2b8bea90 2023-10-16T19:41:18.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 10 client.0 _ll_register_callbacks cb 0x7feea4003740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:41:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53724/0 (socket says 172.21.15.29:53724) 2023-10-16T19:41:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 -- 172.21.15.29:0/2411170450 learned_addr learned my addr 172.21.15.29:0/2411170450 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebe52a700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b90a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebd528700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b965820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 -- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 msgr2=0x561a2b90a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b90a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 -- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 msgr2=0x561a2b965820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b965820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 -- 172.21.15.29:0/2411170450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a2b7ce3a0 con 0x561a2b8b8c90 2023-10-16T19:41:18.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebd528700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b965820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:18.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feebdd29700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feeb401c000 tx=0x7feeb401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21843d21db8275dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7fee98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-16T19:41:18.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4075070 con 0x561a2b8b8c90 2023-10-16T19:41:18.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7feeb40773b0 con 0x561a2b8b8c90 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feeb4083030 con 0x561a2b8b8c90 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb40580c0 con 0x561a2b8b8c90 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 10 client.5466 fetch_fsmap learned FSMap version 17 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561a2b624c10 con 0x561a2b8b8c90 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.362+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4083030 con 0x561a2b8b8c90 2023-10-16T19:41:18.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7feeb4058e30 con 0x561a2b8b8c90 2023-10-16T19:41:18.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 10 client.5466 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:41:18.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 10 client.5466 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T19:41:18.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 20 client.5466 populate_metadata read hostname 'smithi029' 2023-10-16T19:41:18.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8f8120 0x561a2b8da930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 4 client.5466 mds_command: new command op to 5247 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 --> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561a2b809b20 con 0x561a2b8f8120 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feebd528700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8f8120 0x561a2b8da930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7fee98ff9700 10 client.5466 ms_handle_connect on v2:172.21.15.53:6835/4202647706 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feebd528700 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8f8120 0x561a2b8da930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab1ef2124ce55c1 server_cookie=456fea2057295b12 in_seq=0 out_seq=0 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7fee98ff9700 1 -- 172.21.15.29:0/2411170450 <== mds.0 v2:172.21.15.53:6835/4202647706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x561a2b809b20 con 0x561a2b8f8120 2023-10-16T19:41:18.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7fee98ff9700 10 client.5466 handle_command_reply: tid=0 2023-10-16T19:41:18.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.363+0000 7feecc177b80 1 client.5466 shutdown 2023-10-16T19:41:18.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 msgr2=0x561a2b95f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feeb401c000 tx=0x7feeb401e000 comp rx=0 tx=0).stop 2023-10-16T19:41:18.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 shutdown_connections 2023-10-16T19:41:18.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:6835/4202647706,v1:172.21.15.53:6837/4202647706] conn(0x561a2b8f8120 0x561a2b8da930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x561a2b8bea90 0x561a2b90a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561a2b8b8c90 0x561a2b95f1e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 --2- 172.21.15.29:0/2411170450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a2b8be6b0 0x561a2b965820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7fee98ff9700 0 client.5466 ms_handle_reset on v2:172.21.15.53:6835/4202647706 2023-10-16T19:41:18.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 >> 172.21.15.29:0/2411170450 conn(0x561a2b7ebd80 msgr2=0x561a2b8bca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 shutdown_connections 2023-10-16T19:41:18.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 1 -- 172.21.15.29:0/2411170450 wait complete. 2023-10-16T19:41:18.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feecc177b80 20 client.5466 trim_cache size 0 max 16384 2023-10-16T19:41:18.390 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:18.391 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "b5b71d99-0d95-4cc7-b379-31b38eac533d", 2023-10-16T19:41:18.391 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-16T19:41:18.391 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5247, 2023-10-16T19:41:18.391 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-16T19:41:18.391 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-16T19:41:18.392 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "testcephfs1", 2023-10-16T19:41:18.392 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 10.628290010000001, 2023-10-16T19:41:18.392 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 17, 2023-10-16T19:41:18.392 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 40, 2023-10-16T19:41:18.392 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 40, 2023-10-16T19:41:18.393 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 19.473963271999999 2023-10-16T19:41:18.393 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 msgr2=0x7fee9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 0x7fee9c06d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feea8001050 tx=0x7feea8009040 comp rx=0 tx=0).stop 2023-10-16T19:41:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 msgr2=0x7feeb80ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7feeb4011a20 tx=0x7feeb4011de0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 shutdown_connections 2023-10-16T19:41:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fee9c06af00 0x7fee9c06d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7feeb8149020 0x7feeb81ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feeb814ce70 0x7feeb80ab600 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 --2- 172.21.15.29:0/2265013659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeb814b100 0x7feeb80abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 >> 172.21.15.29:0/2265013659 conn(0x7feeb80c7110 msgr2=0x7feeb814bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.364+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 shutdown_connections 2023-10-16T19:41:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.365+0000 7feebff8d700 1 -- 172.21.15.29:0/2265013659 wait complete. 2023-10-16T19:41:18.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:41:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.520+0000 7f15b795a700 1 Processor -- start 2023-10-16T19:41:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.520+0000 7f15b795a700 1 -- start start 2023-10-16T19:41:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b795a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 0x7f15b01583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b795a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15b013dd00 0x7f15b0158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b795a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b0158e40 con 0x7f15b013d660 2023-10-16T19:41:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b795a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b006d320 con 0x7f15b013dd00 2023-10-16T19:41:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b795a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b006e780 con 0x7f15b0154a50 2023-10-16T19:41:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15b013dd00 0x7f15b0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b56f6700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f15b013d660 0x7f15b006a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39176/0 (socket says 172.21.15.29:39176) 2023-10-16T19:41:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15b013dd00 0x7f15b0158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53736/0 (socket says 172.21.15.29:53736) 2023-10-16T19:41:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b56f6700 1 -- 172.21.15.29:0/3402311798 learned_addr learned my addr 172.21.15.29:0/3402311798 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b4ef5700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 0x7f15b01583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3402311798 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 msgr2=0x7f15b01583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:18.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 0x7f15b01583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3402311798 >> v1:172.21.15.29:6789/0 conn(0x7f15b013d660 legacy=0x7f15b006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3402311798 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0154f10 con 0x7f15b013dd00 2023-10-16T19:41:18.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15a7fff700 1 -- 172.21.15.29:0/3402311798 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968727853 0 0) 0x7f15b0158e40 con 0x7f15b013d660 2023-10-16T19:41:18.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.521+0000 7f15b4ef5700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 0x7f15b01583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b5ef7700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b013dd00 0x7f15b0158900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009d90 tx=0x7f15a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dd58a094566d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15a7fff700 1 -- 172.21.15.29:0/3402311798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800e070 con 0x7f15b013dd00 2023-10-16T19:41:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15a7fff700 1 -- 172.21.15.29:0/3402311798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a800bbd0 con 0x7f15b013dd00 2023-10-16T19:41:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15a7fff700 1 -- 172.21.15.29:0/3402311798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8012430 con 0x7f15b013dd00 2023-10-16T19:41:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 -- 172.21.15.29:0/3402311798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b013dd00 msgr2=0x7f15b0158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b013dd00 0x7f15b0158900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009d90 tx=0x7f15a800b330 comp rx=0 tx=0).stop 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 -- 172.21.15.29:0/3402311798 shutdown_connections 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b013dd00 0x7f15b0158900 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 --2- 172.21.15.29:0/3402311798 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b0154a50 0x7f15b01583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 -- 172.21.15.29:0/3402311798 >> 172.21.15.29:0/3402311798 conn(0x7f15b00c7110 msgr2=0x7f15b00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 -- 172.21.15.29:0/3402311798 shutdown_connections 2023-10-16T19:41:18.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.522+0000 7f15b795a700 1 -- 172.21.15.29:0/3402311798 wait complete. 2023-10-16T19:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.523+0000 7f15b795a700 1 Processor -- start 2023-10-16T19:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 -- start start 2023-10-16T19:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15b013d660 0x7f15b01ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b013dd00 0x7f15b00c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b01ee740 con 0x7f15b0154a50 2023-10-16T19:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0137790 con 0x7f15b013d660 2023-10-16T19:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b795a700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0137a70 con 0x7f15b013dd00 2023-10-16T19:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b5ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b5ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53742/0 (socket says 172.21.15.29:53742) 2023-10-16T19:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.524+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3663434598 learned_addr learned my addr 172.21.15.29:0/3663434598 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b013dd00 msgr2=0x7f15b00c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b56f6700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15b013d660 0x7f15b01ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b4ef5700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b013dd00 0x7f15b00c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b013dd00 0x7f15b00c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15b013d660 msgr2=0x7f15b01ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15b013d660 0x7f15b01ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 -- 172.21.15.29:0/3663434598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009a70 con 0x7f15b0154a50 2023-10-16T19:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b5ef7700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15a8014040 tx=0x7f15a8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8012430 con 0x7f15b0154a50 2023-10-16T19:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8020070 con 0x7f15b0154a50 2023-10-16T19:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b01365d0 con 0x7f15b0154a50 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8004280 con 0x7f15b0154a50 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.525+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b0138f50 con 0x7f15b0154a50 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.526+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b0155790 con 0x7f15b0154a50 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.527+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f15a80043e0 con 0x7f15b0154a50 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.527+0000 7f15a5ffb700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 0x7f159406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.527+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f15a8022070 con 0x7f15b0154a50 2023-10-16T19:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.527+0000 7f15b56f6700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 0x7f159406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.528+0000 7f15b56f6700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 0x7f159406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000f60 tx=0x7f15a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.531+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15b0155790 con 0x7f15b0154a50 2023-10-16T19:41:18.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.777+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15b0155790 con 0x7f15b0154a50 2023-10-16T19:41:18.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.777+0000 7f15a5ffb700 1 -- 172.21.15.29:0/3663434598 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f15b0155790 con 0x7f15b0154a50 2023-10-16T19:41:18.780 INFO:teuthology.orchestra.run.smithi029.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-16T19:41:18.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 msgr2=0x7f159406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 0x7f159406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000f60 tx=0x7f15a0009040 comp rx=0 tx=0).stop 2023-10-16T19:41:18.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 msgr2=0x7f15b0137f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:18.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15a8014040 tx=0x7f15a8004b20 comp rx=0 tx=0).stop 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 shutdown_connections 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f159406af00 0x7f159406d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b0154a50 0x7f15b0137f00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15b013d660 0x7f15b01ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 --2- 172.21.15.29:0/3663434598 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f15b013dd00 0x7f15b00c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.779+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 >> 172.21.15.29:0/3663434598 conn(0x7f15b00c7110 msgr2=0x7f15b006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.780+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 shutdown_connections 2023-10-16T19:41:18.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:18.780+0000 7f15b795a700 1 -- 172.21.15.29:0/3663434598 wait complete. 2023-10-16T19:41:18.793 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T19:41:18.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:41:18.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-16T19:41:18.795 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T19:41:18.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:18.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T19:41:18.796 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T19:41:18.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:41:18.796 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:41:18.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:18.797 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-16T19:41:18.815 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:41:18.815 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:41:18.815 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:18.816 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:18.817 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:18.817 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:18.817 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:41:18.817 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:18.817 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T19:41:18.818 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42319sec preferred_lft 42319sec 2023-10-16T19:41:18.818 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-16T19:41:18.818 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.818 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:41:18.818 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:18.819 INFO:teuthology.orchestra.run.smithi029.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:41:18.819 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 32:84:df:2c:e4:e1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:41:18.819 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T19:41:18.819 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.819 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::f0e2:72ff:fe55:626d/64 scope link 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 32:84:df:2c:e4:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::3084:dfff:fe2c:e4e1/64 scope link 2023-10-16T19:41:18.820 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:41:18.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:18.821 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:41:18.882 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-16T19:41:18.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:18.883 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-16T19:41:18.942 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-16T19:41:18.942 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:41:18.943 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T19:41:18.943 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T19:41:18.943 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:41:18.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:18.944 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-16T19:41:18.944 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-16T19:41:18.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T19:41:18.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T19:41:18.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T19:41:18.946 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-16T19:41:19.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.050 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-16T19:41:19.068 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T19:41:19.068 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:41:19.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-16T19:41:19.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:41:19.136 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:19.193 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:41:19.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:41:19.194 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:41:19.249 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T19:41:19.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:41:19.335 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:41:19.335 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:41:19.366 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:41:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:41:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:41:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:41:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:41:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:41:19.368 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:41:19.368 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:41:19.422 INFO:teuthology.orchestra.run.smithi029.stderr:mount error 2 = No such file or directory 2023-10-16T19:41:19.423 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:41:19.423 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:41:19.424 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.53:3300,172.21.15.53:3301" 2023-10-16T19:41:19.424 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@b5b71d99-0d95-4cc7-b379-31b38eac533d.cephfs=/ 2023-10-16T19:41:19.424 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2023-10-16T19:41:19.424 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:41:19.424 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:41:19.425 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:41:19.425 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790" 2023-10-16T19:41:19.425 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.53:6789,172.21.15.53:6790:/ 2023-10-16T19:41:19.425 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b5b71d99-0d95-4cc7-b379-31b38eac533d" will pass to kernel 2023-10-16T19:41:19.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T19:41:19.427 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-16T19:41:19.427 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ERROR 2023-10-16T19:41:19.428 INFO:tasks.cephfs_test_runner: 2023-10-16T19:41:19.428 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T19:41:19.429 INFO:tasks.cephfs_test_runner:ERROR: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-10-16T19:41:19.429 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:41:19.429 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T19:41:19.429 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_multifs_auth.py", line 231, in setUp 2023-10-16T19:41:19.430 INFO:tasks.cephfs_test_runner: super(TestClientsWithoutAuth, self).setUp() 2023-10-16T19:41:19.430 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_multifs_auth.py", line 25, in setUp 2023-10-16T19:41:19.430 INFO:tasks.cephfs_test_runner: super(TestMultiFS, self).setUp() 2023-10-16T19:41:19.431 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T19:41:19.431 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T19:41:19.431 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T19:41:19.431 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T19:41:19.432 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T19:41:19.432 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T19:41:19.432 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T19:41:19.432 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T19:41:19.433 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T19:41:19.433 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T19:41:19.433 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T19:41:19.433 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T19:41:19.434 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T19:41:19.434 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T19:41:19.434 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T19:41:19.434 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T19:41:19.435 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-16T19:41:19.435 INFO:tasks.cephfs_test_runner: 2023-10-16T19:41:19.435 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:41:19.435 INFO:tasks.cephfs_test_runner:Ran 1 test in 37.456s 2023-10-16T19:41:19.436 INFO:tasks.cephfs_test_runner: 2023-10-16T19:41:19.436 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-16T19:41:19.436 INFO:tasks.cephfs_test_runner: 2023-10-16T19:41:19.436 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T19:41:19.437 INFO:tasks.cephfs_test_runner:ERROR: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-10-16T19:41:19.437 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:41:19.437 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T19:41:19.437 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_multifs_auth.py", line 231, in setUp 2023-10-16T19:41:19.438 INFO:tasks.cephfs_test_runner: super(TestClientsWithoutAuth, self).setUp() 2023-10-16T19:41:19.438 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_multifs_auth.py", line 25, in setUp 2023-10-16T19:41:19.438 INFO:tasks.cephfs_test_runner: super(TestMultiFS, self).setUp() 2023-10-16T19:41:19.438 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T19:41:19.439 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T19:41:19.439 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T19:41:19.439 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T19:41:19.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T19:41:19.440 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T19:41:19.440 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T19:41:19.440 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T19:41:19.441 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T19:41:19.441 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T19:41:19.441 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T19:41:19.441 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T19:41:19.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T19:41:19.442 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T19:41:19.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T19:41:19.442 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T19:41:19.443 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-16T19:41:19.443 INFO:tasks.cephfs_test_runner: 2023-10-16T19:41:19.443 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-10-16T19:41:19.516 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8dd396d590d24ac4936a21b04456858e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-10-16T19:41:19.519 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T19:41:19.529 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T19:41:19.603 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T19:41:19.603 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-16T19:41:19.604 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:41:19.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=33,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18803 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-10-16T19:41:19.628 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-10-16T19:41:19.629 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:41:19.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1549 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-10-16T19:41:19.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.657 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-16T19:41:19.690 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T19:41:19.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:41:19.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.773 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-16T19:41:19.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.883 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-10-16T19:41:19.906 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T19:41:19.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T19:41:19.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:41:19.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-10-16T19:41:20.095 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T19:41:20.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T19:41:20.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:20.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.230+0000 7f0852f89700 1 Processor -- start 2023-10-16T19:41:20.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.230+0000 7f0852f89700 1 -- start start 2023-10-16T19:41:20.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0852f89700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f084c0a55b0 0x7f084c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0852f89700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f084c154df0 0x7f084c152350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0852f89700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c155360 con 0x7f084c0c6850 2023-10-16T19:41:20.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0852f89700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c070880 con 0x7f084c0a55b0 2023-10-16T19:41:20.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0852f89700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c1519f0 con 0x7f084c154df0 2023-10-16T19:41:20.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f084c0a55b0 0x7f084c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f084c0a55b0 0x7f084c151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53750/0 (socket says 172.21.15.29:53750) 2023-10-16T19:41:20.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 -- 172.21.15.29:0/1555927749 learned_addr learned my addr 172.21.15.29:0/1555927749 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f0851526700 1 --2- 172.21.15.29:0/1555927749 >> v2:172.21.15.53:3300/0 conn(0x7f084c154df0 0x7f084c152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 -- 172.21.15.29:0/1555927749 >> v2:172.21.15.53:3300/0 conn(0x7f084c154df0 msgr2=0x7f084c152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 --2- 172.21.15.29:0/1555927749 >> v2:172.21.15.53:3300/0 conn(0x7f084c154df0 0x7f084c152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 -- 172.21.15.29:0/1555927749 >> v1:172.21.15.29:6789/0 conn(0x7f084c0c6850 legacy=0x7f084c0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084bfff700 1 -- 172.21.15.29:0/1555927749 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c155640 con 0x7f084c0a55b0 2023-10-16T19:41:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.231+0000 7f084b7fe700 1 -- 172.21.15.29:0/1555927749 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624083796 0 0) 0x7f084c155360 con 0x7f084c0c6850 2023-10-16T19:41:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f084bfff700 1 --2- 172.21.15.29:0/1555927749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c151e10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f084c0700d0 tx=0x7f083800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fcd65c1cca662b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f084b7fe700 1 -- 172.21.15.29:0/1555927749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800dc70 con 0x7f084c0a55b0 2023-10-16T19:41:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f084b7fe700 1 -- 172.21.15.29:0/1555927749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800ddd0 con 0x7f084c0a55b0 2023-10-16T19:41:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f084b7fe700 1 -- 172.21.15.29:0/1555927749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838010690 con 0x7f084c0a55b0 2023-10-16T19:41:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 -- 172.21.15.29:0/1555927749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 msgr2=0x7f084c151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 --2- 172.21.15.29:0/1555927749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c151e10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f084c0700d0 tx=0x7f083800be70 comp rx=0 tx=0).stop 2023-10-16T19:41:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 -- 172.21.15.29:0/1555927749 shutdown_connections 2023-10-16T19:41:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 --2- 172.21.15.29:0/1555927749 >> v2:172.21.15.53:3300/0 conn(0x7f084c154df0 0x7f084c152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 --2- 172.21.15.29:0/1555927749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c151e10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 -- 172.21.15.29:0/1555927749 >> 172.21.15.29:0/1555927749 conn(0x7f084c0a8070 msgr2=0x7f084c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 -- 172.21.15.29:0/1555927749 shutdown_connections 2023-10-16T19:41:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.232+0000 7f0852f89700 1 -- 172.21.15.29:0/1555927749 wait complete. 2023-10-16T19:41:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.233+0000 7f0852f89700 1 Processor -- start 2023-10-16T19:41:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 -- start start 2023-10-16T19:41:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084c0c6850 0x7f084c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f084c154df0 0x7f084c0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c14fbc0 con 0x7f084c0a55b0 2023-10-16T19:41:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c150ca0 con 0x7f084c0c6850 2023-10-16T19:41:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0852f89700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c1e5a50 con 0x7f084c154df0 2023-10-16T19:41:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0850d25700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0850d25700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53754/0 (socket says 172.21.15.29:53754) 2023-10-16T19:41:20.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.234+0000 7f0850d25700 1 -- 172.21.15.29:0/3353737789 learned_addr learned my addr 172.21.15.29:0/3353737789 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:20.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f084bfff700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084c0c6850 0x7f084c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0851526700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f084c154df0 0x7f084c0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 -- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f084c154df0 msgr2=0x7f084c0bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f084c154df0 0x7f084c0bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 -- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084c0c6850 msgr2=0x7f084c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084c0c6850 0x7f084c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 -- 172.21.15.29:0/3353737789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083800b7f0 con 0x7f084c0a55b0 2023-10-16T19:41:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0850d25700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f084000c550 tx=0x7f084000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400054e0 con 0x7f084c0a55b0 2023-10-16T19:41:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840003680 con 0x7f084c0a55b0 2023-10-16T19:41:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840003a30 con 0x7f084c0a55b0 2023-10-16T19:41:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c14d870 con 0x7f084c0a55b0 2023-10-16T19:41:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.235+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c1e8410 con 0x7f084c0a55b0 2023-10-16T19:41:20.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.236+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c04f400 con 0x7f084c0a55b0 2023-10-16T19:41:20.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.237+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0840003b90 con 0x7f084c0a55b0 2023-10-16T19:41:20.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.237+0000 7f08497fa700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 0x7f083006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.237+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0840088bc0 con 0x7f084c0a55b0 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.237+0000 7f084bfff700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 0x7f083006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.238+0000 7f084bfff700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 0x7f083006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f083800beb0 tx=0x7f0838013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.242+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0840053ba0 con 0x7f084c0a55b0 2023-10-16T19:41:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.439+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f084c155920 con 0x7f083006af00 2023-10-16T19:41:20.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.448+0000 7f08497fa700 1 -- 172.21.15.29:0/3353737789 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289220 (secure 0 0 0) 0x7f083801e040 con 0x7f083006af00 2023-10-16T19:41:20.454 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:20.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 msgr2=0x7f083006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 0x7f083006d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f083800beb0 tx=0x7f0838013000 comp rx=0 tx=0).stop 2023-10-16T19:41:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 msgr2=0x7f084c1e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f084000c550 tx=0x7f084000c910 comp rx=0 tx=0).stop 2023-10-16T19:41:20.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 shutdown_connections 2023-10-16T19:41:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f083006af00 0x7f083006d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f084c154df0 0x7f084c0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f084c0a55b0 0x7f084c1e8f90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 --2- 172.21.15.29:0/3353737789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f084c0c6850 0x7f084c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 >> 172.21.15.29:0/3353737789 conn(0x7f084c0a8070 msgr2=0x7f084c072410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 shutdown_connections 2023-10-16T19:41:20.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.452+0000 7f0852f89700 1 -- 172.21.15.29:0/3353737789 wait complete. 2023-10-16T19:41:20.461 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:20.466 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-10-16T19:41:18.578559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002813"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.505}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.374},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.26300000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.745}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.436}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.627}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.746}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.441}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:20.475 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:20.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.629+0000 7fc080cd0700 1 Processor -- start 2023-10-16T19:41:20.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.629+0000 7fc080cd0700 1 -- start start 2023-10-16T19:41:20.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc07c0c18b0 0x7fc07c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc07c14ff30 0x7fc07c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c152780 con 0x7fc07c14ff30 2023-10-16T19:41:20.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c1503c0 con 0x7fc07c0c18b0 2023-10-16T19:41:20.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc080cd0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0724a0 con 0x7fc07c06f6e0 2023-10-16T19:41:20.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc07ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc07c14ff30 0x7fc07c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc07ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc07c14ff30 0x7fc07c152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53766/0 (socket says 172.21.15.29:53766) 2023-10-16T19:41:20.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.630+0000 7fc07ad9d700 1 -- 172.21.15.29:0/2414836155 learned_addr learned my addr 172.21.15.29:0/2414836155 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:20.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc079d9b700 1 --2- 172.21.15.29:0/2414836155 >> v2:172.21.15.53:3300/0 conn(0x7fc07c0c18b0 0x7fc07c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07a59c700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 -- 172.21.15.29:0/2414836155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 msgr2=0x7fc07c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:20.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 -- 172.21.15.29:0/2414836155 >> v2:172.21.15.53:3300/0 conn(0x7fc07c0c18b0 msgr2=0x7fc07c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:20.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 --2- 172.21.15.29:0/2414836155 >> v2:172.21.15.53:3300/0 conn(0x7fc07c0c18b0 0x7fc07c14f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 -- 172.21.15.29:0/2414836155 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0c2660 con 0x7fc07c14ff30 2023-10-16T19:41:20.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07ad9d700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c14ff30 0x7fc07c152ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0713c0 tx=0x7fc07400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8fcc5f4126627e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07959a700 1 -- 172.21.15.29:0/2414836155 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400e070 con 0x7fc07c14ff30 2023-10-16T19:41:20.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07959a700 1 -- 172.21.15.29:0/2414836155 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07400b910 con 0x7fc07c14ff30 2023-10-16T19:41:20.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.631+0000 7fc07959a700 1 -- 172.21.15.29:0/2414836155 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400bcc0 con 0x7fc07c14ff30 2023-10-16T19:41:20.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 -- 172.21.15.29:0/2414836155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c14ff30 msgr2=0x7fc07c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c14ff30 0x7fc07c152ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0713c0 tx=0x7fc07400b330 comp rx=0 tx=0).stop 2023-10-16T19:41:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 -- 172.21.15.29:0/2414836155 shutdown_connections 2023-10-16T19:41:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c14ff30 0x7fc07c152ba0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 --2- 172.21.15.29:0/2414836155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 --2- 172.21.15.29:0/2414836155 >> v2:172.21.15.53:3300/0 conn(0x7fc07c0c18b0 0x7fc07c14f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 -- 172.21.15.29:0/2414836155 >> 172.21.15.29:0/2414836155 conn(0x7fc07c0c7110 msgr2=0x7fc07c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 -- 172.21.15.29:0/2414836155 shutdown_connections 2023-10-16T19:41:20.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.632+0000 7fc080cd0700 1 -- 172.21.15.29:0/2414836155 wait complete. 2023-10-16T19:41:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.633+0000 7fc080cd0700 1 Processor -- start 2023-10-16T19:41:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.633+0000 7fc080cd0700 1 -- start start 2023-10-16T19:41:20.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c1e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 0x7fc07c0c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1448f0 con 0x7fc07c0c18b0 2023-10-16T19:41:20.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c5c00 con 0x7fc07c14ff30 2023-10-16T19:41:20.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc080cd0700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1e8de0 con 0x7fc07c06f6e0 2023-10-16T19:41:20.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53770/0 (socket says 172.21.15.29:53770) 2023-10-16T19:41:20.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 -- 172.21.15.29:0/238083596 learned_addr learned my addr 172.21.15.29:0/238083596 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc07a59c700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c1e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc07ad9d700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 0x7fc07c0c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 -- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 msgr2=0x7fc07c1e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c1e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 -- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 msgr2=0x7fc07c0c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 0x7fc07c0c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 -- 172.21.15.29:0/238083596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009b30 con 0x7fc07c0c18b0 2023-10-16T19:41:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc07ad9d700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 0x7fc07c0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.634+0000 7fc079d9b700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9e0 tx=0x7fc06c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.635+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c009710 con 0x7fc07c0c18b0 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.635+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00c850 con 0x7fc07c0c18b0 2023-10-16T19:41:20.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.635+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c1e7de0 con 0x7fc07c0c18b0 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.635+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00cbc0 con 0x7fc07c0c18b0 2023-10-16T19:41:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.635+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c0c5920 con 0x7fc07c0c18b0 2023-10-16T19:41:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.636+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c0a8a30 con 0x7fc07c0c18b0 2023-10-16T19:41:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.636+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc06c00cd20 con 0x7fc07c0c18b0 2023-10-16T19:41:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.637+0000 7fc06affd700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 0x7fc05c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:20.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.637+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc06c089750 con 0x7fc07c0c18b0 2023-10-16T19:41:20.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.637+0000 7fc07a59c700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 0x7fc05c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:20.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.638+0000 7fc07a59c700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 0x7fc05c06d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc070009b60 tx=0x7fc070009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:20.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.643+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc07c0a8a30 con 0x7fc07c0c18b0 2023-10-16T19:41:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.839+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc07c0a8770 con 0x7fc05c06af30 2023-10-16T19:41:20.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.848+0000 7fc06affd700 1 -- 172.21.15.29:0/238083596 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289220 (secure 0 0 0) 0x7fc0700117e0 con 0x7fc05c06af30 2023-10-16T19:41:20.854 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 msgr2=0x7fc05c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 0x7fc05c06d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc070009b60 tx=0x7fc070009210 comp rx=0 tx=0).stop 2023-10-16T19:41:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 msgr2=0x7fc07c14db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9e0 tx=0x7fc06c00ecf0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 shutdown_connections 2023-10-16T19:41:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc05c06af30 0x7fc05c06d3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc07c14ff30 0x7fc07c0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc07c06f6e0 0x7fc07c1e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 --2- 172.21.15.29:0/238083596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc07c0c18b0 0x7fc07c14db80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:20.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 >> 172.21.15.29:0/238083596 conn(0x7fc07c0c7110 msgr2=0x7fc07c1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 shutdown_connections 2023-10-16T19:41:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:20.851+0000 7fc080cd0700 1 -- 172.21.15.29:0/238083596 wait complete. 2023-10-16T19:41:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:20.865 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-16T19:41:20.578995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.827666"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.505}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.374},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.26300000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.745}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.436}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.627}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.746}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.441}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:20.872 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T19:41:20.872 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.029+0000 7fbb49c47700 1 Processor -- start 2023-10-16T19:41:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.029+0000 7fbb49c47700 1 -- start start 2023-10-16T19:41:21.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb49c47700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb441532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb49c47700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb440724a0 con 0x7fbb44150100 2023-10-16T19:41:21.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb49c47700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb440c2660 con 0x7fbb4406f6e0 2023-10-16T19:41:21.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb49c47700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44152780 con 0x7fbb440c18b0 2023-10-16T19:41:21.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb42ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbb44150100 0x7fbb44152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39222/0 (socket says 172.21.15.29:39222) 2023-10-16T19:41:21.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb42ffd700 1 -- 172.21.15.29:0/2260263190 learned_addr learned my addr 172.21.15.29:0/2260263190 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:21.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb43fff700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb441532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501494191 0 0) 0x7fbb440724a0 con 0x7fbb44150100 2023-10-16T19:41:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c0035b0 con 0x7fbb44150100 2023-10-16T19:41:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657435190 0 0) 0x7fbb2c0035b0 con 0x7fbb44150100 2023-10-16T19:41:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 msgr2=0x7fbb441532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb441532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 >> v1:172.21.15.53:6789/0 conn(0x7fbb4406f6e0 legacy=0x7fbb4414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440a8490 con 0x7fbb44150100 2023-10-16T19:41:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.030+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fbb38001670 con 0x7fbb44150100 2023-10-16T19:41:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 >> v1:172.21.15.29:6789/0 conn(0x7fbb44150100 legacy=0x7fbb44152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb2c004d90 0x7fbb2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44152780 con 0x7fbb2c003a30 2023-10-16T19:41:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c00baf0 con 0x7fbb2c004d90 2023-10-16T19:41:21.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c00bcb0 con 0x7fbb440c18b0 2023-10-16T19:41:21.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb42ffd700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb43fff700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb2c004d90 0x7fbb2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 -- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 msgr2=0x7fbb2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb440c18b0 0x7fbb2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 -- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb2c004d90 msgr2=0x7fbb2c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb2c004d90 0x7fbb2c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 -- 172.21.15.29:0/2260263190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0035b0 con 0x7fbb2c003a30 2023-10-16T19:41:21.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb437fe700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb2c003e10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbb340018b0 tx=0x7fbb2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb0d9444a4f4792 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34001370 con 0x7fbb2c003a30 2023-10-16T19:41:21.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3400c6b0 con 0x7fbb2c003a30 2023-10-16T19:41:21.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.031+0000 7fbb427fc700 1 -- 172.21.15.29:0/2260263190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400ca60 con 0x7fbb2c003a30 2023-10-16T19:41:21.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 -- 172.21.15.29:0/2260263190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 msgr2=0x7fbb2c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 --2- 172.21.15.29:0/2260263190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb2c003e10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbb340018b0 tx=0x7fbb2c005880 comp rx=0 tx=0).stop 2023-10-16T19:41:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb43fff700 1 -- 172.21.15.29:0/2260263190 reap_dead start 2023-10-16T19:41:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 -- 172.21.15.29:0/2260263190 shutdown_connections 2023-10-16T19:41:21.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 -- 172.21.15.29:0/2260263190 >> 172.21.15.29:0/2260263190 conn(0x7fbb440c7110 msgr2=0x7fbb440c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 -- 172.21.15.29:0/2260263190 shutdown_connections 2023-10-16T19:41:21.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.032+0000 7fbb49c47700 1 -- 172.21.15.29:0/2260263190 wait complete. 2023-10-16T19:41:21.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.033+0000 7fbb49c47700 1 Processor -- start 2023-10-16T19:41:21.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.034+0000 7fbb49c47700 1 -- start start 2023-10-16T19:41:21.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb44148600 0x7fbb44140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 0x7fbb441e5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441e8a30 con 0x7fbb2c003a30 2023-10-16T19:41:21.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441e5e80 con 0x7fbb44148600 2023-10-16T19:41:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44148bc0 con 0x7fbb441e54c0 2023-10-16T19:41:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53788/0 (socket says 172.21.15.29:53788) 2023-10-16T19:41:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 -- 172.21.15.29:0/3562047543 learned_addr learned my addr 172.21.15.29:0/3562047543 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:21.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb43fff700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 0x7fbb441e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb42ffd700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb44148600 0x7fbb44140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 -- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 msgr2=0x7fbb441e5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 0x7fbb441e5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 -- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb44148600 msgr2=0x7fbb44140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb44148600 0x7fbb44140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 -- 172.21.15.29:0/3562047543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb441e8c80 con 0x7fbb2c003a30 2023-10-16T19:41:21.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb43fff700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 0x7fbb441e5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:21.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb437fe700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c460 tx=0x7fbb34001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34001370 con 0x7fbb2c003a30 2023-10-16T19:41:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3400cc30 con 0x7fbb2c003a30 2023-10-16T19:41:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb441e8f60 con 0x7fbb2c003a30 2023-10-16T19:41:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34003680 con 0x7fbb2c003a30 2023-10-16T19:41:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.035+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb440c3a90 con 0x7fbb2c003a30 2023-10-16T19:41:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.036+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb441e95b0 con 0x7fbb2c003a30 2023-10-16T19:41:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.037+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbb34023070 con 0x7fbb2c003a30 2023-10-16T19:41:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.037+0000 7fbb2bfff700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 0x7fbb3006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.037+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbb3408acc0 con 0x7fbb2c003a30 2023-10-16T19:41:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.037+0000 7fbb42ffd700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 0x7fbb3006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.038+0000 7fbb42ffd700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 0x7fbb3006d3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb440c4640 tx=0x7fbb38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.042+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb34055ca0 con 0x7fbb2c003a30 2023-10-16T19:41:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.240+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb440a8a50 con 0x7fbb3006af30 2023-10-16T19:41:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.250+0000 7fbb2bfff700 1 -- 172.21.15.29:0/3562047543 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289220 (secure 0 0 0) 0x7fbb38004cb0 con 0x7fbb3006af30 2023-10-16T19:41:21.255 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:21.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 msgr2=0x7fbb3006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 0x7fbb3006d3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb440c4640 tx=0x7fbb38009040 comp rx=0 tx=0).stop 2023-10-16T19:41:21.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 msgr2=0x7fbb44150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c460 tx=0x7fbb34001110 comp rx=0 tx=0).stop 2023-10-16T19:41:21.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 shutdown_connections 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbb3006af30 0x7fbb3006d3f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbb441e54c0 0x7fbb441e5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb2c003a30 0x7fbb44150ed0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 --2- 172.21.15.29:0/3562047543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb44148600 0x7fbb44140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 >> 172.21.15.29:0/3562047543 conn(0x7fbb440c7110 msgr2=0x7fbb44142e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 shutdown_connections 2023-10-16T19:41:21.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.253+0000 7fbb49c47700 1 -- 172.21.15.29:0/3562047543 wait complete. 2023-10-16T19:41:21.262 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:21.267 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-16T19:41:20.578995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.827666"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752496+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:08.752496+0000","last_peered":"2023-10-16T19:41:08.752496+0000","last_clean":"2023-10-16T19:41:08.752496+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:08.752496+0000","last_undegraded":"2023-10-16T19:41:08.752496+0000","last_fullsized":"2023-10-16T19:41:08.752496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:10.654524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752406+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:08.752406+0000","last_peered":"2023-10-16T19:41:08.752406+0000","last_clean":"2023-10-16T19:41:08.752406+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:08.752406+0000","last_undegraded":"2023-10-16T19:41:08.752406+0000","last_fullsized":"2023-10-16T19:41:08.752406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861650+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:09.861650+0000","last_peered":"2023-10-16T19:41:09.861650+0000","last_clean":"2023-10-16T19:41:09.861650+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:09.861650+0000","last_undegraded":"2023-10-16T19:41:09.861650+0000","last_fullsized":"2023-10-16T19:41:09.861650+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784663+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:08.784663+0000","last_peered":"2023-10-16T19:41:08.784663+0000","last_clean":"2023-10-16T19:41:08.784663+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:08.784663+0000","last_undegraded":"2023-10-16T19:41:08.784663+0000","last_fullsized":"2023-10-16T19:41:08.784663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:11.288089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784490+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:08.784490+0000","last_peered":"2023-10-16T19:41:08.784490+0000","last_clean":"2023-10-16T19:41:08.784490+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:08.784490+0000","last_undegraded":"2023-10-16T19:41:08.784490+0000","last_fullsized":"2023-10-16T19:41:08.784490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:45.604750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918395+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:09.918395+0000","last_peered":"2023-10-16T19:41:09.918395+0000","last_clean":"2023-10-16T19:41:09.918395+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:09.918395+0000","last_undegraded":"2023-10-16T19:41:09.918395+0000","last_fullsized":"2023-10-16T19:41:09.918395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752017+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:08.752017+0000","last_peered":"2023-10-16T19:41:08.752017+0000","last_clean":"2023-10-16T19:41:08.752017+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:08.752017+0000","last_undegraded":"2023-10-16T19:41:08.752017+0000","last_fullsized":"2023-10-16T19:41:08.752017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861683+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:09.861683+0000","last_peered":"2023-10-16T19:41:09.861683+0000","last_clean":"2023-10-16T19:41:09.861683+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:09.861683+0000","last_undegraded":"2023-10-16T19:41:09.861683+0000","last_fullsized":"2023-10-16T19:41:09.861683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861687+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:09.861687+0000","last_peered":"2023-10-16T19:41:09.861687+0000","last_clean":"2023-10-16T19:41:09.861687+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:09.861687+0000","last_undegraded":"2023-10-16T19:41:09.861687+0000","last_fullsized":"2023-10-16T19:41:09.861687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754008+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:08.754008+0000","last_peered":"2023-10-16T19:41:08.754008+0000","last_clean":"2023-10-16T19:41:08.754008+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:08.754008+0000","last_undegraded":"2023-10-16T19:41:08.754008+0000","last_fullsized":"2023-10-16T19:41:08.754008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784669+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:08.784669+0000","last_peered":"2023-10-16T19:41:08.784669+0000","last_clean":"2023-10-16T19:41:08.784669+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:08.784669+0000","last_undegraded":"2023-10-16T19:41:08.784669+0000","last_fullsized":"2023-10-16T19:41:08.784669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:18.958964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753535+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:08.753535+0000","last_peered":"2023-10-16T19:41:08.753535+0000","last_clean":"2023-10-16T19:41:08.753535+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:08.753535+0000","last_undegraded":"2023-10-16T19:41:08.753535+0000","last_fullsized":"2023-10-16T19:41:08.753535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784409+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784409+0000","last_peered":"2023-10-16T19:41:08.784409+0000","last_clean":"2023-10-16T19:41:08.784409+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:08.784409+0000","last_undegraded":"2023-10-16T19:41:08.784409+0000","last_fullsized":"2023-10-16T19:41:08.784409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:06.761620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918740+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:09.918740+0000","last_peered":"2023-10-16T19:41:09.918740+0000","last_clean":"2023-10-16T19:41:09.918740+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:09.918740+0000","last_undegraded":"2023-10-16T19:41:09.918740+0000","last_fullsized":"2023-10-16T19:41:09.918740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918225+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:09.918225+0000","last_peered":"2023-10-16T19:41:09.918225+0000","last_clean":"2023-10-16T19:41:09.918225+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:09.918225+0000","last_undegraded":"2023-10-16T19:41:09.918225+0000","last_fullsized":"2023-10-16T19:41:09.918225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919010+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:09.919010+0000","last_peered":"2023-10-16T19:41:09.919010+0000","last_clean":"2023-10-16T19:41:09.919010+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:09.919010+0000","last_undegraded":"2023-10-16T19:41:09.919010+0000","last_fullsized":"2023-10-16T19:41:09.919010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861518+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:09.861518+0000","last_peered":"2023-10-16T19:41:09.861518+0000","last_clean":"2023-10-16T19:41:09.861518+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:09.861518+0000","last_undegraded":"2023-10-16T19:41:09.861518+0000","last_fullsized":"2023-10-16T19:41:09.861518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754500+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:08.754500+0000","last_peered":"2023-10-16T19:41:08.754500+0000","last_clean":"2023-10-16T19:41:08.754500+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:08.754500+0000","last_undegraded":"2023-10-16T19:41:08.754500+0000","last_fullsized":"2023-10-16T19:41:08.754500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918704+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:09.918704+0000","last_peered":"2023-10-16T19:41:09.918704+0000","last_clean":"2023-10-16T19:41:09.918704+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:09.918704+0000","last_undegraded":"2023-10-16T19:41:09.918704+0000","last_fullsized":"2023-10-16T19:41:09.918704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:25.590961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752510+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:08.752510+0000","last_peered":"2023-10-16T19:41:08.752510+0000","last_clean":"2023-10-16T19:41:08.752510+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:08.752510+0000","last_undegraded":"2023-10-16T19:41:08.752510+0000","last_fullsized":"2023-10-16T19:41:08.752510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:22.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754513+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:08.754513+0000","last_peered":"2023-10-16T19:41:08.754513+0000","last_clean":"2023-10-16T19:41:08.754513+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:08.754513+0000","last_undegraded":"2023-10-16T19:41:08.754513+0000","last_fullsized":"2023-10-16T19:41:08.754513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861440+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:09.861440+0000","last_peered":"2023-10-16T19:41:09.861440+0000","last_clean":"2023-10-16T19:41:09.861440+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:09.861440+0000","last_undegraded":"2023-10-16T19:41:09.861440+0000","last_fullsized":"2023-10-16T19:41:09.861440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753712+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:08.753712+0000","last_peered":"2023-10-16T19:41:08.753712+0000","last_clean":"2023-10-16T19:41:08.753712+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:08.753712+0000","last_undegraded":"2023-10-16T19:41:08.753712+0000","last_fullsized":"2023-10-16T19:41:08.753712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918251+0000","last_change":"2023-10-16T19:41:06.754220+0000","last_active":"2023-10-16T19:41:09.918251+0000","last_peered":"2023-10-16T19:41:09.918251+0000","last_clean":"2023-10-16T19:41:09.918251+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:09.918251+0000","last_undegraded":"2023-10-16T19:41:09.918251+0000","last_fullsized":"2023-10-16T19:41:09.918251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752305+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:08.752305+0000","last_peered":"2023-10-16T19:41:08.752305+0000","last_clean":"2023-10-16T19:41:08.752305+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:08.752305+0000","last_undegraded":"2023-10-16T19:41:08.752305+0000","last_fullsized":"2023-10-16T19:41:08.752305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753299+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:08.753299+0000","last_peered":"2023-10-16T19:41:08.753299+0000","last_clean":"2023-10-16T19:41:08.753299+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:08.753299+0000","last_undegraded":"2023-10-16T19:41:08.753299+0000","last_fullsized":"2023-10-16T19:41:08.753299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:58.730901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784659+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:08.784659+0000","last_peered":"2023-10-16T19:41:08.784659+0000","last_clean":"2023-10-16T19:41:08.784659+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:08.784659+0000","last_undegraded":"2023-10-16T19:41:08.784659+0000","last_fullsized":"2023-10-16T19:41:08.784659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:32.640907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752583+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:08.752583+0000","last_peered":"2023-10-16T19:41:08.752583+0000","last_clean":"2023-10-16T19:41:08.752583+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:08.752583+0000","last_undegraded":"2023-10-16T19:41:08.752583+0000","last_fullsized":"2023-10-16T19:41:08.752583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:16.484145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861501+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:09.861501+0000","last_peered":"2023-10-16T19:41:09.861501+0000","last_clean":"2023-10-16T19:41:09.861501+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:09.861501+0000","last_undegraded":"2023-10-16T19:41:09.861501+0000","last_fullsized":"2023-10-16T19:41:09.861501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754206+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:08.754206+0000","last_peered":"2023-10-16T19:41:08.754206+0000","last_clean":"2023-10-16T19:41:08.754206+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:08.754206+0000","last_undegraded":"2023-10-16T19:41:08.754206+0000","last_fullsized":"2023-10-16T19:41:08.754206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:59:48.052661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752267+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:08.752267+0000","last_peered":"2023-10-16T19:41:08.752267+0000","last_clean":"2023-10-16T19:41:08.752267+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:08.752267+0000","last_undegraded":"2023-10-16T19:41:08.752267+0000","last_fullsized":"2023-10-16T19:41:08.752267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:43.241963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861254+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:09.861254+0000","last_peered":"2023-10-16T19:41:09.861254+0000","last_clean":"2023-10-16T19:41:09.861254+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:09.861254+0000","last_undegraded":"2023-10-16T19:41:09.861254+0000","last_fullsized":"2023-10-16T19:41:09.861254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:59.320699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752294+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:08.752294+0000","last_peered":"2023-10-16T19:41:08.752294+0000","last_clean":"2023-10-16T19:41:08.752294+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:08.752294+0000","last_undegraded":"2023-10-16T19:41:08.752294+0000","last_fullsized":"2023-10-16T19:41:08.752294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752582+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:08.752582+0000","last_peered":"2023-10-16T19:41:08.752582+0000","last_clean":"2023-10-16T19:41:08.752582+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:08.752582+0000","last_undegraded":"2023-10-16T19:41:08.752582+0000","last_fullsized":"2023-10-16T19:41:08.752582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:17:55.307902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918490+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:09.918490+0000","last_peered":"2023-10-16T19:41:09.918490+0000","last_clean":"2023-10-16T19:41:09.918490+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:09.918490+0000","last_undegraded":"2023-10-16T19:41:09.918490+0000","last_fullsized":"2023-10-16T19:41:09.918490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:11.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752146+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:08.752146+0000","last_peered":"2023-10-16T19:41:08.752146+0000","last_clean":"2023-10-16T19:41:08.752146+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:08.752146+0000","last_undegraded":"2023-10-16T19:41:08.752146+0000","last_fullsized":"2023-10-16T19:41:08.752146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752160+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:08.752160+0000","last_peered":"2023-10-16T19:41:08.752160+0000","last_clean":"2023-10-16T19:41:08.752160+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:08.752160+0000","last_undegraded":"2023-10-16T19:41:08.752160+0000","last_fullsized":"2023-10-16T19:41:08.752160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754483+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:08.754483+0000","last_peered":"2023-10-16T19:41:08.754483+0000","last_clean":"2023-10-16T19:41:08.754483+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:08.754483+0000","last_undegraded":"2023-10-16T19:41:08.754483+0000","last_fullsized":"2023-10-16T19:41:08.754483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:42.162645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754661+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:08.754661+0000","last_peered":"2023-10-16T19:41:08.754661+0000","last_clean":"2023-10-16T19:41:08.754661+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:08.754661+0000","last_undegraded":"2023-10-16T19:41:08.754661+0000","last_fullsized":"2023-10-16T19:41:08.754661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784722+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:08.784722+0000","last_peered":"2023-10-16T19:41:08.784722+0000","last_clean":"2023-10-16T19:41:08.784722+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:08.784722+0000","last_undegraded":"2023-10-16T19:41:08.784722+0000","last_fullsized":"2023-10-16T19:41:08.784722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:56.855281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784668+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:08.784668+0000","last_peered":"2023-10-16T19:41:08.784668+0000","last_clean":"2023-10-16T19:41:08.784668+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:08.784668+0000","last_undegraded":"2023-10-16T19:41:08.784668+0000","last_fullsized":"2023-10-16T19:41:08.784668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:04.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918492+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:09.918492+0000","last_peered":"2023-10-16T19:41:09.918492+0000","last_clean":"2023-10-16T19:41:09.918492+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:09.918492+0000","last_undegraded":"2023-10-16T19:41:09.918492+0000","last_fullsized":"2023-10-16T19:41:09.918492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784494+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:08.784494+0000","last_peered":"2023-10-16T19:41:08.784494+0000","last_clean":"2023-10-16T19:41:08.784494+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:08.784494+0000","last_undegraded":"2023-10-16T19:41:08.784494+0000","last_fullsized":"2023-10-16T19:41:08.784494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:02:16.579059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861339+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:09.861339+0000","last_peered":"2023-10-16T19:41:09.861339+0000","last_clean":"2023-10-16T19:41:09.861339+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:09.861339+0000","last_undegraded":"2023-10-16T19:41:09.861339+0000","last_fullsized":"2023-10-16T19:41:09.861339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:23.227583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784461+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:08.784461+0000","last_peered":"2023-10-16T19:41:08.784461+0000","last_clean":"2023-10-16T19:41:08.784461+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:08.784461+0000","last_undegraded":"2023-10-16T19:41:08.784461+0000","last_fullsized":"2023-10-16T19:41:08.784461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:27.352008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752198+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:08.752198+0000","last_peered":"2023-10-16T19:41:08.752198+0000","last_clean":"2023-10-16T19:41:08.752198+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:08.752198+0000","last_undegraded":"2023-10-16T19:41:08.752198+0000","last_fullsized":"2023-10-16T19:41:08.752198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.784501+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:08.784501+0000","last_peered":"2023-10-16T19:41:08.784501+0000","last_clean":"2023-10-16T19:41:08.784501+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:08.784501+0000","last_undegraded":"2023-10-16T19:41:08.784501+0000","last_fullsized":"2023-10-16T19:41:08.784501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:07:42.186548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918365+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:09.918365+0000","last_peered":"2023-10-16T19:41:09.918365+0000","last_clean":"2023-10-16T19:41:09.918365+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:09.918365+0000","last_undegraded":"2023-10-16T19:41:09.918365+0000","last_fullsized":"2023-10-16T19:41:09.918365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:13.129267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.895328+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:08.895328+0000","last_peered":"2023-10-16T19:41:08.895328+0000","last_clean":"2023-10-16T19:41:08.895328+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:08.895328+0000","last_undegraded":"2023-10-16T19:41:08.895328+0000","last_fullsized":"2023-10-16T19:41:08.895328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:57:20.949610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752513+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:08.752513+0000","last_peered":"2023-10-16T19:41:08.752513+0000","last_clean":"2023-10-16T19:41:08.752513+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:08.752513+0000","last_undegraded":"2023-10-16T19:41:08.752513+0000","last_fullsized":"2023-10-16T19:41:08.752513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:19.755076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861507+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:09.861507+0000","last_peered":"2023-10-16T19:41:09.861507+0000","last_clean":"2023-10-16T19:41:09.861507+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:09.861507+0000","last_undegraded":"2023-10-16T19:41:09.861507+0000","last_fullsized":"2023-10-16T19:41:09.861507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:44.716252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861274+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:09.861274+0000","last_peered":"2023-10-16T19:41:09.861274+0000","last_clean":"2023-10-16T19:41:09.861274+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:09.861274+0000","last_undegraded":"2023-10-16T19:41:09.861274+0000","last_fullsized":"2023-10-16T19:41:09.861274+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:00.735434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.861578+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:09.861578+0000","last_peered":"2023-10-16T19:41:09.861578+0000","last_clean":"2023-10-16T19:41:09.861578+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:09.861578+0000","last_undegraded":"2023-10-16T19:41:09.861578+0000","last_fullsized":"2023-10-16T19:41:09.861578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:31.418273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918323+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:09.918323+0000","last_peered":"2023-10-16T19:41:09.918323+0000","last_clean":"2023-10-16T19:41:09.918323+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:09.918323+0000","last_undegraded":"2023-10-16T19:41:09.918323+0000","last_fullsized":"2023-10-16T19:41:09.918323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753855+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:08.753855+0000","last_peered":"2023-10-16T19:41:08.753855+0000","last_clean":"2023-10-16T19:41:08.753855+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:08.753855+0000","last_undegraded":"2023-10-16T19:41:08.753855+0000","last_fullsized":"2023-10-16T19:41:08.753855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753478+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:08.753478+0000","last_peered":"2023-10-16T19:41:08.753478+0000","last_clean":"2023-10-16T19:41:08.753478+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:08.753478+0000","last_undegraded":"2023-10-16T19:41:08.753478+0000","last_fullsized":"2023-10-16T19:41:08.753478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.752036+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:08.752036+0000","last_peered":"2023-10-16T19:41:08.752036+0000","last_clean":"2023-10-16T19:41:08.752036+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:08.752036+0000","last_undegraded":"2023-10-16T19:41:08.752036+0000","last_fullsized":"2023-10-16T19:41:08.752036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.628},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.505}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.374},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.26300000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.745}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.436}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.317}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.627}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.746}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.441}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:21.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:41:21.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 Processor -- start 2023-10-16T19:41:21.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 -- start start 2023-10-16T19:41:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 0x7f23d4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40724a0 con 0x7f23d406f6e0 2023-10-16T19:41:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d4152780 con 0x7f23d40c18b0 2023-10-16T19:41:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.431+0000 7f23d97d4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40c2660 con 0x7f23d4150100 2023-10-16T19:41:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 0x7f23d4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d37fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 0x7f23d4152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:44086/0 (socket says 172.21.15.29:44086) 2023-10-16T19:41:21.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:46252/0 (socket says 172.21.15.29:46252) 2023-10-16T19:41:21.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d2ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f23d406f6e0 0x7f23d414f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.29:33834/0 (socket says 172.21.15.29:33834) 2023-10-16T19:41:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d37fe700 1 -- 172.21.15.29:0/353939887 learned_addr learned my addr 172.21.15.29:0/353939887 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 -- 172.21.15.29:0/353939887 >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 msgr2=0x7f23d4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 --2- 172.21.15.29:0/353939887 >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 0x7f23d4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 -- 172.21.15.29:0/353939887 >> v1:172.21.15.53:6789/0 conn(0x7f23d406f6e0 legacy=0x7f23d414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 -- 172.21.15.29:0/353939887 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40a8490 con 0x7f23d4150100 2023-10-16T19:41:21.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d27fc700 1 --2- 172.21.15.29:0/353939887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009840 tx=0x7f23c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=986bd191bb6ab218 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.432+0000 7f23d1ffb700 1 -- 172.21.15.29:0/353939887 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8011830 con 0x7f23d4150100 2023-10-16T19:41:21.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d1ffb700 1 -- 172.21.15.29:0/353939887 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8011990 con 0x7f23d4150100 2023-10-16T19:41:21.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d1ffb700 1 -- 172.21.15.29:0/353939887 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8011d20 con 0x7f23d4150100 2023-10-16T19:41:21.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 -- 172.21.15.29:0/353939887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 msgr2=0x7f23d4156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 --2- 172.21.15.29:0/353939887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009840 tx=0x7f23c8009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:21.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 -- 172.21.15.29:0/353939887 shutdown_connections 2023-10-16T19:41:21.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 --2- 172.21.15.29:0/353939887 >> v2:172.21.15.53:3300/0 conn(0x7f23d40c18b0 0x7f23d4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 --2- 172.21.15.29:0/353939887 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d4150100 0x7f23d4156670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 -- 172.21.15.29:0/353939887 >> 172.21.15.29:0/353939887 conn(0x7f23d40c7110 msgr2=0x7f23d40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 -- 172.21.15.29:0/353939887 shutdown_connections 2023-10-16T19:41:21.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.433+0000 7f23d97d4700 1 -- 172.21.15.29:0/353939887 wait complete. 2023-10-16T19:41:21.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.434+0000 7f23d97d4700 1 Processor -- start 2023-10-16T19:41:21.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.434+0000 7f23d97d4700 1 -- start start 2023-10-16T19:41:21.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d406f6e0 0x7f23d4148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 0x7f23d41e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41ea990 con 0x7f23d4150100 2023-10-16T19:41:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41e9d80 con 0x7f23d406f6e0 2023-10-16T19:41:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d97d4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41ea060 con 0x7f23d40c18b0 2023-10-16T19:41:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53806/0 (socket says 172.21.15.29:53806) 2023-10-16T19:41:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d37fe700 1 -- 172.21.15.29:0/1189406920 learned_addr learned my addr 172.21.15.29:0/1189406920 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:21.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.435+0000 7f23d27fc700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 0x7f23d41e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d2ffd700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d406f6e0 0x7f23d4148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 -- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 msgr2=0x7f23d41e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 0x7f23d41e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 -- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d406f6e0 msgr2=0x7f23d4148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d406f6e0 0x7f23d4148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 -- 172.21.15.29:0/1189406920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80094a0 con 0x7f23d4150100 2023-10-16T19:41:21.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d27fc700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 0x7f23d41e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:21.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d37fe700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00efc0 tx=0x7f23cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc003c70 con 0x7f23d4150100 2023-10-16T19:41:21.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00f040 con 0x7f23d4150100 2023-10-16T19:41:21.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d41ea340 con 0x7f23d4150100 2023-10-16T19:41:21.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00c930 con 0x7f23d4150100 2023-10-16T19:41:21.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.436+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d4148b50 con 0x7f23d4150100 2023-10-16T19:41:21.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.437+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d41eab00 con 0x7f23d4150100 2023-10-16T19:41:21.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.438+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f23cc00ca90 con 0x7f23d4150100 2023-10-16T19:41:21.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.438+0000 7f23bb7fe700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 0x7f23c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:21.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.438+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f23cc089b70 con 0x7f23d4150100 2023-10-16T19:41:21.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.438+0000 7f23d2ffd700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 0x7f23c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:21.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.439+0000 7f23d2ffd700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 0x7f23c006d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000f60 tx=0x7f23c4007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:21.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.442+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23cc054b50 con 0x7f23d4150100 2023-10-16T19:41:21.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.644+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d404f400 con 0x7f23d4150100 2023-10-16T19:41:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.645+0000 7f23bb7fe700 1 -- 172.21.15.29:0/1189406920 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16722 (secure 0 0 0) 0x7f23cc058170 con 0x7f23d4150100 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":40,"fsid":"b5b71d99-0d95-4cc7-b379-31b38eac533d","created":"2023-10-16T19:39:34.668690+0000","modified":"2023-10-16T19:41:08.746449+0000","last_up_change":"2023-10-16T19:39:44.907934+0000","last_in_change":"2023-10-16T19:39:37.168111+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:39:46.612204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:41:04.991651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:41:06.133968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06866353-b172-43cf-b49c-f51bea367ed6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6801","nonce":1770422682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6803","nonce":1770422682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6807","nonce":1770422682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1770422682},{"type":"v1","addr":"172.21.15.29:6805","nonce":1770422682}]},"public_addr":"172.21.15.29:6801/1770422682","cluster_addr":"172.21.15.29:6803/1770422682","heartbeat_back_addr":"172.21.15.29:6807/1770422682","heartbeat_front_addr":"172.21.15.29:6805/1770422682","state":["exists","up"]},{"osd":1,"uuid":"1c40f570-d9a4-459c-8117-ec0ceeb6ac21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6817","nonce":902088959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6820","nonce":902088959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6828","nonce":902088959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":902088959},{"type":"v1","addr":"172.21.15.29:6824","nonce":902088959}]},"public_addr":"172.21.15.29:6817/902088959","cluster_addr":"172.21.15.29:6820/902088959","heartbeat_back_addr":"172.21.15.29:6828/902088959","heartbeat_front_addr":"172.21.15.29:6824/902088959","state":["exists","up"]},{"osd":2,"uuid":"ab4e905e-cd2e-4796-a59b-687c97a91693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6809","nonce":365921754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6811","nonce":365921754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6815","nonce":365921754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":365921754},{"type":"v1","addr":"172.21.15.29:6813","nonce":365921754}]},"public_addr":"172.21.15.29:6809/365921754","cluster_addr":"172.21.15.29:6811/365921754","heartbeat_back_addr":"172.21.15.29:6815/365921754","heartbeat_front_addr":"172.21.15.29:6813/365921754","state":["exists","up"]},{"osd":3,"uuid":"e7423588-87f9-46e0-abe9-d6d07cb76ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6819","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6821","nonce":1600164100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6825","nonce":1600164100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6831","nonce":1600164100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1600164100},{"type":"v1","addr":"172.21.15.29:6829","nonce":1600164100}]},"public_addr":"172.21.15.29:6821/1600164100","cluster_addr":"172.21.15.29:6825/1600164100","heartbeat_back_addr":"172.21.15.29:6831/1600164100","heartbeat_front_addr":"172.21.15.29:6829/1600164100","state":["exists","up"]},{"osd":4,"uuid":"c07bcb23-0ea5-4925-8f3c-10b958cad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6817","nonce":4281980506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6819","nonce":4281980506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6823","nonce":4281980506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4281980506},{"type":"v1","addr":"172.21.15.53:6821","nonce":4281980506}]},"public_addr":"172.21.15.53:6817/4281980506","cluster_addr":"172.21.15.53:6819/4281980506","heartbeat_back_addr":"172.21.15.53:6823/4281980506","heartbeat_front_addr":"172.21.15.53:6821/4281980506","state":["exists","up"]},{"osd":5,"uuid":"d72ef02a-fb95-4fc4-a63e-28b1a61eccf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6801","nonce":1208523159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6803","nonce":1208523159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6807","nonce":1208523159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1208523159},{"type":"v1","addr":"172.21.15.53:6805","nonce":1208523159}]},"public_addr":"172.21.15.53:6801/1208523159","cluster_addr":"172.21.15.53:6803/1208523159","heartbeat_back_addr":"172.21.15.53:6807/1208523159","heartbeat_front_addr":"172.21.15.53:6805/1208523159","state":["exists","up"]},{"osd":6,"uuid":"ec63487a-5c95-434f-b496-45772807e42a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6809","nonce":196702031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6811","nonce":196702031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6815","nonce":196702031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":196702031},{"type":"v1","addr":"172.21.15.53:6813","nonce":196702031}]},"public_addr":"172.21.15.53:6809/196702031","cluster_addr":"172.21.15.53:6811/196702031","heartbeat_back_addr":"172.21.15.53:6815/196702031","heartbeat_front_addr":"172.21.15.53:6813/196702031","state":["exists","up"]},{"osd":7,"uuid":"9d9ffdc4-4fc0-4e2d-9cc4-5717df2dd1e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6825","nonce":2487489897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6827","nonce":2487489897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6831","nonce":2487489897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2487489897},{"type":"v1","addr":"172.21.15.53:6829","nonce":2487489897}]},"public_addr":"172.21.15.53:6825/2487489897","cluster_addr":"172.21.15.53:6827/2487489897","heartbeat_back_addr":"172.21.15.53:6831/2487489897","heartbeat_front_addr":"172.21.15.53:6829/2487489897","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.328782+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.411923+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.407356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.368126+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.447179+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.304740+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.324001+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:39:42.400752+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:41:21.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 msgr2=0x7f23c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 0x7f23c006d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000f60 tx=0x7f23c4007d30 comp rx=0 tx=0).stop 2023-10-16T19:41:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 msgr2=0x7f23d41e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00efc0 tx=0x7f23cc00c3a0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 shutdown_connections 2023-10-16T19:41:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f23c006af00 0x7f23c006d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23d4150100 0x7f23d41e7440 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d406f6e0 0x7f23d4148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 --2- 172.21.15.29:0/1189406920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f23d40c18b0 0x7f23d41e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 >> 172.21.15.29:0/1189406920 conn(0x7f23d40c7110 msgr2=0x7f23d4071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 shutdown_connections 2023-10-16T19:41:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:21.648+0000 7f23d97d4700 1 -- 172.21.15.29:0/1189406920 wait complete. 2023-10-16T19:41:22.663 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T19:41:22.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:22.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.807+0000 7f14cc6ea700 1 Processor -- start 2023-10-16T19:41:22.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.807+0000 7f14cc6ea700 1 -- start start 2023-10-16T19:41:22.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cc6ea700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c406ede0 0x7f14c40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cc6ea700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14c40c3ac0 0x7f14c40c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cc6ea700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c41581b0 con 0x7f14c40c33a0 2023-10-16T19:41:22.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cc6ea700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c4158490 con 0x7f14c40c3ac0 2023-10-16T19:41:22.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cc6ea700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4158770 con 0x7f14c406ede0 2023-10-16T19:41:22.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cac87700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14c40c3ac0 0x7f14c40c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14c9c85700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14c40c33a0 0x7f14c406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39254/0 (socket says 172.21.15.29:39254) 2023-10-16T19:41:22.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14c9c85700 1 -- 172.21.15.29:0/220672091 learned_addr learned my addr 172.21.15.29:0/220672091 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:22.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14ca486700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c406ede0 0x7f14c40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cac87700 1 -- 172.21.15.29:0/220672091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c406ede0 msgr2=0x7f14c40a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:22.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cac87700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c406ede0 0x7f14c40a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cac87700 1 -- 172.21.15.29:0/220672091 >> v1:172.21.15.29:6789/0 conn(0x7f14c40c33a0 legacy=0x7f14c406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14cac87700 1 -- 172.21.15.29:0/220672091 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4158a50 con 0x7f14c40c3ac0 2023-10-16T19:41:22.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.808+0000 7f14c9484700 1 -- 172.21.15.29:0/220672091 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511051668 0 0) 0x7f14c41581b0 con 0x7f14c40c33a0 2023-10-16T19:41:22.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cac87700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c3ac0 0x7f14c40c3ed0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009d90 tx=0x7f14bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31490bb12019aa04 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14c9484700 1 -- 172.21.15.29:0/220672091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00e070 con 0x7f14c40c3ac0 2023-10-16T19:41:22.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14c9484700 1 -- 172.21.15.29:0/220672091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00bbd0 con 0x7f14c40c3ac0 2023-10-16T19:41:22.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14c9484700 1 -- 172.21.15.29:0/220672091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc012430 con 0x7f14c40c3ac0 2023-10-16T19:41:22.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 -- 172.21.15.29:0/220672091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c3ac0 msgr2=0x7f14c40c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c3ac0 0x7f14c40c3ed0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009d90 tx=0x7f14bc00b330 comp rx=0 tx=0).stop 2023-10-16T19:41:22.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 -- 172.21.15.29:0/220672091 shutdown_connections 2023-10-16T19:41:22.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c3ac0 0x7f14c40c3ed0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/220672091 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c406ede0 0x7f14c40a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 -- 172.21.15.29:0/220672091 >> 172.21.15.29:0/220672091 conn(0x7f14c40c7150 msgr2=0x7f14c40c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 -- 172.21.15.29:0/220672091 shutdown_connections 2023-10-16T19:41:22.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.809+0000 7f14cc6ea700 1 -- 172.21.15.29:0/220672091 wait complete. 2023-10-16T19:41:22.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 Processor -- start 2023-10-16T19:41:22.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 -- start start 2023-10-16T19:41:22.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c406ede0 0x7f14c40a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 0x7f14c4155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c40c3ac0 0x7f14c4155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4154b00 con 0x7f14c40c33a0 2023-10-16T19:41:22.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4153ef0 con 0x7f14c406ede0 2023-10-16T19:41:22.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14cc6ea700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4154160 con 0x7f14c40c3ac0 2023-10-16T19:41:22.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14c9c85700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 0x7f14c4155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14c9c85700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 0x7f14c4155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53818/0 (socket says 172.21.15.29:53818) 2023-10-16T19:41:22.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.811+0000 7f14c9c85700 1 -- 172.21.15.29:0/1806102862 learned_addr learned my addr 172.21.15.29:0/1806102862 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:22.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14cac87700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c40c3ac0 0x7f14c4155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14ca486700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c406ede0 0x7f14c40a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 -- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c40c3ac0 msgr2=0x7f14c4155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c40c3ac0 0x7f14c4155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 -- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c406ede0 msgr2=0x7f14c40a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c406ede0 0x7f14c40a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009a70 con 0x7f14c40c33a0 2023-10-16T19:41:22.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14cac87700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f14c40c3ac0 0x7f14c4155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:22.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14c9c85700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 0x7f14c4155020 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c750 tx=0x7f14c000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0004c80 con 0x7f14c40c33a0 2023-10-16T19:41:22.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0004e00 con 0x7f14c40c33a0 2023-10-16T19:41:22.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c4154440 con 0x7f14c40c33a0 2023-10-16T19:41:22.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0007310 con 0x7f14c40c33a0 2023-10-16T19:41:22.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.812+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c40a7170 con 0x7f14c40c33a0 2023-10-16T19:41:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.813+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14c4158d30 con 0x7f14c40c33a0 2023-10-16T19:41:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14c0007470 con 0x7f14c40c33a0 2023-10-16T19:41:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f14a806af00 0x7f14a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f14c0089d70 con 0x7f14c40c33a0 2023-10-16T19:41:22.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f14a8073690 0x7f14a8075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14a80761e0 con 0x7f14a8073690 2023-10-16T19:41:22.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14c008a1c0 con 0x7f14c40c33a0 2023-10-16T19:41:22.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14ca486700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f14a806af00 0x7f14a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.814+0000 7f14cac87700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f14a8073690 0x7f14a8075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.815+0000 7f14cac87700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f14a8073690 0x7f14a8075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.815+0000 7f14ca486700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f14a806af00 0x7f14a806d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009950 tx=0x7f14b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.815+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== osd.0 v2:172.21.15.29:6800/1770422682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f14a80761e0 con 0x7f14a8073690 2023-10-16T19:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.830+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 --> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f14c4154c40 con 0x7f14a8073690 2023-10-16T19:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.830+0000 7f14baffd700 1 -- 172.21.15.29:0/1806102862 <== osd.0 v2:172.21.15.29:6800/1770422682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f14c4154c40 con 0x7f14a8073690 2023-10-16T19:41:22.834 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:22.835 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:22.835 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:22.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f14a8073690 msgr2=0x7f14a8075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:6800/1770422682,v1:172.21.15.29:6801/1770422682] conn(0x7f14a8073690 0x7f14a8075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f14a806af00 msgr2=0x7f14a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f14a806af00 0x7f14a806d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009950 tx=0x7f14b4008040 comp rx=0 tx=0).stop 2023-10-16T19:41:22.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 msgr2=0x7f14c4155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 --2- 172.21.15.29:0/1806102862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c40c33a0 0x7f14c4155020 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c750 tx=0x7f14c000cb10 comp rx=0 tx=0).stop 2023-10-16T19:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cac87700 1 -- 172.21.15.29:0/1806102862 reap_dead start 2023-10-16T19:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 shutdown_connections 2023-10-16T19:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 >> 172.21.15.29:0/1806102862 conn(0x7f14c40c7150 msgr2=0x7f14c40720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 shutdown_connections 2023-10-16T19:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.831+0000 7f14cc6ea700 1 -- 172.21.15.29:0/1806102862 wait complete. 2023-10-16T19:41:22.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T19:41:22.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.969+0000 7fbd103a2700 1 Processor -- start 2023-10-16T19:41:22.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.969+0000 7fbd103a2700 1 -- start start 2023-10-16T19:41:22.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd103a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 0x7fbd0806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd103a2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd08152300 con 0x7fbd080c3350 2023-10-16T19:41:22.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd103a2700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080c2e40 con 0x7fbd0814ec50 2023-10-16T19:41:22.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd103a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814f030 con 0x7fbd081555b0 2023-10-16T19:41:22.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d93d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd080c3350 0x7fbd0806db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39272/0 (socket says 172.21.15.29:39272) 2023-10-16T19:41:22.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d93d700 1 -- 172.21.15.29:0/2925113556 learned_addr learned my addr 172.21.15.29:0/2925113556 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:22.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0e93f700 1 --2- 172.21.15.29:0/2925113556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 0x7fbd0806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290393897 0 0) 0x7fbd08152300 con 0x7fbd080c3350 2023-10-16T19:41:22.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf40035b0 con 0x7fbd080c3350 2023-10-16T19:41:22.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421917849 0 0) 0x7fbd080c2e40 con 0x7fbd0814ec50 2023-10-16T19:41:22.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08152300 con 0x7fbd0814ec50 2023-10-16T19:41:22.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0e93f700 1 -- 172.21.15.29:0/2925113556 >> v1:172.21.15.53:6789/0 conn(0x7fbd0814ec50 legacy=0x7fbd08071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0e93f700 1 -- 172.21.15.29:0/2925113556 >> v1:172.21.15.29:6789/0 conn(0x7fbd080c3350 legacy=0x7fbd0806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064498341 0 0) 0x7fbcf40035b0 con 0x7fbd080c3350 2023-10-16T19:41:22.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.970+0000 7fbd0e93f700 1 -- 172.21.15.29:0/2925113556 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08155a60 con 0x7fbd081555b0 2023-10-16T19:41:22.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd0e93f700 1 --2- 172.21.15.29:0/2925113556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 0x7fbd0806e210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009dc0 tx=0x7fbd0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785a764114ad846 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000e070 con 0x7fbd081555b0 2023-10-16T19:41:22.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00003a70 con 0x7fbd081555b0 2023-10-16T19:41:22.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd0d13c700 1 -- 172.21.15.29:0/2925113556 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8001670 con 0x7fbd081555b0 2023-10-16T19:41:22.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 -- 172.21.15.29:0/2925113556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 msgr2=0x7fbd0806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 --2- 172.21.15.29:0/2925113556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 0x7fbd0806e210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009dc0 tx=0x7fbd0000b330 comp rx=0 tx=0).stop 2023-10-16T19:41:22.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 -- 172.21.15.29:0/2925113556 shutdown_connections 2023-10-16T19:41:22.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 --2- 172.21.15.29:0/2925113556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd081555b0 0x7fbd0806e210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 -- 172.21.15.29:0/2925113556 >> 172.21.15.29:0/2925113556 conn(0x7fbd080c7110 msgr2=0x7fbd080c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:22.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 -- 172.21.15.29:0/2925113556 shutdown_connections 2023-10-16T19:41:22.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.971+0000 7fbd103a2700 1 -- 172.21.15.29:0/2925113556 wait complete. 2023-10-16T19:41:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.972+0000 7fbd103a2700 1 Processor -- start 2023-10-16T19:41:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 -- start start 2023-10-16T19:41:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 0x7fbd081529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd081555b0 0x7fbd081e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081e7a60 con 0x7fbd0814ec50 2023-10-16T19:41:22.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081eb830 con 0x7fbd081555b0 2023-10-16T19:41:22.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd103a2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081ebd60 con 0x7fbd080c3350 2023-10-16T19:41:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd0d93d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd0d93d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53834/0 (socket says 172.21.15.29:53834) 2023-10-16T19:41:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd0d93d700 1 -- 172.21.15.29:0/1442300279 learned_addr learned my addr 172.21.15.29:0/1442300279 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:22.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd0e13e700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 0x7fbd081529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.973+0000 7fbd0e93f700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd081555b0 0x7fbd081e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 -- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 msgr2=0x7fbd081529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 0x7fbd081529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 -- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd081555b0 msgr2=0x7fbd081e7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd081555b0 0x7fbd081e7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 -- 172.21.15.29:0/1442300279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00009a70 con 0x7fbd0814ec50 2023-10-16T19:41:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0e13e700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 0x7fbd081529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd0d93d700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80011e0 tx=0x7fbcf800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004c80 con 0x7fbd0814ec50 2023-10-16T19:41:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8004e00 con 0x7fbd0814ec50 2023-10-16T19:41:22.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd080c4ae0 con 0x7fbd0814ec50 2023-10-16T19:41:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007310 con 0x7fbd0814ec50 2023-10-16T19:41:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.974+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd081eba80 con 0x7fbd0814ec50 2023-10-16T19:41:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.975+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0804f400 con 0x7fbd0814ec50 2023-10-16T19:41:22.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.976+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbcf8007470 con 0x7fbd0814ec50 2023-10-16T19:41:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.976+0000 7fbcfeffd700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 0x7fbcec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.976+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbcf80895b0 con 0x7fbd0814ec50 2023-10-16T19:41:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.976+0000 7fbd0e13e700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 0x7fbcec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:22.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.977+0000 7fbd0e13e700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 0x7fbcec06d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd040011e0 tx=0x7fbd04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:22.981+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbcf8054500 con 0x7fbd0814ec50 2023-10-16T19:41:23.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.178+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd081519d0 con 0x7fbcec06af00 2023-10-16T19:41:23.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.179+0000 7fbcfeffd700 1 -- 172.21.15.29:0/1442300279 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd04001cf0 con 0x7fbcec06af00 2023-10-16T19:41:23.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 msgr2=0x7fbcec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 0x7fbcec06d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd040011e0 tx=0x7fbd04009040 comp rx=0 tx=0).stop 2023-10-16T19:41:23.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 msgr2=0x7fbd08150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80011e0 tx=0x7fbcf800cae0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 shutdown_connections 2023-10-16T19:41:23.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbcec06af00 0x7fbcec06d3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd081555b0 0x7fbd081e7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbd080c3350 0x7fbd081529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 --2- 172.21.15.29:0/1442300279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0814ec50 0x7fbd08150710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 >> 172.21.15.29:0/1442300279 conn(0x7fbd080c7110 msgr2=0x7fbd0814c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 shutdown_connections 2023-10-16T19:41:23.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.181+0000 7fbd103a2700 1 -- 172.21.15.29:0/1442300279 wait complete. 2023-10-16T19:41:23.187 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T19:41:23.195 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T19:41:23.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:23.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.322+0000 7f3ef4257700 1 Processor -- start 2023-10-16T19:41:23.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.323+0000 7f3ef4257700 1 -- start start 2023-10-16T19:41:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef4257700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3eec156020 0x7f3eec1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef4257700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eec151b60 0x7f3eec152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef4257700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0c7c80 con 0x7f3eec0caa20 2023-10-16T19:41:23.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef4257700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec155af0 con 0x7f3eec156020 2023-10-16T19:41:23.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef4257700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec152550 con 0x7f3eec151b60 2023-10-16T19:41:23.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3eec156020 0x7f3eec1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef1ff3700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3eec0caa20 0x7f3eec0c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39284/0 (socket says 172.21.15.29:39284) 2023-10-16T19:41:23.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3eec156020 0x7f3eec1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53842/0 (socket says 172.21.15.29:53842) 2023-10-16T19:41:23.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef1ff3700 1 -- 172.21.15.29:0/4182907135 learned_addr learned my addr 172.21.15.29:0/4182907135 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:23.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 -- 172.21.15.29:0/4182907135 >> v2:172.21.15.53:3300/0 conn(0x7f3eec151b60 msgr2=0x7f3eec152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef27f4700 1 --2- 172.21.15.29:0/4182907135 >> v2:172.21.15.53:3300/0 conn(0x7f3eec151b60 0x7f3eec152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 --2- 172.21.15.29:0/4182907135 >> v2:172.21.15.53:3300/0 conn(0x7f3eec151b60 0x7f3eec152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 -- 172.21.15.29:0/4182907135 >> v1:172.21.15.29:6789/0 conn(0x7f3eec0caa20 legacy=0x7f3eec0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 -- 172.21.15.29:0/4182907135 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c4d80 con 0x7f3eec156020 2023-10-16T19:41:23.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef0ff1700 1 -- 172.21.15.29:0/4182907135 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647191403 0 0) 0x7f3eec0c7c80 con 0x7f3eec0caa20 2023-10-16T19:41:23.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.324+0000 7f3ef17f2700 1 --2- 172.21.15.29:0/4182907135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec156020 0x7f3eec1555b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0c5d00 tx=0x7f3ee0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4781ec0e275ab5fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef0ff1700 1 -- 172.21.15.29:0/4182907135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011830 con 0x7f3eec156020 2023-10-16T19:41:23.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef0ff1700 1 -- 172.21.15.29:0/4182907135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011990 con 0x7f3eec156020 2023-10-16T19:41:23.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef0ff1700 1 -- 172.21.15.29:0/4182907135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011d20 con 0x7f3eec156020 2023-10-16T19:41:23.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 -- 172.21.15.29:0/4182907135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec156020 msgr2=0x7f3eec1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 --2- 172.21.15.29:0/4182907135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec156020 0x7f3eec1555b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0c5d00 tx=0x7f3ee0009b20 comp rx=0 tx=0).stop 2023-10-16T19:41:23.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 -- 172.21.15.29:0/4182907135 shutdown_connections 2023-10-16T19:41:23.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 --2- 172.21.15.29:0/4182907135 >> v2:172.21.15.53:3300/0 conn(0x7f3eec151b60 0x7f3eec152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 --2- 172.21.15.29:0/4182907135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec156020 0x7f3eec1555b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 -- 172.21.15.29:0/4182907135 >> 172.21.15.29:0/4182907135 conn(0x7f3eec072190 msgr2=0x7f3eec0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 -- 172.21.15.29:0/4182907135 shutdown_connections 2023-10-16T19:41:23.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.325+0000 7f3ef4257700 1 -- 172.21.15.29:0/4182907135 wait complete. 2023-10-16T19:41:23.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.326+0000 7f3ef4257700 1 Processor -- start 2023-10-16T19:41:23.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.326+0000 7f3ef4257700 1 -- start start 2023-10-16T19:41:23.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 0x7f3eec1ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3eec151b60 0x7f3eec0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec156020 0x7f3eec14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec150640 con 0x7f3eec0caa20 2023-10-16T19:41:23.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0af090 con 0x7f3eec156020 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef4257700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1543e0 con 0x7f3eec151b60 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 0x7f3eec1ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 0x7f3eec1ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53846/0 (socket says 172.21.15.29:53846) 2023-10-16T19:41:23.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 -- 172.21.15.29:0/877753387 learned_addr learned my addr 172.21.15.29:0/877753387 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 -- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3eec151b60 msgr2=0x7f3eec0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef17f2700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3eec151b60 0x7f3eec0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3eec151b60 0x7f3eec0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 -- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec156020 msgr2=0x7f3eec14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef27f4700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec156020 0x7f3eec14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.327+0000 7f3ef1ff3700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec156020 0x7f3eec14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ef1ff3700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00094a0 con 0x7f3eec0caa20 2023-10-16T19:41:23.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ef1ff3700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 0x7f3eec1ecda0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80011e0 tx=0x7f3ee800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8004c80 con 0x7f3eec0caa20 2023-10-16T19:41:23.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8004e00 con 0x7f3eec0caa20 2023-10-16T19:41:23.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec1546c0 con 0x7f3eec0caa20 2023-10-16T19:41:23.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007310 con 0x7f3eec0caa20 2023-10-16T19:41:23.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.328+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec1ed790 con 0x7f3eec0caa20 2023-10-16T19:41:23.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.329+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3eec0c5040 con 0x7f3eec0caa20 2023-10-16T19:41:23.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.329+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ee8007470 con 0x7f3eec0caa20 2023-10-16T19:41:23.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ede7fc700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ed006af00 0x7f3ed006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3ee8089580 con 0x7f3eec0caa20 2023-10-16T19:41:23.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ede7fc700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f3ed0073690 0x7f3ed0075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ed00761e0 con 0x7f3ed0073690 2023-10-16T19:41:23.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee808bb60 con 0x7f3eec0caa20 2023-10-16T19:41:23.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ef17f2700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ed006af00 0x7f3ed006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ef27f4700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f3ed0073690 0x7f3ed0075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.330+0000 7f3ef27f4700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f3ed0073690 0x7f3ed0075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.331+0000 7f3ef17f2700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ed006af00 0x7f3ed006d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3eec1523f0 tx=0x7f3ee0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.331+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== osd.1 v2:172.21.15.29:6816/902088959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3ed00761e0 con 0x7f3ed0073690 2023-10-16T19:41:23.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.346+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 --> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3eec154550 con 0x7f3ed0073690 2023-10-16T19:41:23.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.346+0000 7f3ede7fc700 1 -- 172.21.15.29:0/877753387 <== osd.1 v2:172.21.15.29:6816/902088959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3eec154550 con 0x7f3ed0073690 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:23.349 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:23.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.346+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f3ed0073690 msgr2=0x7f3ed0075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.346+0000 7f3ef4257700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:6816/902088959,v1:172.21.15.29:6817/902088959] conn(0x7f3ed0073690 0x7f3ed0075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.346+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ed006af00 msgr2=0x7f3ed006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ed006af00 0x7f3ed006d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3eec1523f0 tx=0x7f3ee0008030 comp rx=0 tx=0).stop 2023-10-16T19:41:23.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 msgr2=0x7f3eec1ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 --2- 172.21.15.29:0/877753387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eec0caa20 0x7f3eec1ecda0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80011e0 tx=0x7f3ee800cae0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef27f4700 1 -- 172.21.15.29:0/877753387 reap_dead start 2023-10-16T19:41:23.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 shutdown_connections 2023-10-16T19:41:23.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 >> 172.21.15.29:0/877753387 conn(0x7f3eec072190 msgr2=0x7f3eec156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 shutdown_connections 2023-10-16T19:41:23.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.347+0000 7f3ef4257700 1 -- 172.21.15.29:0/877753387 wait complete. 2023-10-16T19:41:23.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T19:41:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.484+0000 7f4f5e60c700 1 Processor -- start 2023-10-16T19:41:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.484+0000 7f4f5e60c700 1 -- start start 2023-10-16T19:41:23.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5e60c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4f58154a50 0x7f4f581583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5e60c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f58158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5e60c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f58158e40 con 0x7f4f5813d660 2023-10-16T19:41:23.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5e60c700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5806d320 con 0x7f4f58154a50 2023-10-16T19:41:23.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5e60c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806e780 con 0x7f4f5813dd00 2023-10-16T19:41:23.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f57fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f5813d660 0x7f4f5806a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39300/0 (socket says 172.21.15.29:39300) 2023-10-16T19:41:23.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f57fff700 1 -- 172.21.15.29:0/1882627862 learned_addr learned my addr 172.21.15.29:0/1882627862 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:23.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f58158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563804960 0 0) 0x7f4f58158e40 con 0x7f4f5813d660 2023-10-16T19:41:23.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f577fe700 1 --2- 172.21.15.29:0/1882627862 >> v2:172.21.15.53:3300/0 conn(0x7f4f58154a50 0x7f4f581583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f440035b0 con 0x7f4f5813d660 2023-10-16T19:41:23.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820991910 0 0) 0x7f4f440035b0 con 0x7f4f5813d660 2023-10-16T19:41:23.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 msgr2=0x7f4f58158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f58158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 >> v2:172.21.15.53:3300/0 conn(0x7f4f58154a50 msgr2=0x7f4f581583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 --2- 172.21.15.29:0/1882627862 >> v2:172.21.15.53:3300/0 conn(0x7f4f58154a50 0x7f4f581583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58154f10 con 0x7f4f5813d660 2023-10-16T19:41:23.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f4f48001670 con 0x7f4f5813d660 2023-10-16T19:41:23.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 >> v1:172.21.15.29:6789/0 conn(0x7f4f5813d660 legacy=0x7f4f5806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f44003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f44003f80 0x7f4f44004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.485+0000 7f4f56ffd700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f44004d90 0x7f4f44005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806d320 con 0x7f4f44004d90 2023-10-16T19:41:23.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806e780 con 0x7f4f44003f80 2023-10-16T19:41:23.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4400ba10 con 0x7f4f5813dd00 2023-10-16T19:41:23.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f44004d90 0x7f4f44005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f57fff700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f44003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f577fe700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f44003f80 0x7f4f44004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 -- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 msgr2=0x7f4f44003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f5813dd00 0x7f4f44003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 -- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f44003f80 msgr2=0x7f4f44004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f44003f80 0x7f4f44004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 -- 172.21.15.29:0/1882627862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440035b0 con 0x7f4f44004d90 2023-10-16T19:41:23.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f44004d90 0x7f4f44005210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fc0 tx=0x7f4f44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294fd48c4ad7c224 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000ebd0 con 0x7f4f44004d90 2023-10-16T19:41:23.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000f040 con 0x7f4f44004d90 2023-10-16T19:41:23.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.486+0000 7f4f56ffd700 1 -- 172.21.15.29:0/1882627862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50014480 con 0x7f4f44004d90 2023-10-16T19:41:23.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 -- 172.21.15.29:0/1882627862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f44004d90 msgr2=0x7f4f44005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/1882627862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f44004d90 0x7f4f44005210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fc0 tx=0x7f4f44005880 comp rx=0 tx=0).stop 2023-10-16T19:41:23.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5cba9700 1 -- 172.21.15.29:0/1882627862 reap_dead start 2023-10-16T19:41:23.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 -- 172.21.15.29:0/1882627862 shutdown_connections 2023-10-16T19:41:23.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 -- 172.21.15.29:0/1882627862 >> 172.21.15.29:0/1882627862 conn(0x7f4f580c7110 msgr2=0x7f4f580c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 -- 172.21.15.29:0/1882627862 shutdown_connections 2023-10-16T19:41:23.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.487+0000 7f4f5e60c700 1 -- 172.21.15.29:0/1882627862 wait complete. 2023-10-16T19:41:23.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.488+0000 7f4f5e60c700 1 Processor -- start 2023-10-16T19:41:23.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.488+0000 7f4f5e60c700 1 -- start start 2023-10-16T19:41:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f580c6360 0x7f4f581ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f58156080 0x7f4f58156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5813a600 con 0x7f4f581edd00 2023-10-16T19:41:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58139230 con 0x7f4f580c6360 2023-10-16T19:41:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5e60c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5813a1e0 con 0x7f4f58156080 2023-10-16T19:41:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53870/0 (socket says 172.21.15.29:53870) 2023-10-16T19:41:23.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 -- 172.21.15.29:0/3664089474 learned_addr learned my addr 172.21.15.29:0/3664089474 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:23.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f5cba9700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f58156080 0x7f4f58156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 -- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f58156080 msgr2=0x7f4f58156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f58156080 0x7f4f58156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 -- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f580c6360 msgr2=0x7f4f581ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f580c6360 0x7f4f581ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 -- 172.21.15.29:0/3664089474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58157060 con 0x7f4f581edd00 2023-10-16T19:41:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.489+0000 7f4f577fe700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4f40011aa0 tx=0x7f4f40011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.490+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000f980 con 0x7f4f581edd00 2023-10-16T19:41:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.490+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000fb00 con 0x7f4f581edd00 2023-10-16T19:41:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.490+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f58157be0 con 0x7f4f581edd00 2023-10-16T19:41:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.490+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000feb0 con 0x7f4f581edd00 2023-10-16T19:41:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.490+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f58156d80 con 0x7f4f581edd00 2023-10-16T19:41:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.491+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f580c3760 con 0x7f4f581edd00 2023-10-16T19:41:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.491+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f40014440 con 0x7f4f581edd00 2023-10-16T19:41:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.491+0000 7f4f54ff9700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 0x7f4f3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.491+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4f40089eb0 con 0x7f4f581edd00 2023-10-16T19:41:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.492+0000 7f4f57fff700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 0x7f4f3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.492+0000 7f4f57fff700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 0x7f4f3806d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f58154140 tx=0x7f4f48004890 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.496+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f40055000 con 0x7f4f581edd00 2023-10-16T19:41:23.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.697+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f58156c00 con 0x7f4f3806af00 2023-10-16T19:41:23.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.697+0000 7f4f54ff9700 1 -- 172.21.15.29:0/3664089474 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f48007050 con 0x7f4f3806af00 2023-10-16T19:41:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.699+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 msgr2=0x7f4f3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.699+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 0x7f4f3806d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f58154140 tx=0x7f4f48004890 comp rx=0 tx=0).stop 2023-10-16T19:41:23.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.699+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 msgr2=0x7f4f58155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.699+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4f40011aa0 tx=0x7f4f40011e60 comp rx=0 tx=0).stop 2023-10-16T19:41:23.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 shutdown_connections 2023-10-16T19:41:23.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f4f3806af00 0x7f4f3806d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4f58156080 0x7f4f58156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f580c6360 0x7f4f581ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 --2- 172.21.15.29:0/3664089474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f581edd00 0x7f4f58155b40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 >> 172.21.15.29:0/3664089474 conn(0x7f4f580c7110 msgr2=0x7f4f581360c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 shutdown_connections 2023-10-16T19:41:23.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.700+0000 7f4f5e60c700 1 -- 172.21.15.29:0/3664089474 wait complete. 2023-10-16T19:41:23.705 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T19:41:23.714 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T19:41:23.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 Processor -- start 2023-10-16T19:41:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 -- start start 2023-10-16T19:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9000c3bb0 0x7fa90006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9000c2f10 0x7fa90006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000a68a0 con 0x7fa90006de30 2023-10-16T19:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90006f340 con 0x7fa9000c3bb0 2023-10-16T19:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa905b61700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9000c2860 con 0x7fa9000c2f10 2023-10-16T19:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa8ff7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9000c3bb0 0x7fa90006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa8ff7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa9000c3bb0 0x7fa90006ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53876/0 (socket says 172.21.15.29:53876) 2023-10-16T19:41:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa8ff7fe700 1 -- 172.21.15.29:0/2272925090 learned_addr learned my addr 172.21.15.29:0/2272925090 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.844+0000 7fa8fffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa90006de30 0x7fa9000c4e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39324/0 (socket says 172.21.15.29:39324) 2023-10-16T19:41:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8feffd700 1 --2- 172.21.15.29:0/2272925090 >> v2:172.21.15.53:3300/0 conn(0x7fa9000c2f10 0x7fa90006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8ff7fe700 1 -- 172.21.15.29:0/2272925090 >> v2:172.21.15.53:3300/0 conn(0x7fa9000c2f10 msgr2=0x7fa90006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8ff7fe700 1 --2- 172.21.15.29:0/2272925090 >> v2:172.21.15.53:3300/0 conn(0x7fa9000c2f10 0x7fa90006d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8ff7fe700 1 -- 172.21.15.29:0/2272925090 >> v1:172.21.15.29:6789/0 conn(0x7fa90006de30 legacy=0x7fa9000c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8fe7fc700 1 -- 172.21.15.29:0/2272925090 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475559009 0 0) 0x7fa9000a68a0 con 0x7fa90006de30 2023-10-16T19:41:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8ff7fe700 1 -- 172.21.15.29:0/2272925090 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000c2b40 con 0x7fa9000c3bb0 2023-10-16T19:41:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8ff7fe700 1 --2- 172.21.15.29:0/2272925090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c3bb0 0x7fa90006ee00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa9000c63b0 tx=0x7fa8f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7771edf653b5af85 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8fe7fc700 1 -- 172.21.15.29:0/2272925090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000b870 con 0x7fa9000c3bb0 2023-10-16T19:41:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8fe7fc700 1 -- 172.21.15.29:0/2272925090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000b9d0 con 0x7fa9000c3bb0 2023-10-16T19:41:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.845+0000 7fa8fe7fc700 1 -- 172.21.15.29:0/2272925090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000bd60 con 0x7fa9000c3bb0 2023-10-16T19:41:23.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 -- 172.21.15.29:0/2272925090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c3bb0 msgr2=0x7fa90006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 --2- 172.21.15.29:0/2272925090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c3bb0 0x7fa90006ee00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa9000c63b0 tx=0x7fa8f0009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 -- 172.21.15.29:0/2272925090 shutdown_connections 2023-10-16T19:41:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 --2- 172.21.15.29:0/2272925090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c3bb0 0x7fa90006ee00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 --2- 172.21.15.29:0/2272925090 >> v2:172.21.15.53:3300/0 conn(0x7fa9000c2f10 0x7fa90006d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 -- 172.21.15.29:0/2272925090 >> 172.21.15.29:0/2272925090 conn(0x7fa9000c7150 msgr2=0x7fa9000c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 -- 172.21.15.29:0/2272925090 shutdown_connections 2023-10-16T19:41:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.846+0000 7fa905b61700 1 -- 172.21.15.29:0/2272925090 wait complete. 2023-10-16T19:41:23.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.847+0000 7fa905b61700 1 Processor -- start 2023-10-16T19:41:23.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.847+0000 7fa905b61700 1 -- start start 2023-10-16T19:41:23.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90006de30 0x7fa9000baa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 0x7fa9000ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9000c3bb0 0x7fa90014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001e8140 con 0x7fa9000c2f10 2023-10-16T19:41:23.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001e7550 con 0x7fa9000c3bb0 2023-10-16T19:41:23.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa905b61700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001e7810 con 0x7fa90006de30 2023-10-16T19:41:23.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 0x7fa9000ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 0x7fa9000ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53884/0 (socket says 172.21.15.29:53884) 2023-10-16T19:41:23.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 -- 172.21.15.29:0/3576392726 learned_addr learned my addr 172.21.15.29:0/3576392726 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:23.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8ff7fe700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90006de30 0x7fa9000baa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8fffff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9000c3bb0 0x7fa90014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 -- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90006de30 msgr2=0x7fa9000baa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa90006de30 0x7fa9000baa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 -- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9000c3bb0 msgr2=0x7fa90014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9000c3bb0 0x7fa90014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0009550 con 0x7fa9000c2f10 2023-10-16T19:41:23.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8fffff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9000c3bb0 0x7fa90014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:23.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.848+0000 7fa8feffd700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 0x7fa9000ac500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e810 tx=0x7fa8f400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4013610 con 0x7fa9000c2f10 2023-10-16T19:41:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4013790 con 0x7fa9000c2f10 2023-10-16T19:41:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9001e7af0 con 0x7fa9000c2f10 2023-10-16T19:41:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4013b40 con 0x7fa9000c2f10 2023-10-16T19:41:23.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000bafb0 con 0x7fa9000c2f10 2023-10-16T19:41:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.849+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9000a6530 con 0x7fa9000c2f10 2023-10-16T19:41:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.850+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8f4013ca0 con 0x7fa9000c2f10 2023-10-16T19:41:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.850+0000 7fa8e7fff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8ec06af00 0x7fa8ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa8f4089860 con 0x7fa9000c2f10 2023-10-16T19:41:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8e7fff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7fa8ec073690 0x7fa8ec075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8ec0761e0 con 0x7fa8ec073690 2023-10-16T19:41:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8f4089cb0 con 0x7fa9000c2f10 2023-10-16T19:41:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8ff7fe700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8ec06af00 0x7fa8ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8fffff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7fa8ec073690 0x7fa8ec075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:23.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8fffff700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7fa8ec073690 0x7fa8ec075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.851+0000 7fa8ff7fe700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8ec06af00 0x7fa8ec06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0000c00 tx=0x7fa8f0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.852+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== osd.2 v2:172.21.15.29:6808/365921754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa8ec0761e0 con 0x7fa8ec073690 2023-10-16T19:41:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 --> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa9000a6250 con 0x7fa8ec073690 2023-10-16T19:41:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa8e7fff700 1 -- 172.21.15.29:0/3576392726 <== osd.2 v2:172.21.15.29:6808/365921754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa8f8007130 con 0x7fa8ec073690 2023-10-16T19:41:23.871 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:23.872 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:23.872 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:23.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7fa8ec073690 msgr2=0x7fa8ec075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:6808/365921754,v1:172.21.15.29:6809/365921754] conn(0x7fa8ec073690 0x7fa8ec075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:23.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8ec06af00 msgr2=0x7fa8ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fa8ec06af00 0x7fa8ec06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0000c00 tx=0x7fa8f0008030 comp rx=0 tx=0).stop 2023-10-16T19:41:23.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 msgr2=0x7fa9000ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:23.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 --2- 172.21.15.29:0/3576392726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9000c2f10 0x7fa9000ac500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e810 tx=0x7fa8f400eb20 comp rx=0 tx=0).stop 2023-10-16T19:41:23.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa8fffff700 1 -- 172.21.15.29:0/3576392726 reap_dead start 2023-10-16T19:41:23.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 shutdown_connections 2023-10-16T19:41:23.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 >> 172.21.15.29:0/3576392726 conn(0x7fa9000c7150 msgr2=0x7fa9001546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:23.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 shutdown_connections 2023-10-16T19:41:23.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:23.867+0000 7fa905b61700 1 -- 172.21.15.29:0/3576392726 wait complete. 2023-10-16T19:41:23.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T19:41:24.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.004+0000 7fb763f80700 1 Processor -- start 2023-10-16T19:41:24.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.005+0000 7fb763f80700 1 -- start start 2023-10-16T19:41:24.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.005+0000 7fb763f80700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb75c14ec50 0x7fb75c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb763f80700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c155af0 con 0x7fb75c06db00 2023-10-16T19:41:24.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb763f80700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c152300 con 0x7fb75c0c3350 2023-10-16T19:41:24.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb763f80700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0c2e40 con 0x7fb75c14ec50 2023-10-16T19:41:24.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb75c14ec50 0x7fb75c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb76251d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb75c06db00 0x7fb75c06df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39340/0 (socket says 172.21.15.29:39340) 2023-10-16T19:41:24.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb76251d700 1 -- 172.21.15.29:0/3137174577 learned_addr learned my addr 172.21.15.29:0/3137174577 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb75c14ec50 0x7fb75c1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53892/0 (socket says 172.21.15.29:53892) 2023-10-16T19:41:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 -- 172.21.15.29:0/3137174577 >> v1:172.21.15.53:6789/0 conn(0x7fb75c0c3350 legacy=0x7fb75c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 -- 172.21.15.29:0/3137174577 >> v1:172.21.15.29:6789/0 conn(0x7fb75c06db00 legacy=0x7fb75c06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 -- 172.21.15.29:0/3137174577 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c14f030 con 0x7fb75c14ec50 2023-10-16T19:41:24.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb760d1a700 1 -- 172.21.15.29:0/3137174577 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595746729 0 0) 0x7fb7540014e0 con 0x7fb75c06db00 2023-10-16T19:41:24.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb761d1c700 1 --2- 172.21.15.29:0/3137174577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c14ec50 0x7fb75c1555b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb758009840 tx=0x7fb758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e126ef4001b2a196 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb760d1a700 1 -- 172.21.15.29:0/3137174577 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758011830 con 0x7fb75c14ec50 2023-10-16T19:41:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb760d1a700 1 -- 172.21.15.29:0/3137174577 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758011990 con 0x7fb75c14ec50 2023-10-16T19:41:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.006+0000 7fb760d1a700 1 -- 172.21.15.29:0/3137174577 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758011d20 con 0x7fb75c14ec50 2023-10-16T19:41:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 -- 172.21.15.29:0/3137174577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c14ec50 msgr2=0x7fb75c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 --2- 172.21.15.29:0/3137174577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c14ec50 0x7fb75c1555b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb758009840 tx=0x7fb758009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 -- 172.21.15.29:0/3137174577 shutdown_connections 2023-10-16T19:41:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 --2- 172.21.15.29:0/3137174577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c14ec50 0x7fb75c1555b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 -- 172.21.15.29:0/3137174577 >> 172.21.15.29:0/3137174577 conn(0x7fb75c0c7110 msgr2=0x7fb75c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 -- 172.21.15.29:0/3137174577 shutdown_connections 2023-10-16T19:41:24.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.007+0000 7fb763f80700 1 -- 172.21.15.29:0/3137174577 wait complete. 2023-10-16T19:41:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.008+0000 7fb763f80700 1 Processor -- start 2023-10-16T19:41:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.008+0000 7fb763f80700 1 -- start start 2023-10-16T19:41:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb75c06db00 0x7fb75c1ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb75c14ec50 0x7fb75c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c152f50 con 0x7fb75c0c3350 2023-10-16T19:41:24.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c151180 con 0x7fb75c14ec50 2023-10-16T19:41:24.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb763f80700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c1e6e70 con 0x7fb75c06db00 2023-10-16T19:41:24.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53900/0 (socket says 172.21.15.29:53900) 2023-10-16T19:41:24.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 -- 172.21.15.29:0/730806242 learned_addr learned my addr 172.21.15.29:0/730806242 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:24.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb761d1c700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb75c06db00 0x7fb75c1ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76251d700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb75c14ec50 0x7fb75c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 -- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb75c06db00 msgr2=0x7fb75c1ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb75c06db00 0x7fb75c1ddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 -- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb75c14ec50 msgr2=0x7fb75c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb75c14ec50 0x7fb75c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.009+0000 7fb76151b700 1 -- 172.21.15.29:0/730806242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580094a0 con 0x7fb75c0c3350 2023-10-16T19:41:24.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb76151b700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c500 tx=0x7fb75000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500052d0 con 0x7fb75c0c3350 2023-10-16T19:41:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750005430 con 0x7fb75c0c3350 2023-10-16T19:41:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c1e7150 con 0x7fb75c0c3350 2023-10-16T19:41:24.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500038c0 con 0x7fb75c0c3350 2023-10-16T19:41:24.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.010+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c1de520 con 0x7fb75c0c3350 2023-10-16T19:41:24.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.011+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c1e7670 con 0x7fb75c0c3350 2023-10-16T19:41:24.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.011+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb750003a20 con 0x7fb75c0c3350 2023-10-16T19:41:24.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.012+0000 7fb74e7fc700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.012+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb7500889a0 con 0x7fb75c0c3350 2023-10-16T19:41:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.012+0000 7fb761d1c700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.012+0000 7fb761d1c700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 0x7fb74006d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7580090b0 tx=0x7fb75801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.016+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb75c1e7670 con 0x7fb75c0c3350 2023-10-16T19:41:24.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.216+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75c1519d0 con 0x7fb74006af00 2023-10-16T19:41:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.216+0000 7fb74e7fc700 1 -- 172.21.15.29:0/730806242 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb758011c00 con 0x7fb74006af00 2023-10-16T19:41:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 msgr2=0x7fb74006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 0x7fb74006d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7580090b0 tx=0x7fb75801c040 comp rx=0 tx=0).stop 2023-10-16T19:41:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 msgr2=0x7fb75c150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c500 tx=0x7fb75000c810 comp rx=0 tx=0).stop 2023-10-16T19:41:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 shutdown_connections 2023-10-16T19:41:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb75c14ec50 0x7fb75c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb75c06db00 0x7fb75c1ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 --2- 172.21.15.29:0/730806242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c0c3350 0x7fb75c150810 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 >> 172.21.15.29:0/730806242 conn(0x7fb75c0c7110 msgr2=0x7fb75c14ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 shutdown_connections 2023-10-16T19:41:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.219+0000 7fb763f80700 1 -- 172.21.15.29:0/730806242 wait complete. 2023-10-16T19:41:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T19:41:24.233 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T19:41:24.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:24.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 Processor -- start 2023-10-16T19:41:24.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 -- start start 2023-10-16T19:41:24.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 0x7ff15806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1580c2f10 0x7ff15806d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1580a68a0 con 0x7ff15806de30 2023-10-16T19:41:24.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15806f340 con 0x7ff1580c2f10 2023-10-16T19:41:24.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.361+0000 7ff15d7f4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c2860 con 0x7ff1580c3bb0 2023-10-16T19:41:24.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1580c2f10 0x7ff15806d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1580c2f10 0x7ff15806d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53910/0 (socket says 172.21.15.29:53910) 2023-10-16T19:41:24.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 -- 172.21.15.29:0/2869159827 learned_addr learned my addr 172.21.15.29:0/2869159827 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:24.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff156ffd700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 0x7ff15806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 -- 172.21.15.29:0/2869159827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 msgr2=0x7ff15806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:24.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 0x7ff15806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 -- 172.21.15.29:0/2869159827 >> v1:172.21.15.53:6789/0 conn(0x7ff15806de30 legacy=0x7ff1580c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 -- 172.21.15.29:0/2869159827 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580c2b40 con 0x7ff1580c2f10 2023-10-16T19:41:24.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff156ffd700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 0x7ff15806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:24.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff1567fc700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff15806d8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098f0 tx=0x7ff14c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb89765b8d6bca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff155ffb700 1 -- 172.21.15.29:0/2869159827 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00b8a0 con 0x7ff1580c2f10 2023-10-16T19:41:24.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff155ffb700 1 -- 172.21.15.29:0/2869159827 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00ba00 con 0x7ff1580c2f10 2023-10-16T19:41:24.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.362+0000 7ff155ffb700 1 -- 172.21.15.29:0/2869159827 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00bd90 con 0x7ff1580c2f10 2023-10-16T19:41:24.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2869159827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 msgr2=0x7ff15806d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff15806d8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098f0 tx=0x7ff14c009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:24.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2869159827 shutdown_connections 2023-10-16T19:41:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff1580c3bb0 0x7ff15806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2869159827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff15806d8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2869159827 >> 172.21.15.29:0/2869159827 conn(0x7ff1580c7150 msgr2=0x7ff1580c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2869159827 shutdown_connections 2023-10-16T19:41:24.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.363+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2869159827 wait complete. 2023-10-16T19:41:24.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.365+0000 7ff15d7f4700 1 Processor -- start 2023-10-16T19:41:24.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.365+0000 7ff15d7f4700 1 -- start start 2023-10-16T19:41:24.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15806de30 0x7ff158151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff1580a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1580c3bb0 0x7ff1580a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1581ebba0 con 0x7ff1580c2f10 2023-10-16T19:41:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1581eaf90 con 0x7ff1580c3bb0 2023-10-16T19:41:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1581eb270 con 0x7ff15806de30 2023-10-16T19:41:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff1580a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff1580a8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53914/0 (socket says 172.21.15.29:53914) 2023-10-16T19:41:24.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 -- 172.21.15.29:0/2047255382 learned_addr learned my addr 172.21.15.29:0/2047255382 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:24.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff156ffd700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15806de30 0x7ff158151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1577fe700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1580c3bb0 0x7ff1580a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 -- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15806de30 msgr2=0x7ff158151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15806de30 0x7ff158151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 -- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1580c3bb0 msgr2=0x7ff1580a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1580c3bb0 0x7ff1580a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009550 con 0x7ff1580c2f10 2023-10-16T19:41:24.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff1567fc700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff1580a8130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009c40 tx=0x7ff14c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004510 con 0x7ff1580c2f10 2023-10-16T19:41:24.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c01e070 con 0x7ff1580c2f10 2023-10-16T19:41:24.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0038e0 con 0x7ff1580c2f10 2023-10-16T19:41:24.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1581eb550 con 0x7ff1580c2f10 2023-10-16T19:41:24.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.366+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1580a8bb0 con 0x7ff1580c2f10 2023-10-16T19:41:24.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.367+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1580a6530 con 0x7ff1580c2f10 2023-10-16T19:41:24.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff14c003a40 con 0x7ff1580c2f10 2023-10-16T19:41:24.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff14406af00 0x7ff14406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff14c020070 con 0x7ff1580c2f10 2023-10-16T19:41:24.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7ff144073690 0x7ff144075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1440761e0 con 0x7ff144073690 2023-10-16T19:41:24.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.368+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff14c08f2a0 con 0x7ff1580c2f10 2023-10-16T19:41:24.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.369+0000 7ff156ffd700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff14406af00 0x7ff14406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.369+0000 7ff1577fe700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7ff144073690 0x7ff144075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.369+0000 7ff1577fe700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7ff144073690 0x7ff144075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.369+0000 7ff156ffd700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff14406af00 0x7ff14406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff1480099d0 tx=0x7ff148008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.369+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== osd.3 v2:172.21.15.29:6819/1600164100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff1440761e0 con 0x7ff144073690 2023-10-16T19:41:24.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.384+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 --> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1580a6250 con 0x7ff144073690 2023-10-16T19:41:24.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.384+0000 7ff13f7fe700 1 -- 172.21.15.29:0/2047255382 <== osd.3 v2:172.21.15.29:6819/1600164100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff150001f20 con 0x7ff144073690 2023-10-16T19:41:24.387 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:24.387 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:24.388 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:24.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7ff144073690 msgr2=0x7ff144075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:6819/1600164100,v1:172.21.15.29:6821/1600164100] conn(0x7ff144073690 0x7ff144075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff14406af00 msgr2=0x7ff14406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7ff14406af00 0x7ff14406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff1480099d0 tx=0x7ff148008040 comp rx=0 tx=0).stop 2023-10-16T19:41:24.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 msgr2=0x7ff1580a8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 --2- 172.21.15.29:0/2047255382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1580c2f10 0x7ff1580a8130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009c40 tx=0x7ff14c004750 comp rx=0 tx=0).stop 2023-10-16T19:41:24.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff1577fe700 1 -- 172.21.15.29:0/2047255382 reap_dead start 2023-10-16T19:41:24.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 shutdown_connections 2023-10-16T19:41:24.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 >> 172.21.15.29:0/2047255382 conn(0x7ff1580c7150 msgr2=0x7ff1580c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 shutdown_connections 2023-10-16T19:41:24.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.385+0000 7ff15d7f4700 1 -- 172.21.15.29:0/2047255382 wait complete. 2023-10-16T19:41:24.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T19:41:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.523+0000 7f6f04ab2700 1 Processor -- start 2023-10-16T19:41:24.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.523+0000 7f6f04ab2700 1 -- start start 2023-10-16T19:41:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6f04ab2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f0014ec50 0x7f6f001555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6f04ab2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f0006db00 0x7f6f0006df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6f04ab2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f00155af0 con 0x7f6f000c3350 2023-10-16T19:41:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6f04ab2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f00152300 con 0x7f6f0006db00 2023-10-16T19:41:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6f04ab2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000c2e40 con 0x7f6f0014ec50 2023-10-16T19:41:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f0006db00 0x7f6f0006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efdd9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f000c3350 0x7f6f00071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39366/0 (socket says 172.21.15.29:39366) 2023-10-16T19:41:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f0006db00 0x7f6f0006df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53924/0 (socket says 172.21.15.29:53924) 2023-10-16T19:41:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efdd9b700 1 -- 172.21.15.29:0/1765655749 learned_addr learned my addr 172.21.15.29:0/1765655749 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efe59c700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f0014ec50 0x7f6f001555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 -- 172.21.15.29:0/1765655749 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f0014ec50 msgr2=0x7f6f001555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f0014ec50 0x7f6f001555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 -- 172.21.15.29:0/1765655749 >> v1:172.21.15.29:6789/0 conn(0x7f6f000c3350 legacy=0x7f6f00071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 -- 172.21.15.29:0/1765655749 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0014f030 con 0x7f6f0006db00 2023-10-16T19:41:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efd59a700 1 -- 172.21.15.29:0/1765655749 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745929561 0 0) 0x7f6ef4001110 con 0x7f6f000c3350 2023-10-16T19:41:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.524+0000 7f6efed9d700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f0006df90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009d90 tx=0x7f6ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390f0246ac81bb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6efd59a700 1 -- 172.21.15.29:0/1765655749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800e070 con 0x7f6f0006db00 2023-10-16T19:41:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6efd59a700 1 -- 172.21.15.29:0/1765655749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef800bbd0 con 0x7f6f0006db00 2023-10-16T19:41:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6efd59a700 1 -- 172.21.15.29:0/1765655749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8012430 con 0x7f6f0006db00 2023-10-16T19:41:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 -- 172.21.15.29:0/1765655749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 msgr2=0x7f6f0006df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f0006df90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009d90 tx=0x7f6ef800b330 comp rx=0 tx=0).stop 2023-10-16T19:41:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 -- 172.21.15.29:0/1765655749 shutdown_connections 2023-10-16T19:41:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f0006df90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/1765655749 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f0014ec50 0x7f6f001555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 -- 172.21.15.29:0/1765655749 >> 172.21.15.29:0/1765655749 conn(0x7f6f000c7110 msgr2=0x7f6f000c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 -- 172.21.15.29:0/1765655749 shutdown_connections 2023-10-16T19:41:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.525+0000 7f6f04ab2700 1 -- 172.21.15.29:0/1765655749 wait complete. 2023-10-16T19:41:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.526+0000 7f6f04ab2700 1 Processor -- start 2023-10-16T19:41:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 -- start start 2023-10-16T19:41:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 0x7f6f0014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 0x7f6f0014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001dd230 con 0x7f6f0006db00 2023-10-16T19:41:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00143600 con 0x7f6f0014ec50 2023-10-16T19:41:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6f04ab2700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001dcce0 con 0x7f6f000c3350 2023-10-16T19:41:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6efe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6efe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53926/0 (socket says 172.21.15.29:53926) 2023-10-16T19:41:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6efe59c700 1 -- 172.21.15.29:0/3430491479 learned_addr learned my addr 172.21.15.29:0/3430491479 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.527+0000 7f6efed9d700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 0x7f6f0014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efdd9b700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 0x7f6f0014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 -- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 msgr2=0x7f6f0014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 0x7f6f0014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 -- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 msgr2=0x7f6f0014af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 0x7f6f0014af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 -- 172.21.15.29:0/3430491479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009a70 con 0x7f6f0006db00 2023-10-16T19:41:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efed9d700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 0x7f6f0014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efdd9b700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 0x7f6f0014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:24.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6efe59c700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000e810 tx=0x7f6ef000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0013610 con 0x7f6f0006db00 2023-10-16T19:41:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0013770 con 0x7f6f0006db00 2023-10-16T19:41:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0014b4a0 con 0x7f6f0006db00 2023-10-16T19:41:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0013b20 con 0x7f6f0006db00 2023-10-16T19:41:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.528+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001dd670 con 0x7f6f0006db00 2023-10-16T19:41:24.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.529+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f001dd4d0 con 0x7f6f0006db00 2023-10-16T19:41:24.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.529+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ef0013c80 con 0x7f6f0006db00 2023-10-16T19:41:24.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.530+0000 7f6eeeffd700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 0x7f6ee006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.530+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6ef0089380 con 0x7f6f0006db00 2023-10-16T19:41:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.530+0000 7f6efdd9b700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 0x7f6ee006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.531+0000 7f6efdd9b700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 0x7f6ee006d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007fd0 tx=0x7f6ef4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.534+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f001dd4d0 con 0x7f6f0006db00 2023-10-16T19:41:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.734+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f001519d0 con 0x7f6ee006af30 2023-10-16T19:41:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.735+0000 7f6eeeffd700 1 -- 172.21.15.29:0/3430491479 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ef4001420 con 0x7f6ee006af30 2023-10-16T19:41:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 msgr2=0x7f6ee006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 0x7f6ee006d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007fd0 tx=0x7f6ef4009040 comp rx=0 tx=0).stop 2023-10-16T19:41:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 msgr2=0x7f6f001539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000e810 tx=0x7f6ef000ebd0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 shutdown_connections 2023-10-16T19:41:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f6ee006af30 0x7f6ee006d3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f0014ec50 0x7f6f0014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0006db00 0x7f6f001539e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 --2- 172.21.15.29:0/3430491479 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6f000c3350 0x7f6f0014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 >> 172.21.15.29:0/3430491479 conn(0x7f6f000c7110 msgr2=0x7f6f000c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 shutdown_connections 2023-10-16T19:41:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.737+0000 7f6f04ab2700 1 -- 172.21.15.29:0/3430491479 wait complete. 2023-10-16T19:41:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T19:41:24.751 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T19:41:24.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:24.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.878+0000 7f685fb34700 1 Processor -- start 2023-10-16T19:41:24.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.879+0000 7f685fb34700 1 -- start start 2023-10-16T19:41:24.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.879+0000 7f685fb34700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 0x7f685806e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.879+0000 7f685fb34700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685806d7f0 con 0x7f68580c2300 2023-10-16T19:41:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.879+0000 7f685fb34700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580c37a0 con 0x7f685806d330 2023-10-16T19:41:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.879+0000 7f685fb34700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685806da90 con 0x7f6858151e40 2023-10-16T19:41:24.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685e0d1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f68580c2300 0x7f6858158250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39382/0 (socket says 172.21.15.29:39382) 2023-10-16T19:41:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685e0d1700 1 -- 172.21.15.29:0/277582780 learned_addr learned my addr 172.21.15.29:0/277582780 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685d8d0700 1 --2- 172.21.15.29:0/277582780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 0x7f685806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694060088 0 0) 0x7f685806d7f0 con 0x7f68580c2300 2023-10-16T19:41:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68440035b0 con 0x7f68580c2300 2023-10-16T19:41:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402550727 0 0) 0x7f68580c37a0 con 0x7f685806d330 2023-10-16T19:41:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685806d7f0 con 0x7f685806d330 2023-10-16T19:41:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685d8d0700 1 -- 172.21.15.29:0/277582780 >> v1:172.21.15.53:6789/0 conn(0x7f685806d330 legacy=0x7f68580ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685d8d0700 1 -- 172.21.15.29:0/277582780 >> v1:172.21.15.29:6789/0 conn(0x7f68580c2300 legacy=0x7f6858158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685d8d0700 1 -- 172.21.15.29:0/277582780 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580c31e0 con 0x7f6858151e40 2023-10-16T19:41:24.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.880+0000 7f685d8d0700 1 --2- 172.21.15.29:0/277582780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 0x7f685806e620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6854009870 tx=0x7f6854009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff1a841e4f6d8af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854011830 con 0x7f6858151e40 2023-10-16T19:41:24.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854011990 con 0x7f6858151e40 2023-10-16T19:41:24.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685c8ce700 1 -- 172.21.15.29:0/277582780 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854011d20 con 0x7f6858151e40 2023-10-16T19:41:24.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 -- 172.21.15.29:0/277582780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 msgr2=0x7f685806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 --2- 172.21.15.29:0/277582780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 0x7f685806e620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6854009870 tx=0x7f6854009b80 comp rx=0 tx=0).stop 2023-10-16T19:41:24.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 -- 172.21.15.29:0/277582780 shutdown_connections 2023-10-16T19:41:24.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 --2- 172.21.15.29:0/277582780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6858151e40 0x7f685806e620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 -- 172.21.15.29:0/277582780 >> 172.21.15.29:0/277582780 conn(0x7f68580c6ff0 msgr2=0x7f68580c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 -- 172.21.15.29:0/277582780 shutdown_connections 2023-10-16T19:41:24.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.881+0000 7f685fb34700 1 -- 172.21.15.29:0/277582780 wait complete. 2023-10-16T19:41:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.883+0000 7f685fb34700 1 Processor -- start 2023-10-16T19:41:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.883+0000 7f685fb34700 1 -- start start 2023-10-16T19:41:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f685806d330 0x7f68581542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c2300 0x7f6858143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6858151e40 0x7f6858150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858154830 con 0x7f6858151e40 2023-10-16T19:41:24.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581edf90 con 0x7f68580c2300 2023-10-16T19:41:24.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685fb34700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68581ed0e0 con 0x7f685806d330 2023-10-16T19:41:24.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685e0d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6858151e40 0x7f6858150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685e0d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6858151e40 0x7f6858150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53944/0 (socket says 172.21.15.29:53944) 2023-10-16T19:41:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685e0d1700 1 -- 172.21.15.29:0/776615570 learned_addr learned my addr 172.21.15.29:0/776615570 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f685806d330 0x7f68581542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d0cf700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c2300 0x7f6858143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 -- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c2300 msgr2=0x7f6858143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c2300 0x7f6858143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 -- 172.21.15.29:0/776615570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6858151e40 msgr2=0x7f6858150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6858151e40 0x7f6858150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.884+0000 7f685d8d0700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540094a0 con 0x7f685806d330 2023-10-16T19:41:24.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f685d8d0700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f685806d330 0x7f68581542f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6854016000 tx=0x7f6854004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685401a6e0 con 0x7f685806d330 2023-10-16T19:41:24.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685401a840 con 0x7f685806d330 2023-10-16T19:41:24.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580ad130 con 0x7f685806d330 2023-10-16T19:41:24.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685401abd0 con 0x7f685806d330 2023-10-16T19:41:24.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.885+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68581ed380 con 0x7f685806d330 2023-10-16T19:41:24.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.886+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68580acfb0 con 0x7f685806d330 2023-10-16T19:41:24.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.886+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6854022070 con 0x7f685806d330 2023-10-16T19:41:24.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f684e7fc700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f683c06af00 0x7f683c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f685408aae0 con 0x7f685806d330 2023-10-16T19:41:24.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f684e7fc700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7f683c073690 0x7f683c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:24.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f685d0cf700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f683c06af00 0x7f683c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f683c0761e0 con 0x7f683c073690 2023-10-16T19:41:24.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f685408af00 con 0x7f685806d330 2023-10-16T19:41:24.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.887+0000 7f685e0d1700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7f683c073690 0x7f683c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:24.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.888+0000 7f685d0cf700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f683c06af00 0x7f683c06d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f685814b3a0 tx=0x7f6848009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.888+0000 7f685e0d1700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7f683c073690 0x7f683c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:24.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.889+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== osd.4 v2:172.21.15.53:6816/4281980506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f683c0761e0 con 0x7f683c073690 2023-10-16T19:41:24.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.903+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 --> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68580c34c0 con 0x7f683c073690 2023-10-16T19:41:24.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f684e7fc700 1 -- 172.21.15.29:0/776615570 <== osd.4 v2:172.21.15.53:6816/4281980506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6850001fe0 con 0x7f683c073690 2023-10-16T19:41:24.906 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:24.906 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:24.907 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:24.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7f683c073690 msgr2=0x7f683c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6816/4281980506,v1:172.21.15.53:6817/4281980506] conn(0x7f683c073690 0x7f683c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:24.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f683c06af00 msgr2=0x7f683c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f683c06af00 0x7f683c06d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f685814b3a0 tx=0x7f6848009040 comp rx=0 tx=0).stop 2023-10-16T19:41:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f685806d330 msgr2=0x7f68581542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 --2- 172.21.15.29:0/776615570 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f685806d330 0x7f68581542f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6854016000 tx=0x7f6854004750 comp rx=0 tx=0).stop 2023-10-16T19:41:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685e0d1700 1 -- 172.21.15.29:0/776615570 reap_dead start 2023-10-16T19:41:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 shutdown_connections 2023-10-16T19:41:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 >> 172.21.15.29:0/776615570 conn(0x7f68580c6ff0 msgr2=0x7f68580c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 shutdown_connections 2023-10-16T19:41:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:24.904+0000 7f685fb34700 1 -- 172.21.15.29:0/776615570 wait complete. 2023-10-16T19:41:24.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T19:41:25.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.041+0000 7fc92b81e700 1 Processor -- start 2023-10-16T19:41:25.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 -- start start 2023-10-16T19:41:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc92413d660 0x7fc92406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc924154a50 0x7fc9241583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92406e780 con 0x7fc92406adc0 2023-10-16T19:41:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92406d320 con 0x7fc92413d660 2023-10-16T19:41:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc92b81e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc924154f10 con 0x7fc924154a50 2023-10-16T19:41:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.042+0000 7fc9295ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc92413d660 0x7fc92406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc929dbb700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc92406adc0 0x7fc924158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39398/0 (socket says 172.21.15.29:39398) 2023-10-16T19:41:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc92413d660 0x7fc92406a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53950/0 (socket says 172.21.15.29:53950) 2023-10-16T19:41:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc929dbb700 1 -- 172.21.15.29:0/2473929133 learned_addr learned my addr 172.21.15.29:0/2473929133 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:25.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc928db9700 1 --2- 172.21.15.29:0/2473929133 >> v2:172.21.15.53:3300/0 conn(0x7fc924154a50 0x7fc9241583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 -- 172.21.15.29:0/2473929133 >> v2:172.21.15.53:3300/0 conn(0x7fc924154a50 msgr2=0x7fc9241583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 --2- 172.21.15.29:0/2473929133 >> v2:172.21.15.53:3300/0 conn(0x7fc924154a50 0x7fc9241583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 -- 172.21.15.29:0/2473929133 >> v1:172.21.15.29:6789/0 conn(0x7fc92406adc0 legacy=0x7fc924158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 -- 172.21.15.29:0/2473929133 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9241551f0 con 0x7fc92413d660 2023-10-16T19:41:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc917fff700 1 -- 172.21.15.29:0/2473929133 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192220327 0 0) 0x7fc92406e780 con 0x7fc92406adc0 2023-10-16T19:41:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc9295ba700 1 --2- 172.21.15.29:0/2473929133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc92406a880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c1780 tx=0x7fc920009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ebbb4a9efdee1c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc917fff700 1 -- 172.21.15.29:0/2473929133 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920011830 con 0x7fc92413d660 2023-10-16T19:41:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc917fff700 1 -- 172.21.15.29:0/2473929133 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920011990 con 0x7fc92413d660 2023-10-16T19:41:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.043+0000 7fc917fff700 1 -- 172.21.15.29:0/2473929133 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920011d20 con 0x7fc92413d660 2023-10-16T19:41:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 -- 172.21.15.29:0/2473929133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 msgr2=0x7fc92406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 --2- 172.21.15.29:0/2473929133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc92406a880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c1780 tx=0x7fc920009b20 comp rx=0 tx=0).stop 2023-10-16T19:41:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 -- 172.21.15.29:0/2473929133 shutdown_connections 2023-10-16T19:41:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 --2- 172.21.15.29:0/2473929133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc92406a880 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 --2- 172.21.15.29:0/2473929133 >> v2:172.21.15.53:3300/0 conn(0x7fc924154a50 0x7fc9241583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 -- 172.21.15.29:0/2473929133 >> 172.21.15.29:0/2473929133 conn(0x7fc9240c7110 msgr2=0x7fc9240c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 -- 172.21.15.29:0/2473929133 shutdown_connections 2023-10-16T19:41:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.044+0000 7fc92b81e700 1 -- 172.21.15.29:0/2473929133 wait complete. 2023-10-16T19:41:25.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.045+0000 7fc92b81e700 1 Processor -- start 2023-10-16T19:41:25.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.045+0000 7fc92b81e700 1 -- start start 2023-10-16T19:41:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 0x7fc9240c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc924154a50 0x7fc9241ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92413a080 con 0x7fc92413d660 2023-10-16T19:41:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924157180 con 0x7fc92406adc0 2023-10-16T19:41:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92413c910 con 0x7fc924154a50 2023-10-16T19:41:25.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53958/0 (socket says 172.21.15.29:53958) 2023-10-16T19:41:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 -- 172.21.15.29:0/3448263716 learned_addr learned my addr 172.21.15.29:0/3448263716 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:25.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc9295ba700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 0x7fc9240c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc929dbb700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc924154a50 0x7fc9241ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 -- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc924154a50 msgr2=0x7fc9241ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc924154a50 0x7fc9241ea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 -- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 msgr2=0x7fc9240c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 0x7fc9240c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 -- 172.21.15.29:0/3448263716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200094a0 con 0x7fc92413d660 2023-10-16T19:41:25.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc9295ba700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 0x7fc9240c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:25.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc928db9700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc91800e870 tx=0x7fc91800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918009590 con 0x7fc92413d660 2023-10-16T19:41:25.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800ee70 con 0x7fc92413d660 2023-10-16T19:41:25.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92413a4a0 con 0x7fc92413d660 2023-10-16T19:41:25.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800ca50 con 0x7fc92413d660 2023-10-16T19:41:25.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.047+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc924137b90 con 0x7fc92413d660 2023-10-16T19:41:25.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.047+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92413a1c0 con 0x7fc92413d660 2023-10-16T19:41:25.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.048+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc91800cbb0 con 0x7fc92413d660 2023-10-16T19:41:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.049+0000 7fc915ffb700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.049+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc918089620 con 0x7fc92413d660 2023-10-16T19:41:25.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.049+0000 7fc9295ba700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.049+0000 7fc9295ba700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 0x7fc90806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9200090b0 tx=0x7fc920008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.053+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc92413a1c0 con 0x7fc92413d660 2023-10-16T19:41:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.254+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9241557b0 con 0x7fc90806af00 2023-10-16T19:41:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.255+0000 7fc915ffb700 1 -- 172.21.15.29:0/3448263716 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc920011c00 con 0x7fc90806af00 2023-10-16T19:41:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 msgr2=0x7fc90806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 0x7fc90806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc9200090b0 tx=0x7fc920008030 comp rx=0 tx=0).stop 2023-10-16T19:41:25.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 msgr2=0x7fc9241e9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc91800e870 tx=0x7fc91800ec30 comp rx=0 tx=0).stop 2023-10-16T19:41:25.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 shutdown_connections 2023-10-16T19:41:25.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc924154a50 0x7fc9241ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92406adc0 0x7fc9240c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 --2- 172.21.15.29:0/3448263716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92413d660 0x7fc9241e9c50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 >> 172.21.15.29:0/3448263716 conn(0x7fc9240c7110 msgr2=0x7fc9240c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 shutdown_connections 2023-10-16T19:41:25.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.257+0000 7fc92b81e700 1 -- 172.21.15.29:0/3448263716 wait complete. 2023-10-16T19:41:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T19:41:25.271 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T19:41:25.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:25.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.399+0000 7f3d076ce700 1 Processor -- start 2023-10-16T19:41:25.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.399+0000 7f3d076ce700 1 -- start start 2023-10-16T19:41:25.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d0006ede0 0x7f3d000a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 0x7f3d0006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 0x7f3d000c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d001581b0 con 0x7f3d0006ede0 2023-10-16T19:41:25.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d00158490 con 0x7f3d000c33a0 2023-10-16T19:41:25.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d076ce700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00158770 con 0x7f3d0006adc0 2023-10-16T19:41:25.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d0006ede0 0x7f3d000a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d0006ede0 0x7f3d000a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53964/0 (socket says 172.21.15.29:53964) 2023-10-16T19:41:25.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 -- 172.21.15.29:0/4108447173 learned_addr learned my addr 172.21.15.29:0/4108447173 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:25.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d05c6b700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 0x7f3d000c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d04c69700 1 --2- 172.21.15.29:0/4108447173 >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 0x7f3d0006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 -- 172.21.15.29:0/4108447173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 msgr2=0x7f3d000c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 0x7f3d000c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 -- 172.21.15.29:0/4108447173 >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 msgr2=0x7f3d0006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 --2- 172.21.15.29:0/4108447173 >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 0x7f3d0006a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 -- 172.21.15.29:0/4108447173 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00158a50 con 0x7f3d0006ede0 2023-10-16T19:41:25.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d05c6b700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 0x7f3d000c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d04c69700 1 --2- 172.21.15.29:0/4108447173 >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 0x7f3d0006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3d0546a700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000a61d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d000c1550 tx=0x7f3cfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b682748783634b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3cf7fff700 1 -- 172.21.15.29:0/4108447173 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00b870 con 0x7f3d0006ede0 2023-10-16T19:41:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3cf7fff700 1 -- 172.21.15.29:0/4108447173 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc00b9d0 con 0x7f3d0006ede0 2023-10-16T19:41:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.400+0000 7f3cf7fff700 1 -- 172.21.15.29:0/4108447173 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00bd60 con 0x7f3d0006ede0 2023-10-16T19:41:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 -- 172.21.15.29:0/4108447173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 msgr2=0x7f3d000a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000a61d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d000c1550 tx=0x7f3cfc009bd0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 -- 172.21.15.29:0/4108447173 shutdown_connections 2023-10-16T19:41:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000a61d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 --2- 172.21.15.29:0/4108447173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d0006adc0 0x7f3d000c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 --2- 172.21.15.29:0/4108447173 >> v2:172.21.15.53:3300/0 conn(0x7f3d000c33a0 0x7f3d0006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 -- 172.21.15.29:0/4108447173 >> 172.21.15.29:0/4108447173 conn(0x7f3d000c7150 msgr2=0x7f3d000c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 -- 172.21.15.29:0/4108447173 shutdown_connections 2023-10-16T19:41:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.401+0000 7f3d076ce700 1 -- 172.21.15.29:0/4108447173 wait complete. 2023-10-16T19:41:25.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.402+0000 7f3d076ce700 1 Processor -- start 2023-10-16T19:41:25.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.402+0000 7f3d076ce700 1 -- start start 2023-10-16T19:41:25.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d0006adc0 0x7f3d000ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d000c33a0 0x7f3d000bc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00153bd0 con 0x7f3d0006ede0 2023-10-16T19:41:25.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000bbaf0 con 0x7f3d0006adc0 2023-10-16T19:41:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d076ce700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000bbdd0 con 0x7f3d000c33a0 2023-10-16T19:41:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53972/0 (socket says 172.21.15.29:53972) 2023-10-16T19:41:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 -- 172.21.15.29:0/3980397730 learned_addr learned my addr 172.21.15.29:0/3980397730 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d05c6b700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d000c33a0 0x7f3d000bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 -- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d000c33a0 msgr2=0x7f3d000bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d000c33a0 0x7f3d000bc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 -- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d0006adc0 msgr2=0x7f3d000ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d0546a700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d0006adc0 0x7f3d000ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d0006adc0 0x7f3d000ba9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.403+0000 7f3d04c69700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc009550 con 0x7f3d0006ede0 2023-10-16T19:41:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3d04c69700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000abfb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c820 tx=0x7f3cf000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0011800 con 0x7f3d0006ede0 2023-10-16T19:41:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0011960 con 0x7f3d0006ede0 2023-10-16T19:41:25.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0011d10 con 0x7f3d0006ede0 2023-10-16T19:41:25.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d000bd590 con 0x7f3d0006ede0 2023-10-16T19:41:25.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.404+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d000bdcc0 con 0x7f3d0006ede0 2023-10-16T19:41:25.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.405+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d00158d30 con 0x7f3d0006ede0 2023-10-16T19:41:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.405+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3cf0018360 con 0x7f3d0006ede0 2023-10-16T19:41:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3cf5ffb700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ce406af00 0x7f3ce406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3cf0089740 con 0x7f3d0006ede0 2023-10-16T19:41:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3cf5ffb700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7f3ce4073690 0x7f3ce4075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ce40761e0 con 0x7f3ce4073690 2023-10-16T19:41:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cf008be00 con 0x7f3d0006ede0 2023-10-16T19:41:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3d0546a700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ce406af00 0x7f3ce406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.406+0000 7f3d05c6b700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7f3ce4073690 0x7f3ce4075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.407+0000 7f3d0546a700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ce406af00 0x7f3ce406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009130 tx=0x7f3cfc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.407+0000 7f3d05c6b700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7f3ce4073690 0x7f3ce4075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.407+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== osd.5 v2:172.21.15.53:6800/1208523159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3ce40761e0 con 0x7f3ce4073690 2023-10-16T19:41:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.422+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 --> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d0004f400 con 0x7f3ce4073690 2023-10-16T19:41:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3cf5ffb700 1 -- 172.21.15.29:0/3980397730 <== osd.5 v2:172.21.15.53:6800/1208523159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d0004f400 con 0x7f3ce4073690 2023-10-16T19:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7f3ce4073690 msgr2=0x7f3ce4075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6800/1208523159,v1:172.21.15.53:6801/1208523159] conn(0x7f3ce4073690 0x7f3ce4075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ce406af00 msgr2=0x7f3ce406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f3ce406af00 0x7f3ce406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009130 tx=0x7f3cfc008030 comp rx=0 tx=0).stop 2023-10-16T19:41:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 msgr2=0x7f3d000abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 --2- 172.21.15.29:0/3980397730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0006ede0 0x7f3d000abfb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c820 tx=0x7f3cf000cbe0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d05c6b700 1 -- 172.21.15.29:0/3980397730 reap_dead start 2023-10-16T19:41:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 shutdown_connections 2023-10-16T19:41:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 >> 172.21.15.29:0/3980397730 conn(0x7f3d000c7150 msgr2=0x7f3d000c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 shutdown_connections 2023-10-16T19:41:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.423+0000 7f3d076ce700 1 -- 172.21.15.29:0/3980397730 wait complete. 2023-10-16T19:41:25.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T19:41:25.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.561+0000 7f9fe8f0d700 1 Processor -- start 2023-10-16T19:41:25.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.561+0000 7f9fe8f0d700 1 -- start start 2023-10-16T19:41:25.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe8f0d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9fe40c3350 0x7f9fe41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe8f0d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fe406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe8f0d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe4155af0 con 0x7f9fe414ec50 2023-10-16T19:41:25.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe8f0d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe4152300 con 0x7f9fe40c3350 2023-10-16T19:41:25.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe8f0d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40c2e40 con 0x7f9fe406db00 2023-10-16T19:41:25.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9fe414ec50 0x7f9fe4071300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39424/0 (socket says 172.21.15.29:39424) 2023-10-16T19:41:25.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe259c700 1 -- 172.21.15.29:0/1923092704 learned_addr learned my addr 172.21.15.29:0/1923092704 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:25.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe2d9d700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fe406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117283460 0 0) 0x7f9fd8001110 con 0x7f9fe414ec50 2023-10-16T19:41:25.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fcc0035b0 con 0x7f9fe414ec50 2023-10-16T19:41:25.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.562+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/1923092704 >> v2:172.21.15.53:3300/0 conn(0x7f9fe40c3350 0x7f9fe41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442695617 0 0) 0x7f9fcc0035b0 con 0x7f9fe414ec50 2023-10-16T19:41:25.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 msgr2=0x7f9fe406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fe406dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 >> v2:172.21.15.53:3300/0 conn(0x7f9fe40c3350 msgr2=0x7f9fe41555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 --2- 172.21.15.29:0/1923092704 >> v2:172.21.15.53:3300/0 conn(0x7f9fe40c3350 0x7f9fe41555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe414f030 con 0x7f9fe414ec50 2023-10-16T19:41:25.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7f9fd8001800 con 0x7f9fe414ec50 2023-10-16T19:41:25.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 >> v1:172.21.15.29:6789/0 conn(0x7f9fe414ec50 legacy=0x7f9fe4071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fcc004d90 0x7f9fcc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4152300 con 0x7f9fcc003a00 2023-10-16T19:41:25.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40c2e40 con 0x7f9fcc004d90 2023-10-16T19:41:25.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc00ba10 con 0x7f9fe406db00 2023-10-16T19:41:25.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe2d9d700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fcc004d90 0x7f9fcc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 -- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 msgr2=0x7f9fcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe406db00 0x7f9fcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 -- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fcc004d90 msgr2=0x7f9fcc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fcc004d90 0x7f9fcc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 -- 172.21.15.29:0/1923092704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0035b0 con 0x7f9fcc003a00 2023-10-16T19:41:25.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe259c700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fcc003e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c320 tx=0x7f9fcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b84a75d35fe4bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800ce60 con 0x7f9fcc003a00 2023-10-16T19:41:25.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8005960 con 0x7f9fcc003a00 2023-10-16T19:41:25.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.563+0000 7f9fe159a700 1 -- 172.21.15.29:0/1923092704 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8005d10 con 0x7f9fcc003a00 2023-10-16T19:41:25.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/1923092704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 msgr2=0x7f9fcc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/1923092704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fcc003e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c320 tx=0x7f9fcc005880 comp rx=0 tx=0).stop 2023-10-16T19:41:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe2d9d700 1 -- 172.21.15.29:0/1923092704 reap_dead start 2023-10-16T19:41:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/1923092704 shutdown_connections 2023-10-16T19:41:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/1923092704 >> 172.21.15.29:0/1923092704 conn(0x7f9fe40c7110 msgr2=0x7f9fe40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/1923092704 shutdown_connections 2023-10-16T19:41:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.564+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/1923092704 wait complete. 2023-10-16T19:41:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.565+0000 7f9fe8f0d700 1 Processor -- start 2023-10-16T19:41:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.565+0000 7f9fe8f0d700 1 -- start start 2023-10-16T19:41:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 0x7f9fe40aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 0x7f9fe40c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40ab7e0 con 0x7f9fcc003a00 2023-10-16T19:41:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe41e67a0 con 0x7f9fe40aab60 2023-10-16T19:41:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe8f0d700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe41e6a40 con 0x7f9fe4144fa0 2023-10-16T19:41:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53992/0 (socket says 172.21.15.29:53992) 2023-10-16T19:41:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe259c700 1 -- 172.21.15.29:0/2040156063 learned_addr learned my addr 172.21.15.29:0/2040156063 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe2d9d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 0x7f9fe40c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.566+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 0x7f9fe40aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 -- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 msgr2=0x7f9fe40aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 0x7f9fe40aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 -- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 msgr2=0x7f9fe40c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 0x7f9fe40c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 -- 172.21.15.29:0/2040156063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe41e6d20 con 0x7f9fcc003a00 2023-10-16T19:41:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 0x7f9fe40aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe2d9d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 0x7f9fe40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe259c700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004730 tx=0x7f9fd8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8020070 con 0x7f9fcc003a00 2023-10-16T19:41:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8007d00 con 0x7f9fcc003a00 2023-10-16T19:41:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe41e7000 con 0x7f9fcc003a00 2023-10-16T19:41:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8004870 con 0x7f9fcc003a00 2023-10-16T19:41:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.567+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe414bd80 con 0x7f9fcc003a00 2023-10-16T19:41:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.568+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe41e7370 con 0x7f9fcc003a00 2023-10-16T19:41:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.568+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9fd80049d0 con 0x7f9fcc003a00 2023-10-16T19:41:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.569+0000 7f9fd2ffd700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 0x7f9fc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.569+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9fd808bd90 con 0x7f9fcc003a00 2023-10-16T19:41:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.569+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 0x7f9fc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.570+0000 7f9fe1d9b700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 0x7f9fc406d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9fe41453a0 tx=0x7f9fd4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.573+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9fd8056cf0 con 0x7f9fcc003a00 2023-10-16T19:41:25.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.773+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fe41519d0 con 0x7f9fc406af00 2023-10-16T19:41:25.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.774+0000 7f9fd2ffd700 1 -- 172.21.15.29:0/2040156063 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9fd40137a0 con 0x7f9fc406af00 2023-10-16T19:41:25.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 msgr2=0x7f9fc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 0x7f9fc406d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9fe41453a0 tx=0x7f9fd4008040 comp rx=0 tx=0).stop 2023-10-16T19:41:25.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 msgr2=0x7f9fe4144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004730 tx=0x7f9fd8001b90 comp rx=0 tx=0).stop 2023-10-16T19:41:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 shutdown_connections 2023-10-16T19:41:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9fc406af00 0x7f9fc406d3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe40aab60 0x7f9fe40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fcc003a00 0x7f9fe4144980 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 --2- 172.21.15.29:0/2040156063 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9fe4144fa0 0x7f9fe40aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 >> 172.21.15.29:0/2040156063 conn(0x7f9fe40c7110 msgr2=0x7f9fe414d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 shutdown_connections 2023-10-16T19:41:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.776+0000 7f9fe8f0d700 1 -- 172.21.15.29:0/2040156063 wait complete. 2023-10-16T19:41:25.782 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T19:41:25.790 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T19:41:25.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:25.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.918+0000 7fbabb3fe700 1 Processor -- start 2023-10-16T19:41:25.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.918+0000 7fbabb3fe700 1 -- start start 2023-10-16T19:41:25.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbabb3fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab4155060 0x7fbab40665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbabb3fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab41558c0 con 0x7fbab4152090 2023-10-16T19:41:25.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbabb3fe700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab41555e0 con 0x7fbab4072b80 2023-10-16T19:41:25.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbabb3fe700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c1de0 con 0x7fbab4155060 2023-10-16T19:41:25.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbab919a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbab4152090 0x7fbab4154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39444/0 (socket says 172.21.15.29:39444) 2023-10-16T19:41:25.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbab919a700 1 -- 172.21.15.29:0/3519536850 learned_addr learned my addr 172.21.15.29:0/3519536850 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:25.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.919+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780052829 0 0) 0x7fbab41558c0 con 0x7fbab4152090 2023-10-16T19:41:25.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab999b700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab4155060 0x7fbab40665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa00035b0 con 0x7fbab4152090 2023-10-16T19:41:25.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771681543 0 0) 0x7fbaa00035b0 con 0x7fbab4152090 2023-10-16T19:41:25.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab4155060 msgr2=0x7fbab40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab4155060 0x7fbab40665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 >> v1:172.21.15.53:6789/0 conn(0x7fbab4072b80 legacy=0x7fbab40bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40c20c0 con 0x7fbab4152090 2023-10-16T19:41:25.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fbab0001670 con 0x7fbab4152090 2023-10-16T19:41:25.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 >> v1:172.21.15.29:6789/0 conn(0x7fbab4152090 legacy=0x7fbab4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaa0003a30 0x7fbaa0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0004850 0x7fbaa0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbaa0005330 0x7fbaa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c1de0 con 0x7fbaa0003a30 2023-10-16T19:41:25.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa000c200 con 0x7fbaa0004850 2023-10-16T19:41:25.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa000c3c0 con 0x7fbaa0005330 2023-10-16T19:41:25.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab999b700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab4155060 0x7fbab40665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:25.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaa0003a30 0x7fbaa0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab8999700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0004850 0x7fbaa0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab999b700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbaa0005330 0x7fbaa000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 -- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbaa0005330 msgr2=0x7fbaa000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbaa0005330 0x7fbaa000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 -- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0004850 msgr2=0x7fbaa0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:25.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0004850 0x7fbaa0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 -- 172.21.15.29:0/3519536850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00035b0 con 0x7fbaa0003a30 2023-10-16T19:41:25.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab999b700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbaa0005330 0x7fbaa000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:25.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.920+0000 7fbab919a700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaa0003a30 0x7fbaa0003e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c240 tx=0x7fbaa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1998a9b8852fa86 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0007c10 con 0x7fbaa0003a30 2023-10-16T19:41:25.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab000ce00 con 0x7fbaa0003a30 2023-10-16T19:41:25.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbaa7fff700 1 -- 172.21.15.29:0/3519536850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0005ba0 con 0x7fbaa0003a30 2023-10-16T19:41:25.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 -- 172.21.15.29:0/3519536850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaa0003a30 msgr2=0x7fbaa0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 --2- 172.21.15.29:0/3519536850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaa0003a30 0x7fbaa0003e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c240 tx=0x7fbaa0005880 comp rx=0 tx=0).stop 2023-10-16T19:41:25.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbab999b700 1 -- 172.21.15.29:0/3519536850 reap_dead start 2023-10-16T19:41:25.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 -- 172.21.15.29:0/3519536850 shutdown_connections 2023-10-16T19:41:25.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 -- 172.21.15.29:0/3519536850 >> 172.21.15.29:0/3519536850 conn(0x7fbab40c3190 msgr2=0x7fbab40c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 -- 172.21.15.29:0/3519536850 shutdown_connections 2023-10-16T19:41:25.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.921+0000 7fbabb3fe700 1 -- 172.21.15.29:0/3519536850 wait complete. 2023-10-16T19:41:25.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.923+0000 7fbabb3fe700 1 Processor -- start 2023-10-16T19:41:25.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.923+0000 7fbabb3fe700 1 -- start start 2023-10-16T19:41:25.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0003a30 0x7fbab40c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 0x7fbab414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab41527c0 0x7fbab4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41ed8d0 con 0x7fbab40c60b0 2023-10-16T19:41:25.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41546d0 con 0x7fbaa0003a30 2023-10-16T19:41:25.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbabb3fe700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c4930 con 0x7fbab41527c0 2023-10-16T19:41:25.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 0x7fbab414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 0x7fbab414a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54014/0 (socket says 172.21.15.29:54014) 2023-10-16T19:41:25.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 -- 172.21.15.29:0/547020701 learned_addr learned my addr 172.21.15.29:0/547020701 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:25.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab999b700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab41527c0 0x7fbab4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab919a700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0003a30 0x7fbab40c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 -- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab41527c0 msgr2=0x7fbab4152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbab41527c0 0x7fbab4152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 -- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0003a30 msgr2=0x7fbab40c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa0003a30 0x7fbab40c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40c5af0 con 0x7fbab40c60b0 2023-10-16T19:41:25.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbab8999700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 0x7fbab414a9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e5a0 tx=0x7fbaa800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80052e0 con 0x7fbab40c60b0 2023-10-16T19:41:25.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa8005460 con 0x7fbab40c60b0 2023-10-16T19:41:25.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.924+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80038c0 con 0x7fbab40c60b0 2023-10-16T19:41:25.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.925+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab41edcf0 con 0x7fbab40c60b0 2023-10-16T19:41:25.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.925+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41ed210 con 0x7fbab40c60b0 2023-10-16T19:41:25.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.925+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbab40665a0 con 0x7fbab40c60b0 2023-10-16T19:41:25.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.926+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbaa8003a20 con 0x7fbab40c60b0 2023-10-16T19:41:25.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.926+0000 7fbaa5ffb700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fba9806af00 0x7fba9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.926+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbaa8088e30 con 0x7fbab40c60b0 2023-10-16T19:41:25.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbab919a700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fba9806af00 0x7fba9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbaa5ffb700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fba98073690 0x7fba98075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:25.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba980761e0 con 0x7fba98073690 2023-10-16T19:41:25.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa808b4f0 con 0x7fbab40c60b0 2023-10-16T19:41:25.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbab999b700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fba98073690 0x7fba98075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:25.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbab919a700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fba9806af00 0x7fba9806d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbab0000c00 tx=0x7fbab0007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.927+0000 7fbab999b700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fba98073690 0x7fba98075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:25.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.928+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== osd.6 v2:172.21.15.53:6808/196702031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fba980761e0 con 0x7fba98073690 2023-10-16T19:41:25.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.943+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 --> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbab41eda10 con 0x7fba98073690 2023-10-16T19:41:25.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.943+0000 7fbaa5ffb700 1 -- 172.21.15.29:0/547020701 <== osd.6 v2:172.21.15.53:6808/196702031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbab41eda10 con 0x7fba98073690 2023-10-16T19:41:25.954 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:25.954 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:25.954 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:25.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fba98073690 msgr2=0x7fba98075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6808/196702031,v1:172.21.15.53:6809/196702031] conn(0x7fba98073690 0x7fba98075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:25.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fba9806af00 msgr2=0x7fba9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fba9806af00 0x7fba9806d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbab0000c00 tx=0x7fbab0007000 comp rx=0 tx=0).stop 2023-10-16T19:41:25.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 msgr2=0x7fbab414a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:25.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 --2- 172.21.15.29:0/547020701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbab40c60b0 0x7fbab414a9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e5a0 tx=0x7fbaa800e960 comp rx=0 tx=0).stop 2023-10-16T19:41:25.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbab999b700 1 -- 172.21.15.29:0/547020701 reap_dead start 2023-10-16T19:41:25.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 shutdown_connections 2023-10-16T19:41:25.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 >> 172.21.15.29:0/547020701 conn(0x7fbab40c3190 msgr2=0x7fbab40c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:25.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 shutdown_connections 2023-10-16T19:41:25.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:25.944+0000 7fbabb3fe700 1 -- 172.21.15.29:0/547020701 wait complete. 2023-10-16T19:41:25.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T19:41:26.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.084+0000 7fbdaf2fb700 1 Processor -- start 2023-10-16T19:41:26.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.084+0000 7fbdaf2fb700 1 -- start start 2023-10-16T19:41:26.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdaf2fb700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbda814ec50 0x7fbda81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdaf2fb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdaf2fb700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8155af0 con 0x7fbda8071840 2023-10-16T19:41:26.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdaf2fb700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda8152300 con 0x7fbda814ec50 2023-10-16T19:41:26.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdaf2fb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c2e40 con 0x7fbda80c3350 2023-10-16T19:41:26.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdad097700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbda814ec50 0x7fbda81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:46478/0 (socket says 172.21.15.29:46478) 2023-10-16T19:41:26.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 -- 172.21.15.29:0/3853250622 learned_addr learned my addr 172.21.15.29:0/3853250622 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 -- 172.21.15.29:0/3853250622 >> v2:172.21.15.53:3300/0 conn(0x7fbda814ec50 msgr2=0x7fbda81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 --2- 172.21.15.29:0/3853250622 >> v2:172.21.15.53:3300/0 conn(0x7fbda814ec50 0x7fbda81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 -- 172.21.15.29:0/3853250622 >> v1:172.21.15.53:6789/0 conn(0x7fbda8071840 legacy=0x7fbda806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.085+0000 7fbdac896700 1 -- 172.21.15.29:0/3853250622 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda814f030 con 0x7fbda80c3350 2023-10-16T19:41:26.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdac896700 1 --2- 172.21.15.29:0/3853250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800bb90 tx=0x7fbd9800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82b4f156dfcf581e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbd9ffff700 1 -- 172.21.15.29:0/3853250622 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800dd30 con 0x7fbda80c3350 2023-10-16T19:41:26.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbd9ffff700 1 -- 172.21.15.29:0/3853250622 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800de90 con 0x7fbda80c3350 2023-10-16T19:41:26.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbd9ffff700 1 -- 172.21.15.29:0/3853250622 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98010690 con 0x7fbda80c3350 2023-10-16T19:41:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/3853250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 msgr2=0x7fbda8071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/3853250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800bb90 tx=0x7fbd9800bea0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/3853250622 shutdown_connections 2023-10-16T19:41:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/3853250622 >> v2:172.21.15.53:3300/0 conn(0x7fbda814ec50 0x7fbda81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/3853250622 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda8071300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/3853250622 >> 172.21.15.29:0/3853250622 conn(0x7fbda80c7110 msgr2=0x7fbda80c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/3853250622 shutdown_connections 2023-10-16T19:41:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.086+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/3853250622 wait complete. 2023-10-16T19:41:26.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 Processor -- start 2023-10-16T19:41:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 -- start start 2023-10-16T19:41:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 0x7fbda81e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c6ba0 con 0x7fbda8071840 2023-10-16T19:41:26.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda814f990 con 0x7fbda814ec50 2023-10-16T19:41:26.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdaf2fb700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8150840 con 0x7fbda80c3350 2023-10-16T19:41:26.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdad097700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdad097700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54028/0 (socket says 172.21.15.29:54028) 2023-10-16T19:41:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.088+0000 7fbdad097700 1 -- 172.21.15.29:0/956242113 learned_addr learned my addr 172.21.15.29:0/956242113 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdac896700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad898700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 0x7fbda81e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 -- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 msgr2=0x7fbda806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 -- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 msgr2=0x7fbda81e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 0x7fbda81e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 -- 172.21.15.29:0/956242113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9800b7f0 con 0x7fbda8071840 2023-10-16T19:41:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad898700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 0x7fbda81e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:41:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdad097700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e9b0 tx=0x7fbda400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4009710 con 0x7fbda8071840 2023-10-16T19:41:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400c850 con 0x7fbda8071840 2023-10-16T19:41:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda8150b20 con 0x7fbda8071840 2023-10-16T19:41:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400cbc0 con 0x7fbda8071840 2023-10-16T19:41:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.089+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda814fba0 con 0x7fbda8071840 2023-10-16T19:41:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.090+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda804f400 con 0x7fbda8071840 2023-10-16T19:41:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.091+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbda400cd20 con 0x7fbda8071840 2023-10-16T19:41:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.091+0000 7fbd9dffb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 0x7fbd8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.091+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbda4089870 con 0x7fbda8071840 2023-10-16T19:41:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.091+0000 7fbdac896700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 0x7fbd8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.092+0000 7fbdac896700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 0x7fbd8c06d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800bee0 tx=0x7fbd98013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.095+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbda4054740 con 0x7fbda8071840 2023-10-16T19:41:26.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.294+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbda81519d0 con 0x7fbd8c06af00 2023-10-16T19:41:26.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.294+0000 7fbd9dffb700 1 -- 172.21.15.29:0/956242113 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd98020040 con 0x7fbd8c06af00 2023-10-16T19:41:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 msgr2=0x7fbd8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 0x7fbd8c06d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800bee0 tx=0x7fbd98013000 comp rx=0 tx=0).stop 2023-10-16T19:41:26.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 msgr2=0x7fbda80c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e9b0 tx=0x7fbda400ecc0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 shutdown_connections 2023-10-16T19:41:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fbd8c06af00 0x7fbd8c06d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda814ec50 0x7fbda81e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda8071840 0x7fbda80c5510 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 --2- 172.21.15.29:0/956242113 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbda80c3350 0x7fbda806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.296+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 >> 172.21.15.29:0/956242113 conn(0x7fbda80c7110 msgr2=0x7fbda814cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.297+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 shutdown_connections 2023-10-16T19:41:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.297+0000 7fbdaf2fb700 1 -- 172.21.15.29:0/956242113 wait complete. 2023-10-16T19:41:26.302 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T19:41:26.311 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T19:41:26.311 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:41:26.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 Processor -- start 2023-10-16T19:41:26.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 -- start start 2023-10-16T19:41:26.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d2806f180 0x7f9d281548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d28157ed0 con 0x7f9d28152000 2023-10-16T19:41:26.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d281523e0 con 0x7f9d2806f180 2023-10-16T19:41:26.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.438+0000 7f9d2e7d6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c1a80 con 0x7f9d28158c00 2023-10-16T19:41:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d2cd73700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d2806f180 0x7f9d281548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:46490/0 (socket says 172.21.15.29:46490) 2023-10-16T19:41:26.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 -- 172.21.15.29:0/918618688 learned_addr learned my addr 172.21.15.29:0/918618688 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 -- 172.21.15.29:0/918618688 >> v2:172.21.15.53:3300/0 conn(0x7f9d2806f180 msgr2=0x7f9d281548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 --2- 172.21.15.29:0/918618688 >> v2:172.21.15.53:3300/0 conn(0x7f9d2806f180 0x7f9d281548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 -- 172.21.15.29:0/918618688 >> v1:172.21.15.53:6789/0 conn(0x7f9d28152000 legacy=0x7f9d2806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 -- 172.21.15.29:0/918618688 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d28158770 con 0x7f9d28158c00 2023-10-16T19:41:26.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d277fe700 1 --2- 172.21.15.29:0/918618688 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098f0 tx=0x7f9d1c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f996dd0758ba8cd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.439+0000 7f9d26ffd700 1 -- 172.21.15.29:0/918618688 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011830 con 0x7f9d28158c00 2023-10-16T19:41:26.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d26ffd700 1 -- 172.21.15.29:0/918618688 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c011990 con 0x7f9d28158c00 2023-10-16T19:41:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d26ffd700 1 -- 172.21.15.29:0/918618688 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011d20 con 0x7f9d28158c00 2023-10-16T19:41:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/918618688 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 msgr2=0x7f9d28071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/918618688 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098f0 tx=0x7f9d1c009c00 comp rx=0 tx=0).stop 2023-10-16T19:41:26.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/918618688 shutdown_connections 2023-10-16T19:41:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/918618688 >> v2:172.21.15.53:3300/0 conn(0x7f9d2806f180 0x7f9d281548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/918618688 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d28158c00 0x7f9d28071c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/918618688 >> 172.21.15.29:0/918618688 conn(0x7f9d280c7150 msgr2=0x7f9d280c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/918618688 shutdown_connections 2023-10-16T19:41:26.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.440+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/918618688 wait complete. 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.441+0000 7f9d2e7d6700 1 Processor -- start 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.441+0000 7f9d2e7d6700 1 -- start start 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d2806f180 0x7f9d2814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 0x7f9d28146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d28158c00 0x7f9d28146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281472f0 con 0x7f9d28152000 2023-10-16T19:41:26.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281ea890 con 0x7f9d28158c00 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2e7d6700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281eab30 con 0x7f9d2806f180 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 0x7f9d28146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 0x7f9d28146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54044/0 (socket says 172.21.15.29:54044) 2023-10-16T19:41:26.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d277fe700 1 -- 172.21.15.29:0/305252334 learned_addr learned my addr 172.21.15.29:0/305252334 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d2cd73700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d28158c00 0x7f9d28146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.442+0000 7f9d27fff700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d2806f180 0x7f9d2814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 -- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d2806f180 msgr2=0x7f9d2814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d2806f180 0x7f9d2814ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 -- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d28158c00 msgr2=0x7f9d28146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d28158c00 0x7f9d28146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009550 con 0x7f9d28152000 2023-10-16T19:41:26.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d277fe700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 0x7f9d28146870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c000c00 tx=0x7f9d1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0036a0 con 0x7f9d28152000 2023-10-16T19:41:26.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c003800 con 0x7f9d28152000 2023-10-16T19:41:26.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003b90 con 0x7f9d28152000 2023-10-16T19:41:26.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d281567a0 con 0x7f9d28152000 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.443+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d28156d60 con 0x7f9d28152000 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.444+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d28158120 con 0x7f9d28152000 2023-10-16T19:41:26.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.444+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d1c021070 con 0x7f9d28152000 2023-10-16T19:41:26.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d24ff9700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9d1406af00 0x7f9d1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9d1c08abf0 con 0x7f9d28152000 2023-10-16T19:41:26.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d24ff9700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7f9d14073710 0x7f9d14075b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d14076260 con 0x7f9d14073710 2023-10-16T19:41:26.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d27fff700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9d1406af00 0x7f9d1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1c08f280 con 0x7f9d28152000 2023-10-16T19:41:26.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.445+0000 7f9d2cd73700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7f9d14073710 0x7f9d14075b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.446+0000 7f9d27fff700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9d1406af00 0x7f9d1406d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d18007fd0 tx=0x7f9d18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.446+0000 7f9d2cd73700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7f9d14073710 0x7f9d14075b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.446+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== osd.7 v2:172.21.15.53:6824/2487489897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9d14076260 con 0x7f9d14073710 2023-10-16T19:41:26.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.461+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 --> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d280723c0 con 0x7f9d14073710 2023-10-16T19:41:26.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d24ff9700 1 -- 172.21.15.29:0/305252334 <== osd.7 v2:172.21.15.53:6824/2487489897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d2000f040 con 0x7f9d14073710 2023-10-16T19:41:26.464 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T19:41:26.465 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-16T19:41:26.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7f9d14073710 msgr2=0x7f9d14075b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6824/2487489897,v1:172.21.15.53:6825/2487489897] conn(0x7f9d14073710 0x7f9d14075b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9d1406af00 msgr2=0x7f9d1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9d1406af00 0x7f9d1406d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d18007fd0 tx=0x7f9d18009040 comp rx=0 tx=0).stop 2023-10-16T19:41:26.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 msgr2=0x7f9d28146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 --2- 172.21.15.29:0/305252334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d28152000 0x7f9d28146870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c000c00 tx=0x7f9d1c004750 comp rx=0 tx=0).stop 2023-10-16T19:41:26.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2cd73700 1 -- 172.21.15.29:0/305252334 reap_dead start 2023-10-16T19:41:26.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 shutdown_connections 2023-10-16T19:41:26.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 >> 172.21.15.29:0/305252334 conn(0x7f9d280c7150 msgr2=0x7f9d2814c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 shutdown_connections 2023-10-16T19:41:26.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.462+0000 7f9d2e7d6700 1 -- 172.21.15.29:0/305252334 wait complete. 2023-10-16T19:41:26.476 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T19:41:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.599+0000 7fc05bc76700 1 Processor -- start 2023-10-16T19:41:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 -- start start 2023-10-16T19:41:26.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc05414ee10 0x7fc0540c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0540c2880 0x7fc0540c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc054152200 con 0x7fc0540c1d90 2023-10-16T19:41:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05406c140 con 0x7fc0540c2880 2023-10-16T19:41:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.600+0000 7fc05bc76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540c2d20 con 0x7fc05414ee10 2023-10-16T19:41:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0540c2880 0x7fc0540c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc05a213700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc0540c1d90 0x7fc05406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39500/0 (socket says 172.21.15.29:39500) 2023-10-16T19:41:26.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc05a213700 1 -- 172.21.15.29:0/1341873086 learned_addr learned my addr 172.21.15.29:0/1341873086 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:26.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059a12700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc05414ee10 0x7fc0540c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 -- 172.21.15.29:0/1341873086 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc05414ee10 msgr2=0x7fc0540c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc05414ee10 0x7fc0540c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 -- 172.21.15.29:0/1341873086 >> v1:172.21.15.29:6789/0 conn(0x7fc0540c1d90 legacy=0x7fc05406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 -- 172.21.15.29:0/1341873086 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054152690 con 0x7fc0540c2880 2023-10-16T19:41:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc058a10700 1 -- 172.21.15.29:0/1341873086 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487633176 0 0) 0x7fc054152200 con 0x7fc0540c1d90 2023-10-16T19:41:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc059211700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c2880 0x7fc0540c1850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc048009840 tx=0x7fc048009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90113caa773b6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc058a10700 1 -- 172.21.15.29:0/1341873086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048011830 con 0x7fc0540c2880 2023-10-16T19:41:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc058a10700 1 -- 172.21.15.29:0/1341873086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048011990 con 0x7fc0540c2880 2023-10-16T19:41:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.601+0000 7fc058a10700 1 -- 172.21.15.29:0/1341873086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048011d20 con 0x7fc0540c2880 2023-10-16T19:41:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 -- 172.21.15.29:0/1341873086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c2880 msgr2=0x7fc0540c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c2880 0x7fc0540c1850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc048009840 tx=0x7fc048009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 -- 172.21.15.29:0/1341873086 shutdown_connections 2023-10-16T19:41:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc05414ee10 0x7fc0540c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 --2- 172.21.15.29:0/1341873086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c2880 0x7fc0540c1850 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 -- 172.21.15.29:0/1341873086 >> 172.21.15.29:0/1341873086 conn(0x7fc0540c66d0 msgr2=0x7fc0540c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 -- 172.21.15.29:0/1341873086 shutdown_connections 2023-10-16T19:41:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.602+0000 7fc05bc76700 1 -- 172.21.15.29:0/1341873086 wait complete. 2023-10-16T19:41:26.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.603+0000 7fc05bc76700 1 Processor -- start 2023-10-16T19:41:26.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.603+0000 7fc05bc76700 1 -- start start 2023-10-16T19:41:26.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0540c2880 0x7fc054154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05414ee10 0x7fc054141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541eb8c0 con 0x7fc0540c1d90 2023-10-16T19:41:26.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541eac40 con 0x7fc05414ee10 2023-10-16T19:41:26.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05bc76700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541eaf20 con 0x7fc0540c2880 2023-10-16T19:41:26.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54058/0 (socket says 172.21.15.29:54058) 2023-10-16T19:41:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 -- 172.21.15.29:0/2009658824 learned_addr learned my addr 172.21.15.29:0/2009658824 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059211700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0540c2880 0x7fc054154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc05a213700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05414ee10 0x7fc054141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 -- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0540c2880 msgr2=0x7fc054154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0540c2880 0x7fc054154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 -- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05414ee10 msgr2=0x7fc054141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05414ee10 0x7fc054141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 -- 172.21.15.29:0/2009658824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480094a0 con 0x7fc0540c1d90 2023-10-16T19:41:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc059a12700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc044007ef0 tx=0x7fc04400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.604+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400edf0 con 0x7fc0540c1d90 2023-10-16T19:41:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.605+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044014420 con 0x7fc0540c1d90 2023-10-16T19:41:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.605+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0541eb200 con 0x7fc0540c1d90 2023-10-16T19:41:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.605+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0440147d0 con 0x7fc0540c1d90 2023-10-16T19:41:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.605+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0540c3890 con 0x7fc0540c1d90 2023-10-16T19:41:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.605+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0541eba00 con 0x7fc0540c1d90 2023-10-16T19:41:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.606+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc044014930 con 0x7fc0540c1d90 2023-10-16T19:41:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.607+0000 7fc0527fc700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 0x7fc04006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.607+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc044089e20 con 0x7fc0540c1d90 2023-10-16T19:41:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.607+0000 7fc059211700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 0x7fc04006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.607+0000 7fc059211700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 0x7fc04006d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0480090b0 tx=0x7fc048008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.611+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0541eba00 con 0x7fc0540c1d90 2023-10-16T19:41:26.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.813+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0541518d0 con 0x7fc04006af00 2023-10-16T19:41:26.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.813+0000 7fc0527fc700 1 -- 172.21.15.29:0/2009658824 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc048011c00 con 0x7fc04006af00 2023-10-16T19:41:26.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 msgr2=0x7fc04006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 0x7fc04006d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0480090b0 tx=0x7fc048008030 comp rx=0 tx=0).stop 2023-10-16T19:41:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 msgr2=0x7fc0540c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc044007ef0 tx=0x7fc04400e3c0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 shutdown_connections 2023-10-16T19:41:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fc04006af00 0x7fc04006d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05414ee10 0x7fc054141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0540c1d90 0x7fc0540c3350 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 --2- 172.21.15.29:0/2009658824 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc0540c2880 0x7fc054154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 >> 172.21.15.29:0/2009658824 conn(0x7fc0540c66d0 msgr2=0x7fc05414f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 shutdown_connections 2023-10-16T19:41:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.815+0000 7fc05bc76700 1 -- 172.21.15.29:0/2009658824 wait complete. 2023-10-16T19:41:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T19:41:26.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:26.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.952+0000 7f8416b5e700 1 Processor -- start 2023-10-16T19:41:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.952+0000 7f8416b5e700 1 -- start start 2023-10-16T19:41:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f8416b5e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f841014c780 0x7f84100ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f8416b5e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f841006a880 0x7f841006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f8416b5e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8410156c60 con 0x7f8410153290 2023-10-16T19:41:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f8416b5e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100ac7d0 con 0x7f841014c780 2023-10-16T19:41:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f8416b5e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100ac5e0 con 0x7f841006a880 2023-10-16T19:41:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f84148fa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f841014c780 0x7f84100ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f840ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8410153290 0x7f841006d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39512/0 (socket says 172.21.15.29:39512) 2023-10-16T19:41:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f840ffff700 1 -- 172.21.15.29:0/1381094287 learned_addr learned my addr 172.21.15.29:0/1381094287 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f84148fa700 1 -- 172.21.15.29:0/1381094287 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f841006a880 msgr2=0x7f841006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f84148fa700 1 --2- 172.21.15.29:0/1381094287 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f841006a880 0x7f841006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f84148fa700 1 -- 172.21.15.29:0/1381094287 >> v1:172.21.15.29:6789/0 conn(0x7f8410153290 legacy=0x7f841006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f84148fa700 1 -- 172.21.15.29:0/1381094287 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84101536f0 con 0x7f841014c780 2023-10-16T19:41:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.953+0000 7f840f7fe700 1 -- 172.21.15.29:0/1381094287 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053234246 0 0) 0x7f8410156c60 con 0x7f8410153290 2023-10-16T19:41:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f84148fa700 1 --2- 172.21.15.29:0/1381094287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841014c780 0x7f84100ac0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8404009840 tx=0x7f8404009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7516317c33bf473 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f840f7fe700 1 -- 172.21.15.29:0/1381094287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404011830 con 0x7f841014c780 2023-10-16T19:41:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f840f7fe700 1 -- 172.21.15.29:0/1381094287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404011990 con 0x7f841014c780 2023-10-16T19:41:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f840f7fe700 1 -- 172.21.15.29:0/1381094287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404011d20 con 0x7f841014c780 2023-10-16T19:41:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 -- 172.21.15.29:0/1381094287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841014c780 msgr2=0x7f84100ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 --2- 172.21.15.29:0/1381094287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841014c780 0x7f84100ac0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8404009840 tx=0x7f8404009b50 comp rx=0 tx=0).stop 2023-10-16T19:41:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 -- 172.21.15.29:0/1381094287 shutdown_connections 2023-10-16T19:41:26.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 --2- 172.21.15.29:0/1381094287 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f841006a880 0x7f841006ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 --2- 172.21.15.29:0/1381094287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841014c780 0x7f84100ac0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 -- 172.21.15.29:0/1381094287 >> 172.21.15.29:0/1381094287 conn(0x7f84100c66d0 msgr2=0x7f84100c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:26.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.954+0000 7f8416b5e700 1 -- 172.21.15.29:0/1381094287 shutdown_connections 2023-10-16T19:41:26.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.955+0000 7f8416b5e700 1 -- 172.21.15.29:0/1381094287 wait complete. 2023-10-16T19:41:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 Processor -- start 2023-10-16T19:41:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 -- start start 2023-10-16T19:41:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f841014c780 0x7f84101ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8410153290 0x7f84101ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84101ee4d0 con 0x7f841006a880 2023-10-16T19:41:26.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410143c10 con 0x7f841014c780 2023-10-16T19:41:26.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.956+0000 7f8416b5e700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84101ed850 con 0x7f8410153290 2023-10-16T19:41:26.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54072/0 (socket says 172.21.15.29:54072) 2023-10-16T19:41:26.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 -- 172.21.15.29:0/856193462 learned_addr learned my addr 172.21.15.29:0/856193462 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:26.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 -- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8410153290 msgr2=0x7f84101ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8410153290 0x7f84101ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 -- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f841014c780 msgr2=0x7f84101ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:26.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f841014c780 0x7f84101ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:26.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 -- 172.21.15.29:0/856193462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040094a0 con 0x7f841006a880 2023-10-16T19:41:26.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f84148fa700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f84040090b0 tx=0x7f8404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040045f0 con 0x7f841006a880 2023-10-16T19:41:26.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840401f070 con 0x7f841006a880 2023-10-16T19:41:26.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404003b00 con 0x7f841006a880 2023-10-16T19:41:26.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84101edb30 con 0x7f841006a880 2023-10-16T19:41:26.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.957+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84101ee0f0 con 0x7f841006a880 2023-10-16T19:41:26.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.958+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841004f400 con 0x7f841006a880 2023-10-16T19:41:26.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.959+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8404003c60 con 0x7f841006a880 2023-10-16T19:41:26.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.959+0000 7f840d7fa700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 0x7f83f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:26.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.959+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8404021070 con 0x7f841006a880 2023-10-16T19:41:26.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.959+0000 7f840ffff700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 0x7f83f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:26.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.960+0000 7f840ffff700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 0x7f83f406d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f84101480c0 tx=0x7f83fc0079f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:26.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:26.964+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84040561b0 con 0x7f841006a880 2023-10-16T19:41:27.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.160+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8410156180 con 0x7f83f406af00 2023-10-16T19:41:27.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.169+0000 7f840d7fa700 1 -- 172.21.15.29:0/856193462 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287232 (secure 0 0 0) 0x7f83fc0070d0 con 0x7f83f406af00 2023-10-16T19:41:27.178 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:27.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 msgr2=0x7f83f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 0x7f83f406d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f84101480c0 tx=0x7f83fc0079f0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 msgr2=0x7f8410143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f84040090b0 tx=0x7f8404004750 comp rx=0 tx=0).stop 2023-10-16T19:41:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 shutdown_connections 2023-10-16T19:41:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f83f406af00 0x7f83f406d3c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8410153290 0x7f84101ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f841006a880 0x7f8410143250 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 --2- 172.21.15.29:0/856193462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f841014c780 0x7f84101ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 >> 172.21.15.29:0/856193462 conn(0x7f84100c66d0 msgr2=0x7f84101527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 shutdown_connections 2023-10-16T19:41:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:27.173+0000 7f8416b5e700 1 -- 172.21.15.29:0/856193462 wait complete. 2023-10-16T19:41:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:27.187 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-16T19:41:26.580304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221016,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753704,"statfs":{"total":773094113280,"available":772867792896,"internally_reserved":0,"allocated":4956160,"data_stored":2781988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002752"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641725+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:10.641725+0000","last_peered":"2023-10-16T19:41:10.641725+0000","last_clean":"2023-10-16T19:41:10.641725+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:10.641725+0000","last_undegraded":"2023-10-16T19:41:10.641725+0000","last_fullsized":"2023-10-16T19:41:10.641725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641700+0000","last_change":"2023-10-16T19:41:07.770247+0000","last_active":"2023-10-16T19:41:10.641700+0000","last_peered":"2023-10-16T19:41:10.641700+0000","last_clean":"2023-10-16T19:41:10.641700+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:10.641700+0000","last_undegraded":"2023-10-16T19:41:10.641700+0000","last_fullsized":"2023-10-16T19:41:10.641700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646587+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:10.646587+0000","last_peered":"2023-10-16T19:41:10.646587+0000","last_clean":"2023-10-16T19:41:10.646587+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:10.646587+0000","last_undegraded":"2023-10-16T19:41:10.646587+0000","last_fullsized":"2023-10-16T19:41:10.646587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646416+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:10.646416+0000","last_peered":"2023-10-16T19:41:10.646416+0000","last_clean":"2023-10-16T19:41:10.646416+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:10.646416+0000","last_undegraded":"2023-10-16T19:41:10.646416+0000","last_fullsized":"2023-10-16T19:41:10.646416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646391+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:10.646391+0000","last_peered":"2023-10-16T19:41:10.646391+0000","last_clean":"2023-10-16T19:41:10.646391+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:10.646391+0000","last_undegraded":"2023-10-16T19:41:10.646391+0000","last_fullsized":"2023-10-16T19:41:10.646391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648857+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:10.648857+0000","last_peered":"2023-10-16T19:41:10.648857+0000","last_clean":"2023-10-16T19:41:10.648857+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:10.648857+0000","last_undegraded":"2023-10-16T19:41:10.648857+0000","last_fullsized":"2023-10-16T19:41:10.648857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896310+0000","last_change":"2023-10-16T19:41:07.770089+0000","last_active":"2023-10-16T19:41:08.896310+0000","last_peered":"2023-10-16T19:41:08.896310+0000","last_clean":"2023-10-16T19:41:08.896310+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:08.896310+0000","last_undegraded":"2023-10-16T19:41:08.896310+0000","last_fullsized":"2023-10-16T19:41:08.896310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641589+0000","last_change":"2023-10-16T19:41:07.766675+0000","last_active":"2023-10-16T19:41:10.641589+0000","last_peered":"2023-10-16T19:41:10.641589+0000","last_clean":"2023-10-16T19:41:10.641589+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:10.641589+0000","last_undegraded":"2023-10-16T19:41:10.641589+0000","last_fullsized":"2023-10-16T19:41:10.641589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646673+0000","last_change":"2023-10-16T19:41:07.767824+0000","last_active":"2023-10-16T19:41:10.646673+0000","last_peered":"2023-10-16T19:41:10.646673+0000","last_clean":"2023-10-16T19:41:10.646673+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:10.646673+0000","last_undegraded":"2023-10-16T19:41:10.646673+0000","last_fullsized":"2023-10-16T19:41:10.646673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896416+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:08.896416+0000","last_peered":"2023-10-16T19:41:08.896416+0000","last_clean":"2023-10-16T19:41:08.896416+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:08.896416+0000","last_undegraded":"2023-10-16T19:41:08.896416+0000","last_fullsized":"2023-10-16T19:41:08.896416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:40:33.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896321+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:08.896321+0000","last_peered":"2023-10-16T19:41:08.896321+0000","last_clean":"2023-10-16T19:41:08.896321+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:08.896321+0000","last_undegraded":"2023-10-16T19:41:08.896321+0000","last_fullsized":"2023-10-16T19:41:08.896321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646567+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:10.646567+0000","last_peered":"2023-10-16T19:41:10.646567+0000","last_clean":"2023-10-16T19:41:10.646567+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:10.646567+0000","last_undegraded":"2023-10-16T19:41:10.646567+0000","last_fullsized":"2023-10-16T19:41:10.646567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896046+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:08.896046+0000","last_peered":"2023-10-16T19:41:08.896046+0000","last_clean":"2023-10-16T19:41:08.896046+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:08.896046+0000","last_undegraded":"2023-10-16T19:41:08.896046+0000","last_fullsized":"2023-10-16T19:41:08.896046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654796+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:10.654796+0000","last_peered":"2023-10-16T19:41:10.654796+0000","last_clean":"2023-10-16T19:41:10.654796+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:10.654796+0000","last_undegraded":"2023-10-16T19:41:10.654796+0000","last_fullsized":"2023-10-16T19:41:10.654796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896009+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:08.896009+0000","last_peered":"2023-10-16T19:41:08.896009+0000","last_clean":"2023-10-16T19:41:08.896009+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:08.896009+0000","last_undegraded":"2023-10-16T19:41:08.896009+0000","last_fullsized":"2023-10-16T19:41:08.896009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918354+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:09.918354+0000","last_peered":"2023-10-16T19:41:09.918354+0000","last_clean":"2023-10-16T19:41:09.918354+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:09.918354+0000","last_undegraded":"2023-10-16T19:41:09.918354+0000","last_fullsized":"2023-10-16T19:41:09.918354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:41.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918919+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:09.918919+0000","last_peered":"2023-10-16T19:41:09.918919+0000","last_clean":"2023-10-16T19:41:09.918919+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:09.918919+0000","last_undegraded":"2023-10-16T19:41:09.918919+0000","last_fullsized":"2023-10-16T19:41:09.918919+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754755+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:08.754755+0000","last_peered":"2023-10-16T19:41:08.754755+0000","last_clean":"2023-10-16T19:41:08.754755+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:08.754755+0000","last_undegraded":"2023-10-16T19:41:08.754755+0000","last_fullsized":"2023-10-16T19:41:08.754755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:32.423085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646439+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:10.646439+0000","last_peered":"2023-10-16T19:41:10.646439+0000","last_clean":"2023-10-16T19:41:10.646439+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:10.646439+0000","last_undegraded":"2023-10-16T19:41:10.646439+0000","last_fullsized":"2023-10-16T19:41:10.646439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753844+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:08.753844+0000","last_peered":"2023-10-16T19:41:08.753844+0000","last_clean":"2023-10-16T19:41:08.753844+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:08.753844+0000","last_undegraded":"2023-10-16T19:41:08.753844+0000","last_fullsized":"2023-10-16T19:41:08.753844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:52:59.735713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896305+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:08.896305+0000","last_peered":"2023-10-16T19:41:08.896305+0000","last_clean":"2023-10-16T19:41:08.896305+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:08.896305+0000","last_undegraded":"2023-10-16T19:41:08.896305+0000","last_fullsized":"2023-10-16T19:41:08.896305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654759+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:10.654759+0000","last_peered":"2023-10-16T19:41:10.654759+0000","last_clean":"2023-10-16T19:41:10.654759+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:10.654759+0000","last_undegraded":"2023-10-16T19:41:10.654759+0000","last_fullsized":"2023-10-16T19:41:10.654759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918592+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:09.918592+0000","last_peered":"2023-10-16T19:41:09.918592+0000","last_clean":"2023-10-16T19:41:09.918592+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:09.918592+0000","last_undegraded":"2023-10-16T19:41:09.918592+0000","last_fullsized":"2023-10-16T19:41:09.918592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:03.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646342+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:10.646342+0000","last_peered":"2023-10-16T19:41:10.646342+0000","last_clean":"2023-10-16T19:41:10.646342+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:10.646342+0000","last_undegraded":"2023-10-16T19:41:10.646342+0000","last_fullsized":"2023-10-16T19:41:10.646342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754797+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:08.754797+0000","last_peered":"2023-10-16T19:41:08.754797+0000","last_clean":"2023-10-16T19:41:08.754797+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:08.754797+0000","last_undegraded":"2023-10-16T19:41:08.754797+0000","last_fullsized":"2023-10-16T19:41:08.754797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:47:45.721064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648931+0000","last_change":"2023-10-16T19:41:07.766562+0000","last_active":"2023-10-16T19:41:10.648931+0000","last_peered":"2023-10-16T19:41:10.648931+0000","last_clean":"2023-10-16T19:41:10.648931+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:10.648931+0000","last_undegraded":"2023-10-16T19:41:10.648931+0000","last_fullsized":"2023-10-16T19:41:10.648931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754681+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:08.754681+0000","last_peered":"2023-10-16T19:41:08.754681+0000","last_clean":"2023-10-16T19:41:08.754681+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:08.754681+0000","last_undegraded":"2023-10-16T19:41:08.754681+0000","last_fullsized":"2023-10-16T19:41:08.754681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:19.682780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896435+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:08.896435+0000","last_peered":"2023-10-16T19:41:08.896435+0000","last_clean":"2023-10-16T19:41:08.896435+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:08.896435+0000","last_undegraded":"2023-10-16T19:41:08.896435+0000","last_fullsized":"2023-10-16T19:41:08.896435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:13.279493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753816+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:08.753816+0000","last_peered":"2023-10-16T19:41:08.753816+0000","last_clean":"2023-10-16T19:41:08.753816+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:08.753816+0000","last_undegraded":"2023-10-16T19:41:08.753816+0000","last_fullsized":"2023-10-16T19:41:08.753816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:56:43.167457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754113+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:08.754113+0000","last_peered":"2023-10-16T19:41:08.754113+0000","last_clean":"2023-10-16T19:41:08.754113+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:08.754113+0000","last_undegraded":"2023-10-16T19:41:08.754113+0000","last_fullsized":"2023-10-16T19:41:08.754113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:12.290715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918548+0000","last_change":"2023-10-16T19:41:07.773939+0000","last_active":"2023-10-16T19:41:09.918548+0000","last_peered":"2023-10-16T19:41:09.918548+0000","last_clean":"2023-10-16T19:41:09.918548+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:09.918548+0000","last_undegraded":"2023-10-16T19:41:09.918548+0000","last_fullsized":"2023-10-16T19:41:09.918548+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:26.358128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648814+0000","last_change":"2023-10-16T19:41:07.764351+0000","last_active":"2023-10-16T19:41:10.648814+0000","last_peered":"2023-10-16T19:41:10.648814+0000","last_clean":"2023-10-16T19:41:10.648814+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:10.648814+0000","last_undegraded":"2023-10-16T19:41:10.648814+0000","last_fullsized":"2023-10-16T19:41:10.648814+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918737+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:09.918737+0000","last_peered":"2023-10-16T19:41:09.918737+0000","last_clean":"2023-10-16T19:41:09.918737+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:09.918737+0000","last_undegraded":"2023-10-16T19:41:09.918737+0000","last_fullsized":"2023-10-16T19:41:09.918737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754833+0000","last_change":"2023-10-16T19:41:06.755348+0000","last_active":"2023-10-16T19:41:08.754833+0000","last_peered":"2023-10-16T19:41:08.754833+0000","last_clean":"2023-10-16T19:41:08.754833+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:08.754833+0000","last_undegraded":"2023-10-16T19:41:08.754833+0000","last_fullsized":"2023-10-16T19:41:08.754833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:42:03.964189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648904+0000","last_change":"2023-10-16T19:41:07.770268+0000","last_active":"2023-10-16T19:41:10.648904+0000","last_peered":"2023-10-16T19:41:10.648904+0000","last_clean":"2023-10-16T19:41:10.648904+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:10.648904+0000","last_undegraded":"2023-10-16T19:41:10.648904+0000","last_fullsized":"2023-10-16T19:41:10.648904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646652+0000","last_change":"2023-10-16T19:41:06.757890+0000","last_active":"2023-10-16T19:41:10.646652+0000","last_peered":"2023-10-16T19:41:10.646652+0000","last_clean":"2023-10-16T19:41:10.646652+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:10.646652+0000","last_undegraded":"2023-10-16T19:41:10.646652+0000","last_fullsized":"2023-10-16T19:41:10.646652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654824+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:10.654824+0000","last_peered":"2023-10-16T19:41:10.654824+0000","last_clean":"2023-10-16T19:41:10.654824+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:10.654824+0000","last_undegraded":"2023-10-16T19:41:10.654824+0000","last_fullsized":"2023-10-16T19:41:10.654824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648916+0000","last_change":"2023-10-16T19:41:06.753133+0000","last_active":"2023-10-16T19:41:10.648916+0000","last_peered":"2023-10-16T19:41:10.648916+0000","last_clean":"2023-10-16T19:41:10.648916+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:10.648916+0000","last_undegraded":"2023-10-16T19:41:10.648916+0000","last_fullsized":"2023-10-16T19:41:10.648916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641736+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:10.641736+0000","last_peered":"2023-10-16T19:41:10.641736+0000","last_clean":"2023-10-16T19:41:10.641736+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:10.641736+0000","last_undegraded":"2023-10-16T19:41:10.641736+0000","last_fullsized":"2023-10-16T19:41:10.641736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654812+0000","last_change":"2023-10-16T19:41:06.755981+0000","last_active":"2023-10-16T19:41:10.654812+0000","last_peered":"2023-10-16T19:41:10.654812+0000","last_clean":"2023-10-16T19:41:10.654812+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:10.654812+0000","last_undegraded":"2023-10-16T19:41:10.654812+0000","last_fullsized":"2023-10-16T19:41:10.654812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646519+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:10.646519+0000","last_peered":"2023-10-16T19:41:10.646519+0000","last_clean":"2023-10-16T19:41:10.646519+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:10.646519+0000","last_undegraded":"2023-10-16T19:41:10.646519+0000","last_fullsized":"2023-10-16T19:41:10.646519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896210+0000","last_change":"2023-10-16T19:41:06.758286+0000","last_active":"2023-10-16T19:41:08.896210+0000","last_peered":"2023-10-16T19:41:08.896210+0000","last_clean":"2023-10-16T19:41:08.896210+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:08.896210+0000","last_undegraded":"2023-10-16T19:41:08.896210+0000","last_fullsized":"2023-10-16T19:41:08.896210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896179+0000","last_change":"2023-10-16T19:41:07.770309+0000","last_active":"2023-10-16T19:41:08.896179+0000","last_peered":"2023-10-16T19:41:08.896179+0000","last_clean":"2023-10-16T19:41:08.896179+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:08.896179+0000","last_undegraded":"2023-10-16T19:41:08.896179+0000","last_fullsized":"2023-10-16T19:41:08.896179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:18.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918542+0000","last_change":"2023-10-16T19:41:06.754411+0000","last_active":"2023-10-16T19:41:09.918542+0000","last_peered":"2023-10-16T19:41:09.918542+0000","last_clean":"2023-10-16T19:41:09.918542+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:09.918542+0000","last_undegraded":"2023-10-16T19:41:09.918542+0000","last_fullsized":"2023-10-16T19:41:09.918542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:12.124455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654772+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:10.654772+0000","last_peered":"2023-10-16T19:41:10.654772+0000","last_clean":"2023-10-16T19:41:10.654772+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:10.654772+0000","last_undegraded":"2023-10-16T19:41:10.654772+0000","last_fullsized":"2023-10-16T19:41:10.654772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:24.416749+0000","last_change":"2023-10-16T19:41:24.416785+0000","last_active":"2023-10-16T19:41:24.416749+0000","last_peered":"2023-10-16T19:41:24.416749+0000","last_clean":"2023-10-16T19:41:24.416749+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:24.416749+0000","last_undegraded":"2023-10-16T19:41:24.416749+0000","last_fullsized":"2023-10-16T19:41:24.416749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_clean_scrub_stamp":"2023-10-16T19:41:24.416675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:21.105171+0000","scrub_duration":0.001987988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641649+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:10.641649+0000","last_peered":"2023-10-16T19:41:10.641649+0000","last_clean":"2023-10-16T19:41:10.641649+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:10.641649+0000","last_undegraded":"2023-10-16T19:41:10.641649+0000","last_fullsized":"2023-10-16T19:41:10.641649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654698+0000","last_change":"2023-10-16T19:41:06.749580+0000","last_active":"2023-10-16T19:41:10.654698+0000","last_peered":"2023-10-16T19:41:10.654698+0000","last_clean":"2023-10-16T19:41:10.654698+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:10.654698+0000","last_undegraded":"2023-10-16T19:41:10.654698+0000","last_fullsized":"2023-10-16T19:41:10.654698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646425+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:10.646425+0000","last_peered":"2023-10-16T19:41:10.646425+0000","last_clean":"2023-10-16T19:41:10.646425+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:10.646425+0000","last_undegraded":"2023-10-16T19:41:10.646425+0000","last_fullsized":"2023-10-16T19:41:10.646425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641747+0000","last_change":"2023-10-16T19:41:06.750392+0000","last_active":"2023-10-16T19:41:10.641747+0000","last_peered":"2023-10-16T19:41:10.641747+0000","last_clean":"2023-10-16T19:41:10.641747+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:10.641747+0000","last_undegraded":"2023-10-16T19:41:10.641747+0000","last_fullsized":"2023-10-16T19:41:10.641747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918908+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:09.918908+0000","last_peered":"2023-10-16T19:41:09.918908+0000","last_clean":"2023-10-16T19:41:09.918908+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:09.918908+0000","last_undegraded":"2023-10-16T19:41:09.918908+0000","last_fullsized":"2023-10-16T19:41:09.918908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:55.101401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896493+0000","last_change":"2023-10-16T19:41:06.756400+0000","last_active":"2023-10-16T19:41:08.896493+0000","last_peered":"2023-10-16T19:41:08.896493+0000","last_clean":"2023-10-16T19:41:08.896493+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:08.896493+0000","last_undegraded":"2023-10-16T19:41:08.896493+0000","last_fullsized":"2023-10-16T19:41:08.896493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:40.785353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646636+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:10.646636+0000","last_peered":"2023-10-16T19:41:10.646636+0000","last_clean":"2023-10-16T19:41:10.646636+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:10.646636+0000","last_undegraded":"2023-10-16T19:41:10.646636+0000","last_fullsized":"2023-10-16T19:41:10.646636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896580+0000","last_change":"2023-10-16T19:41:06.754114+0000","last_active":"2023-10-16T19:41:08.896580+0000","last_peered":"2023-10-16T19:41:08.896580+0000","last_clean":"2023-10-16T19:41:08.896580+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:08.896580+0000","last_undegraded":"2023-10-16T19:41:08.896580+0000","last_fullsized":"2023-10-16T19:41:08.896580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:56:22.222771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654867+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:10.654867+0000","last_peered":"2023-10-16T19:41:10.654867+0000","last_clean":"2023-10-16T19:41:10.654867+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:10.654867+0000","last_undegraded":"2023-10-16T19:41:10.654867+0000","last_fullsized":"2023-10-16T19:41:10.654867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641687+0000","last_change":"2023-10-16T19:41:06.754537+0000","last_active":"2023-10-16T19:41:10.641687+0000","last_peered":"2023-10-16T19:41:10.641687+0000","last_clean":"2023-10-16T19:41:10.641687+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:10.641687+0000","last_undegraded":"2023-10-16T19:41:10.641687+0000","last_fullsized":"2023-10-16T19:41:10.641687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646491+0000","last_change":"2023-10-16T19:41:07.765532+0000","last_active":"2023-10-16T19:41:10.646491+0000","last_peered":"2023-10-16T19:41:10.646491+0000","last_clean":"2023-10-16T19:41:10.646491+0000","last_became_active":"2023-10-16T19:41:07.765202+0000","last_became_peered":"2023-10-16T19:41:07.765202+0000","last_unstale":"2023-10-16T19:41:10.646491+0000","last_undegraded":"2023-10-16T19:41:10.646491+0000","last_fullsized":"2023-10-16T19:41:10.646491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641662+0000","last_change":"2023-10-16T19:41:06.752862+0000","last_active":"2023-10-16T19:41:10.641662+0000","last_peered":"2023-10-16T19:41:10.641662+0000","last_clean":"2023-10-16T19:41:10.641662+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:10.641662+0000","last_undegraded":"2023-10-16T19:41:10.641662+0000","last_fullsized":"2023-10-16T19:41:10.641662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641618+0000","last_change":"2023-10-16T19:41:07.753707+0000","last_active":"2023-10-16T19:41:10.641618+0000","last_peered":"2023-10-16T19:41:10.641618+0000","last_clean":"2023-10-16T19:41:10.641618+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:10.641618+0000","last_undegraded":"2023-10-16T19:41:10.641618+0000","last_fullsized":"2023-10-16T19:41:10.641618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648869+0000","last_change":"2023-10-16T19:41:06.754131+0000","last_active":"2023-10-16T19:41:10.648869+0000","last_peered":"2023-10-16T19:41:10.648869+0000","last_clean":"2023-10-16T19:41:10.648869+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:10.648869+0000","last_undegraded":"2023-10-16T19:41:10.648869+0000","last_fullsized":"2023-10-16T19:41:10.648869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918675+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:09.918675+0000","last_peered":"2023-10-16T19:41:09.918675+0000","last_clean":"2023-10-16T19:41:09.918675+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:09.918675+0000","last_undegraded":"2023-10-16T19:41:09.918675+0000","last_fullsized":"2023-10-16T19:41:09.918675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:44.246775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.754047+0000","last_change":"2023-10-16T19:41:06.755395+0000","last_active":"2023-10-16T19:41:08.754047+0000","last_peered":"2023-10-16T19:41:08.754047+0000","last_clean":"2023-10-16T19:41:08.754047+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:08.754047+0000","last_undegraded":"2023-10-16T19:41:08.754047+0000","last_fullsized":"2023-10-16T19:41:08.754047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:15:03.099464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641629+0000","last_change":"2023-10-16T19:41:07.754666+0000","last_active":"2023-10-16T19:41:10.641629+0000","last_peered":"2023-10-16T19:41:10.641629+0000","last_clean":"2023-10-16T19:41:10.641629+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:10.641629+0000","last_undegraded":"2023-10-16T19:41:10.641629+0000","last_fullsized":"2023-10-16T19:41:10.641629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918496+0000","last_change":"2023-10-16T19:41:06.748778+0000","last_active":"2023-10-16T19:41:09.918496+0000","last_peered":"2023-10-16T19:41:09.918496+0000","last_clean":"2023-10-16T19:41:09.918496+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:09.918496+0000","last_undegraded":"2023-10-16T19:41:09.918496+0000","last_fullsized":"2023-10-16T19:41:09.918496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:22.505416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641674+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:10.641674+0000","last_peered":"2023-10-16T19:41:10.641674+0000","last_clean":"2023-10-16T19:41:10.641674+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:10.641674+0000","last_undegraded":"2023-10-16T19:41:10.641674+0000","last_fullsized":"2023-10-16T19:41:10.641674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896643+0000","last_change":"2023-10-16T19:41:06.755011+0000","last_active":"2023-10-16T19:41:08.896643+0000","last_peered":"2023-10-16T19:41:08.896643+0000","last_clean":"2023-10-16T19:41:08.896643+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:08.896643+0000","last_undegraded":"2023-10-16T19:41:08.896643+0000","last_fullsized":"2023-10-16T19:41:08.896643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:13:25.353317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896559+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:08.896559+0000","last_peered":"2023-10-16T19:41:08.896559+0000","last_clean":"2023-10-16T19:41:08.896559+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:08.896559+0000","last_undegraded":"2023-10-16T19:41:08.896559+0000","last_fullsized":"2023-10-16T19:41:08.896559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:30.904992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654837+0000","last_change":"2023-10-16T19:41:06.756255+0000","last_active":"2023-10-16T19:41:10.654837+0000","last_peered":"2023-10-16T19:41:10.654837+0000","last_clean":"2023-10-16T19:41:10.654837+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:10.654837+0000","last_undegraded":"2023-10-16T19:41:10.654837+0000","last_fullsized":"2023-10-16T19:41:10.654837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654848+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:10.654848+0000","last_peered":"2023-10-16T19:41:10.654848+0000","last_clean":"2023-10-16T19:41:10.654848+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:10.654848+0000","last_undegraded":"2023-10-16T19:41:10.654848+0000","last_fullsized":"2023-10-16T19:41:10.654848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646449+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:10.646449+0000","last_peered":"2023-10-16T19:41:10.646449+0000","last_clean":"2023-10-16T19:41:10.646449+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:10.646449+0000","last_undegraded":"2023-10-16T19:41:10.646449+0000","last_fullsized":"2023-10-16T19:41:10.646449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646486+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:10.646486+0000","last_peered":"2023-10-16T19:41:10.646486+0000","last_clean":"2023-10-16T19:41:10.646486+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:10.646486+0000","last_undegraded":"2023-10-16T19:41:10.646486+0000","last_fullsized":"2023-10-16T19:41:10.646486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648893+0000","last_change":"2023-10-16T19:41:06.751838+0000","last_active":"2023-10-16T19:41:10.648893+0000","last_peered":"2023-10-16T19:41:10.648893+0000","last_clean":"2023-10-16T19:41:10.648893+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:10.648893+0000","last_undegraded":"2023-10-16T19:41:10.648893+0000","last_fullsized":"2023-10-16T19:41:10.648893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918491+0000","last_change":"2023-10-16T19:41:07.773507+0000","last_active":"2023-10-16T19:41:09.918491+0000","last_peered":"2023-10-16T19:41:09.918491+0000","last_clean":"2023-10-16T19:41:09.918491+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:09.918491+0000","last_undegraded":"2023-10-16T19:41:09.918491+0000","last_fullsized":"2023-10-16T19:41:09.918491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:07.784660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646403+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:10.646403+0000","last_peered":"2023-10-16T19:41:10.646403+0000","last_clean":"2023-10-16T19:41:10.646403+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:10.646403+0000","last_undegraded":"2023-10-16T19:41:10.646403+0000","last_fullsized":"2023-10-16T19:41:10.646403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646531+0000","last_change":"2023-10-16T19:41:07.758127+0000","last_active":"2023-10-16T19:41:10.646531+0000","last_peered":"2023-10-16T19:41:10.646531+0000","last_clean":"2023-10-16T19:41:10.646531+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:10.646531+0000","last_undegraded":"2023-10-16T19:41:10.646531+0000","last_fullsized":"2023-10-16T19:41:10.646531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646372+0000","last_change":"2023-10-16T19:41:06.756875+0000","last_active":"2023-10-16T19:41:10.646372+0000","last_peered":"2023-10-16T19:41:10.646372+0000","last_clean":"2023-10-16T19:41:10.646372+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:10.646372+0000","last_undegraded":"2023-10-16T19:41:10.646372+0000","last_fullsized":"2023-10-16T19:41:10.646372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896190+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:08.896190+0000","last_peered":"2023-10-16T19:41:08.896190+0000","last_clean":"2023-10-16T19:41:08.896190+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:08.896190+0000","last_undegraded":"2023-10-16T19:41:08.896190+0000","last_fullsized":"2023-10-16T19:41:08.896190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:17.488957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918695+0000","last_change":"2023-10-16T19:41:06.754497+0000","last_active":"2023-10-16T19:41:09.918695+0000","last_peered":"2023-10-16T19:41:09.918695+0000","last_clean":"2023-10-16T19:41:09.918695+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:09.918695+0000","last_undegraded":"2023-10-16T19:41:09.918695+0000","last_fullsized":"2023-10-16T19:41:09.918695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:59.730622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641638+0000","last_change":"2023-10-16T19:41:07.759687+0000","last_active":"2023-10-16T19:41:10.641638+0000","last_peered":"2023-10-16T19:41:10.641638+0000","last_clean":"2023-10-16T19:41:10.641638+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:10.641638+0000","last_undegraded":"2023-10-16T19:41:10.641638+0000","last_fullsized":"2023-10-16T19:41:10.641638+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646358+0000","last_change":"2023-10-16T19:41:06.751471+0000","last_active":"2023-10-16T19:41:10.646358+0000","last_peered":"2023-10-16T19:41:10.646358+0000","last_clean":"2023-10-16T19:41:10.646358+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:10.646358+0000","last_undegraded":"2023-10-16T19:41:10.646358+0000","last_fullsized":"2023-10-16T19:41:10.646358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648880+0000","last_change":"2023-10-16T19:41:07.766289+0000","last_active":"2023-10-16T19:41:10.648880+0000","last_peered":"2023-10-16T19:41:10.648880+0000","last_clean":"2023-10-16T19:41:10.648880+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:10.648880+0000","last_undegraded":"2023-10-16T19:41:10.648880+0000","last_fullsized":"2023-10-16T19:41:10.648880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896628+0000","last_change":"2023-10-16T19:41:06.753658+0000","last_active":"2023-10-16T19:41:08.896628+0000","last_peered":"2023-10-16T19:41:08.896628+0000","last_clean":"2023-10-16T19:41:08.896628+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:08.896628+0000","last_undegraded":"2023-10-16T19:41:08.896628+0000","last_fullsized":"2023-10-16T19:41:08.896628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:06.779848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918995+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:09.918995+0000","last_peered":"2023-10-16T19:41:09.918995+0000","last_clean":"2023-10-16T19:41:09.918995+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:09.918995+0000","last_undegraded":"2023-10-16T19:41:09.918995+0000","last_fullsized":"2023-10-16T19:41:09.918995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:08.720648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646463+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:10.646463+0000","last_peered":"2023-10-16T19:41:10.646463+0000","last_clean":"2023-10-16T19:41:10.646463+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:10.646463+0000","last_undegraded":"2023-10-16T19:41:10.646463+0000","last_fullsized":"2023-10-16T19:41:10.646463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641715+0000","last_change":"2023-10-16T19:41:07.752580+0000","last_active":"2023-10-16T19:41:10.641715+0000","last_peered":"2023-10-16T19:41:10.641715+0000","last_clean":"2023-10-16T19:41:10.641715+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:10.641715+0000","last_undegraded":"2023-10-16T19:41:10.641715+0000","last_fullsized":"2023-10-16T19:41:10.641715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646614+0000","last_change":"2023-10-16T19:41:06.750771+0000","last_active":"2023-10-16T19:41:10.646614+0000","last_peered":"2023-10-16T19:41:10.646614+0000","last_clean":"2023-10-16T19:41:10.646614+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:10.646614+0000","last_undegraded":"2023-10-16T19:41:10.646614+0000","last_fullsized":"2023-10-16T19:41:10.646614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646508+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:10.646508+0000","last_peered":"2023-10-16T19:41:10.646508+0000","last_clean":"2023-10-16T19:41:10.646508+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:10.646508+0000","last_undegraded":"2023-10-16T19:41:10.646508+0000","last_fullsized":"2023-10-16T19:41:10.646508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.646546+0000","last_change":"2023-10-16T19:41:06.749894+0000","last_active":"2023-10-16T19:41:10.646546+0000","last_peered":"2023-10-16T19:41:10.646546+0000","last_clean":"2023-10-16T19:41:10.646546+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:10.646546+0000","last_undegraded":"2023-10-16T19:41:10.646546+0000","last_fullsized":"2023-10-16T19:41:10.646546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.648834+0000","last_change":"2023-10-16T19:41:07.758405+0000","last_active":"2023-10-16T19:41:10.648834+0000","last_peered":"2023-10-16T19:41:10.648834+0000","last_clean":"2023-10-16T19:41:10.648834+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:10.648834+0000","last_undegraded":"2023-10-16T19:41:10.648834+0000","last_fullsized":"2023-10-16T19:41:10.648834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.753581+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:08.753581+0000","last_peered":"2023-10-16T19:41:08.753581+0000","last_clean":"2023-10-16T19:41:08.753581+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:08.753581+0000","last_undegraded":"2023-10-16T19:41:08.753581+0000","last_fullsized":"2023-10-16T19:41:08.753581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:57.284334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654783+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:10.654783+0000","last_peered":"2023-10-16T19:41:10.654783+0000","last_clean":"2023-10-16T19:41:10.654783+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:10.654783+0000","last_undegraded":"2023-10-16T19:41:10.654783+0000","last_fullsized":"2023-10-16T19:41:10.654783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.654735+0000","last_change":"2023-10-16T19:41:06.757704+0000","last_active":"2023-10-16T19:41:10.654735+0000","last_peered":"2023-10-16T19:41:10.654735+0000","last_clean":"2023-10-16T19:41:10.654735+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:10.654735+0000","last_undegraded":"2023-10-16T19:41:10.654735+0000","last_fullsized":"2023-10-16T19:41:10.654735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.919178+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:09.919178+0000","last_peered":"2023-10-16T19:41:09.919178+0000","last_clean":"2023-10-16T19:41:09.919178+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:09.919178+0000","last_undegraded":"2023-10-16T19:41:09.919178+0000","last_fullsized":"2023-10-16T19:41:09.919178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:18.675273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:10.641608+0000","last_change":"2023-10-16T19:41:06.750843+0000","last_active":"2023-10-16T19:41:10.641608+0000","last_peered":"2023-10-16T19:41:10.641608+0000","last_clean":"2023-10-16T19:41:10.641608+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:10.641608+0000","last_undegraded":"2023-10-16T19:41:10.641608+0000","last_fullsized":"2023-10-16T19:41:10.641608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:08.896568+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:08.896568+0000","last_peered":"2023-10-16T19:41:08.896568+0000","last_clean":"2023-10-16T19:41:08.896568+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:08.896568+0000","last_undegraded":"2023-10-16T19:41:08.896568+0000","last_fullsized":"2023-10-16T19:41:08.896568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:00:59.888548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T19:41:09.918834+0000","last_change":"2023-10-16T19:41:06.758476+0000","last_active":"2023-10-16T19:41:09.918834+0000","last_peered":"2023-10-16T19:41:09.918834+0000","last_clean":"2023-10-16T19:41:09.918834+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:09.918834+0000","last_undegraded":"2023-10-16T19:41:09.918834+0000","last_fullsized":"2023-10-16T19:41:09.918834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:18.677968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T19:41:07.747984+0000","last_change":"2023-10-16T19:39:48.282885+0000","last_active":"2023-10-16T19:41:07.747984+0000","last_peered":"2023-10-16T19:41:07.747984+0000","last_clean":"2023-10-16T19:41:07.747984+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:07.747984+0000","last_undegraded":"2023-10-16T19:41:07.747984+0000","last_fullsized":"2023-10-16T19:41:07.747984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:39:46.914496+0000","last_clean_scrub_stamp":"2023-10-16T19:39:46.914496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:01:53.833185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":791604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.65600000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":200136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.375},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59599999999999997}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.497},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":199644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.26900000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.44},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.628}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.747}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.373}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.27600000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68000000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.313},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.32800000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":201200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.316},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61799999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.754}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:27.194 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.195 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.195 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.196 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.196 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.196 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.197 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.197 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.197 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.198 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.198 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.198 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.199 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.199 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.199 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.200 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.200 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.200 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.201 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.201 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.202 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.202 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.202 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.203 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.203 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.203 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.204 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.204 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.204 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.205 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.205 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.205 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.206 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.206 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.206 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.207 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.207 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.207 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.208 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.208 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.209 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.209 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.209 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.210 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.210 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.210 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.211 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.211 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.212 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.212 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.212 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.213 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.213 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.213 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.214 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.214 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.214 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.215 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.215 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.215 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.216 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.216 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.216 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.217 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.217 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.218 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.218 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.218 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.219 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.219 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.219 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.220 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.220 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.220 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.221 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.221 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.222 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.222 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.222 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.223 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.223 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.223 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.224 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.224 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.224 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.225 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.225 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.225 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.226 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.226 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.226 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.227 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.227 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.228 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.228 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.228 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T19:39:46.914496+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=39, tm_sec=46, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:27.229 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:41:27.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:27.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:47.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:41:47.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.369+0000 7f336284b700 1 Processor -- start 2023-10-16T19:41:47.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.369+0000 7f336284b700 1 -- start start 2023-10-16T19:41:47.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f336284b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f335c0c6850 0x7f335c0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:47.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f336284b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c155360 con 0x7f335c152520 2023-10-16T19:41:47.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f336284b700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c155640 con 0x7f335c154df0 2023-10-16T19:41:47.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f336284b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c070880 con 0x7f335c0c6850 2023-10-16T19:41:47.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f335c0c6850 0x7f335c0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:47.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f3360de8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f335c152520 0x7f335c15c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39528/0 (socket says 172.21.15.29:39528) 2023-10-16T19:41:47.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f335c0c6850 0x7f335c0a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54080/0 (socket says 172.21.15.29:54080) 2023-10-16T19:41:47.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f3360de8700 1 -- 172.21.15.29:0/440728059 learned_addr learned my addr 172.21.15.29:0/440728059 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:41:47.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335bfff700 1 -- 172.21.15.29:0/440728059 >> v1:172.21.15.53:6789/0 conn(0x7f335c154df0 legacy=0x7f335c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:41:47.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335bfff700 1 -- 172.21.15.29:0/440728059 >> v1:172.21.15.29:6789/0 conn(0x7f335c152520 legacy=0x7f335c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335bfff700 1 -- 172.21.15.29:0/440728059 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c155920 con 0x7f335c0c6850 2023-10-16T19:41:47.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.370+0000 7f335affd700 1 -- 172.21.15.29:0/440728059 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202032648 0 0) 0x7f335c155360 con 0x7f335c152520 2023-10-16T19:41:47.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f335bfff700 1 --2- 172.21.15.29:0/440728059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c0a4ea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f91f33acfcc0a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:47.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f335affd700 1 -- 172.21.15.29:0/440728059 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c005e30 con 0x7f335c0c6850 2023-10-16T19:41:47.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f335affd700 1 -- 172.21.15.29:0/440728059 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c004030 con 0x7f335c0c6850 2023-10-16T19:41:47.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f335affd700 1 -- 172.21.15.29:0/440728059 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0043c0 con 0x7f335c0c6850 2023-10-16T19:41:47.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f336284b700 1 -- 172.21.15.29:0/440728059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 msgr2=0x7f335c0a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f336284b700 1 --2- 172.21.15.29:0/440728059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c0a4ea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c009b30 comp rx=0 tx=0).stop 2023-10-16T19:41:47.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f336284b700 1 -- 172.21.15.29:0/440728059 shutdown_connections 2023-10-16T19:41:47.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f336284b700 1 --2- 172.21.15.29:0/440728059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c0a4ea0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.371+0000 7f336284b700 1 -- 172.21.15.29:0/440728059 >> 172.21.15.29:0/440728059 conn(0x7f335c0a8070 msgr2=0x7f335c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:47.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.372+0000 7f336284b700 1 -- 172.21.15.29:0/440728059 shutdown_connections 2023-10-16T19:41:47.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.372+0000 7f336284b700 1 -- 172.21.15.29:0/440728059 wait complete. 2023-10-16T19:41:47.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.373+0000 7f336284b700 1 Processor -- start 2023-10-16T19:41:47.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.373+0000 7f336284b700 1 -- start start 2023-10-16T19:41:47.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:47.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 0x7f335c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:47.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 0x7f335c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:47.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1519f0 con 0x7f335c0c6850 2023-10-16T19:41:47.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b4440 con 0x7f335c152520 2023-10-16T19:41:47.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f336284b700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b52c0 con 0x7f335c154df0 2023-10-16T19:41:47.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:47.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54086/0 (socket says 172.21.15.29:54086) 2023-10-16T19:41:47.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 -- 172.21.15.29:0/2077065207 learned_addr learned my addr 172.21.15.29:0/2077065207 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:41:47.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f3360de8700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 0x7f335c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:47.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335b7fe700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 0x7f335c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:47.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 -- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 msgr2=0x7f335c153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 0x7f335c153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 -- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 msgr2=0x7f335c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 0x7f335c1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 -- 172.21.15.29:0/2077065207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009430 con 0x7f335c0c6850 2023-10-16T19:41:47.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335b7fe700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 0x7f335c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:47.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f3360de8700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 0x7f335c153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:41:47.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.374+0000 7f335bfff700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f335c06e850 tx=0x7f334c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:47.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.375+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c011420 con 0x7f335c0c6850 2023-10-16T19:41:47.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.375+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c011580 con 0x7f335c0c6850 2023-10-16T19:41:47.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.375+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c14dd40 con 0x7f335c0c6850 2023-10-16T19:41:47.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.375+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c011930 con 0x7f335c0c6850 2023-10-16T19:41:47.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.375+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c0b4f50 con 0x7f335c0c6850 2023-10-16T19:41:47.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.376+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c0b5110 con 0x7f335c0c6850 2023-10-16T19:41:47.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.376+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f334c018030 con 0x7f335c0c6850 2023-10-16T19:41:47.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.376+0000 7f3358ff9700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 0x7f334806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:41:47.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.377+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f334c08ad40 con 0x7f335c0c6850 2023-10-16T19:41:47.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.377+0000 7f335b7fe700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 0x7f334806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:41:47.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.377+0000 7f335b7fe700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 0x7f334806d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:41:47.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.381+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f334c055e30 con 0x7f335c0c6850 2023-10-16T19:41:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.578+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f335c155c00 con 0x7f334806af30 2023-10-16T19:41:47.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.587+0000 7f3358ff9700 1 -- 172.21.15.29:0/2077065207 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288194 (secure 0 0 0) 0x7f335000ad30 con 0x7f334806af30 2023-10-16T19:41:47.593 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:41:47.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 msgr2=0x7f334806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 0x7f334806d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350008040 comp rx=0 tx=0).stop 2023-10-16T19:41:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 msgr2=0x7f335c14fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:41:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f335c06e850 tx=0x7f334c004750 comp rx=0 tx=0).stop 2023-10-16T19:41:47.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 shutdown_connections 2023-10-16T19:41:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f334806af30 0x7f334806d3f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f335c154df0 0x7f335c153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f335c0c6850 0x7f335c14fb70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 --2- 172.21.15.29:0/2077065207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335c152520 0x7f335c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:41:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 >> 172.21.15.29:0/2077065207 conn(0x7f335c0a8070 msgr2=0x7f335c0b8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:41:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 shutdown_connections 2023-10-16T19:41:47.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:41:47.590+0000 7f336284b700 1 -- 172.21.15.29:0/2077065207 wait complete. 2023-10-16T19:41:47.599 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:41:47.604 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-10-16T19:41:46.585093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221196,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753524,"statfs":{"total":773094113280,"available":772867608576,"internally_reserved":0,"allocated":5152768,"data_stored":2882964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001641"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689733+0000","last_change":"2023-10-16T19:41:07.755342+0000","last_active":"2023-10-16T19:41:40.689733+0000","last_peered":"2023-10-16T19:41:40.689733+0000","last_clean":"2023-10-16T19:41:40.689733+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:40.689733+0000","last_undegraded":"2023-10-16T19:41:40.689733+0000","last_fullsized":"2023-10-16T19:41:40.689733+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689621+0000","last_change":"2023-10-16T19:41:37.432770+0000","last_active":"2023-10-16T19:41:40.689621+0000","last_peered":"2023-10-16T19:41:40.689621+0000","last_clean":"2023-10-16T19:41:40.689621+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:40.689621+0000","last_undegraded":"2023-10-16T19:41:40.689621+0000","last_fullsized":"2023-10-16T19:41:40.689621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.432607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:45:58.851261+0000","scrub_duration":0.001589827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203196+0000","last_change":"2023-10-16T19:41:07.770722+0000","last_active":"2023-10-16T19:41:41.203196+0000","last_peered":"2023-10-16T19:41:41.203196+0000","last_clean":"2023-10-16T19:41:41.203196+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:41.203196+0000","last_undegraded":"2023-10-16T19:41:41.203196+0000","last_fullsized":"2023-10-16T19:41:41.203196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204530+0000","last_change":"2023-10-16T19:41:07.761957+0000","last_active":"2023-10-16T19:41:41.204530+0000","last_peered":"2023-10-16T19:41:41.204530+0000","last_clean":"2023-10-16T19:41:41.204530+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:41.204530+0000","last_undegraded":"2023-10-16T19:41:41.204530+0000","last_fullsized":"2023-10-16T19:41:41.204530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204187+0000","last_change":"2023-10-16T19:41:07.759204+0000","last_active":"2023-10-16T19:41:41.204187+0000","last_peered":"2023-10-16T19:41:41.204187+0000","last_clean":"2023-10-16T19:41:41.204187+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:41:41.204187+0000","last_undegraded":"2023-10-16T19:41:41.204187+0000","last_fullsized":"2023-10-16T19:41:41.204187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203483+0000","last_change":"2023-10-16T19:41:07.763277+0000","last_active":"2023-10-16T19:41:41.203483+0000","last_peered":"2023-10-16T19:41:41.203483+0000","last_clean":"2023-10-16T19:41:41.203483+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:41.203483+0000","last_undegraded":"2023-10-16T19:41:41.203483+0000","last_fullsized":"2023-10-16T19:41:41.203483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:42.819585+0000","last_change":"2023-10-16T19:41:42.819641+0000","last_active":"2023-10-16T19:41:42.819585+0000","last_peered":"2023-10-16T19:41:42.819585+0000","last_clean":"2023-10-16T19:41:42.819585+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:42.819585+0000","last_undegraded":"2023-10-16T19:41:42.819585+0000","last_fullsized":"2023-10-16T19:41:42.819585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_clean_scrub_stamp":"2023-10-16T19:41:42.819483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:25:02.979210+0000","scrub_duration":0.0019850570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.688960+0000","last_change":"2023-10-16T19:41:33.469584+0000","last_active":"2023-10-16T19:41:40.688960+0000","last_peered":"2023-10-16T19:41:40.688960+0000","last_clean":"2023-10-16T19:41:40.688960+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:40.688960+0000","last_undegraded":"2023-10-16T19:41:40.688960+0000","last_fullsized":"2023-10-16T19:41:40.688960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.469436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:53.629164+0000","scrub_duration":0.001807835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203491+0000","last_change":"2023-10-16T19:41:40.998502+0000","last_active":"2023-10-16T19:41:41.203491+0000","last_peered":"2023-10-16T19:41:41.203491+0000","last_clean":"2023-10-16T19:41:41.203491+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:41.203491+0000","last_undegraded":"2023-10-16T19:41:41.203491+0000","last_fullsized":"2023-10-16T19:41:41.203491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.998308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:36.817186+0000","scrub_duration":0.002136102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203635+0000","last_change":"2023-10-16T19:41:07.765522+0000","last_active":"2023-10-16T19:41:41.203635+0000","last_peered":"2023-10-16T19:41:41.203635+0000","last_clean":"2023-10-16T19:41:41.203635+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:41.203635+0000","last_undegraded":"2023-10-16T19:41:41.203635+0000","last_fullsized":"2023-10-16T19:41:41.203635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203674+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:41.203674+0000","last_peered":"2023-10-16T19:41:41.203674+0000","last_clean":"2023-10-16T19:41:41.203674+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:41.203674+0000","last_undegraded":"2023-10-16T19:41:41.203674+0000","last_fullsized":"2023-10-16T19:41:41.203674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203097+0000","last_change":"2023-10-16T19:41:07.764025+0000","last_active":"2023-10-16T19:41:41.203097+0000","last_peered":"2023-10-16T19:41:41.203097+0000","last_clean":"2023-10-16T19:41:41.203097+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:41.203097+0000","last_undegraded":"2023-10-16T19:41:41.203097+0000","last_fullsized":"2023-10-16T19:41:41.203097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203326+0000","last_change":"2023-10-16T19:41:07.766993+0000","last_active":"2023-10-16T19:41:41.203326+0000","last_peered":"2023-10-16T19:41:41.203326+0000","last_clean":"2023-10-16T19:41:41.203326+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:41.203326+0000","last_undegraded":"2023-10-16T19:41:41.203326+0000","last_fullsized":"2023-10-16T19:41:41.203326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850507+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:40.850507+0000","last_peered":"2023-10-16T19:41:40.850507+0000","last_clean":"2023-10-16T19:41:40.850507+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:40.850507+0000","last_undegraded":"2023-10-16T19:41:40.850507+0000","last_fullsized":"2023-10-16T19:41:40.850507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203117+0000","last_change":"2023-10-16T19:41:07.770568+0000","last_active":"2023-10-16T19:41:41.203117+0000","last_peered":"2023-10-16T19:41:41.203117+0000","last_clean":"2023-10-16T19:41:41.203117+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:41.203117+0000","last_undegraded":"2023-10-16T19:41:41.203117+0000","last_fullsized":"2023-10-16T19:41:41.203117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689093+0000","last_change":"2023-10-16T19:41:07.768135+0000","last_active":"2023-10-16T19:41:40.689093+0000","last_peered":"2023-10-16T19:41:40.689093+0000","last_clean":"2023-10-16T19:41:40.689093+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:41:40.689093+0000","last_undegraded":"2023-10-16T19:41:40.689093+0000","last_fullsized":"2023-10-16T19:41:40.689093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689798+0000","last_change":"2023-10-16T19:41:07.774005+0000","last_active":"2023-10-16T19:41:40.689798+0000","last_peered":"2023-10-16T19:41:40.689798+0000","last_clean":"2023-10-16T19:41:40.689798+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:40.689798+0000","last_undegraded":"2023-10-16T19:41:40.689798+0000","last_fullsized":"2023-10-16T19:41:40.689798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.690466+0000","last_change":"2023-10-16T19:41:07.751970+0000","last_active":"2023-10-16T19:41:40.690466+0000","last_peered":"2023-10-16T19:41:40.690466+0000","last_clean":"2023-10-16T19:41:40.690466+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:40.690466+0000","last_undegraded":"2023-10-16T19:41:40.690466+0000","last_fullsized":"2023-10-16T19:41:40.690466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204686+0000","last_change":"2023-10-16T19:41:07.758584+0000","last_active":"2023-10-16T19:41:41.204686+0000","last_peered":"2023-10-16T19:41:41.204686+0000","last_clean":"2023-10-16T19:41:41.204686+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:41.204686+0000","last_undegraded":"2023-10-16T19:41:41.204686+0000","last_fullsized":"2023-10-16T19:41:41.204686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.690227+0000","last_change":"2023-10-16T19:41:07.755959+0000","last_active":"2023-10-16T19:41:40.690227+0000","last_peered":"2023-10-16T19:41:40.690227+0000","last_clean":"2023-10-16T19:41:40.690227+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:40.690227+0000","last_undegraded":"2023-10-16T19:41:40.690227+0000","last_fullsized":"2023-10-16T19:41:40.690227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203362+0000","last_change":"2023-10-16T19:41:07.766151+0000","last_active":"2023-10-16T19:41:41.203362+0000","last_peered":"2023-10-16T19:41:41.203362+0000","last_clean":"2023-10-16T19:41:41.203362+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:41.203362+0000","last_undegraded":"2023-10-16T19:41:41.203362+0000","last_fullsized":"2023-10-16T19:41:41.203362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850355+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:40.850355+0000","last_peered":"2023-10-16T19:41:40.850355+0000","last_clean":"2023-10-16T19:41:40.850355+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:40.850355+0000","last_undegraded":"2023-10-16T19:41:40.850355+0000","last_fullsized":"2023-10-16T19:41:40.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689194+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:40.689194+0000","last_peered":"2023-10-16T19:41:40.689194+0000","last_clean":"2023-10-16T19:41:40.689194+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:40.689194+0000","last_undegraded":"2023-10-16T19:41:40.689194+0000","last_fullsized":"2023-10-16T19:41:40.689194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203927+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:41.203927+0000","last_peered":"2023-10-16T19:41:41.203927+0000","last_clean":"2023-10-16T19:41:41.203927+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:41:41.203927+0000","last_undegraded":"2023-10-16T19:41:41.203927+0000","last_fullsized":"2023-10-16T19:41:41.203927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.690454+0000","last_change":"2023-10-16T19:41:07.759838+0000","last_active":"2023-10-16T19:41:40.690454+0000","last_peered":"2023-10-16T19:41:40.690454+0000","last_clean":"2023-10-16T19:41:40.690454+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:41:40.690454+0000","last_undegraded":"2023-10-16T19:41:40.690454+0000","last_fullsized":"2023-10-16T19:41:40.690454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204682+0000","last_change":"2023-10-16T19:41:39.424899+0000","last_active":"2023-10-16T19:41:41.204682+0000","last_peered":"2023-10-16T19:41:41.204682+0000","last_clean":"2023-10-16T19:41:41.204682+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:41.204682+0000","last_undegraded":"2023-10-16T19:41:41.204682+0000","last_fullsized":"2023-10-16T19:41:41.204682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.424752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:04.441642+0000","scrub_duration":0.0021646320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.690398+0000","last_change":"2023-10-16T19:41:07.771435+0000","last_active":"2023-10-16T19:41:40.690398+0000","last_peered":"2023-10-16T19:41:40.690398+0000","last_clean":"2023-10-16T19:41:40.690398+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:40.690398+0000","last_undegraded":"2023-10-16T19:41:40.690398+0000","last_fullsized":"2023-10-16T19:41:40.690398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203554+0000","last_change":"2023-10-16T19:41:07.766557+0000","last_active":"2023-10-16T19:41:41.203554+0000","last_peered":"2023-10-16T19:41:41.203554+0000","last_clean":"2023-10-16T19:41:41.203554+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:41.203554+0000","last_undegraded":"2023-10-16T19:41:41.203554+0000","last_fullsized":"2023-10-16T19:41:41.203554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.690099+0000","last_change":"2023-10-16T19:41:07.756464+0000","last_active":"2023-10-16T19:41:40.690099+0000","last_peered":"2023-10-16T19:41:40.690099+0000","last_clean":"2023-10-16T19:41:40.690099+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:41:40.690099+0000","last_undegraded":"2023-10-16T19:41:40.690099+0000","last_fullsized":"2023-10-16T19:41:40.690099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689830+0000","last_change":"2023-10-16T19:41:07.749941+0000","last_active":"2023-10-16T19:41:40.689830+0000","last_peered":"2023-10-16T19:41:40.689830+0000","last_clean":"2023-10-16T19:41:40.689830+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:40.689830+0000","last_undegraded":"2023-10-16T19:41:40.689830+0000","last_fullsized":"2023-10-16T19:41:40.689830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.466343+0000","last_change":"2023-10-16T19:41:44.466397+0000","last_active":"2023-10-16T19:41:44.466343+0000","last_peered":"2023-10-16T19:41:44.466343+0000","last_clean":"2023-10-16T19:41:44.466343+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:44.466343+0000","last_undegraded":"2023-10-16T19:41:44.466343+0000","last_fullsized":"2023-10-16T19:41:44.466343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.466248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:56:07.937480+0000","scrub_duration":0.0019996940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.380727+0000","last_change":"2023-10-16T19:41:43.380778+0000","last_active":"2023-10-16T19:41:43.380727+0000","last_peered":"2023-10-16T19:41:43.380727+0000","last_clean":"2023-10-16T19:41:43.380727+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:43.380727+0000","last_undegraded":"2023-10-16T19:41:43.380727+0000","last_fullsized":"2023-10-16T19:41:43.380727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.380637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:39.199515+0000","scrub_duration":0.0016328530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689418+0000","last_change":"2023-10-16T19:41:07.766287+0000","last_active":"2023-10-16T19:41:40.689418+0000","last_peered":"2023-10-16T19:41:40.689418+0000","last_clean":"2023-10-16T19:41:40.689418+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:40.689418+0000","last_undegraded":"2023-10-16T19:41:40.689418+0000","last_fullsized":"2023-10-16T19:41:40.689418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"41'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.210712+0000","last_change":"2023-10-16T19:41:41.210712+0000","last_active":"2023-10-16T19:41:41.210712+0000","last_peered":"2023-10-16T19:41:41.210712+0000","last_clean":"2023-10-16T19:41:41.210712+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:41.210712+0000","last_undegraded":"2023-10-16T19:41:41.210712+0000","last_fullsized":"2023-10-16T19:41:41.210712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'6","last_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_deep_scrub":"41'6","last_deep_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.210537+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:53.124209+0000","scrub_duration":0.0037256020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204257+0000","last_change":"2023-10-16T19:41:38.438093+0000","last_active":"2023-10-16T19:41:41.204257+0000","last_peered":"2023-10-16T19:41:41.204257+0000","last_clean":"2023-10-16T19:41:41.204257+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:41.204257+0000","last_undegraded":"2023-10-16T19:41:41.204257+0000","last_fullsized":"2023-10-16T19:41:41.204257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.437940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:10.954572+0000","scrub_duration":0.002000309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203329+0000","last_change":"2023-10-16T19:41:32.035790+0000","last_active":"2023-10-16T19:41:41.203329+0000","last_peered":"2023-10-16T19:41:41.203329+0000","last_clean":"2023-10-16T19:41:41.203329+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:41.203329+0000","last_undegraded":"2023-10-16T19:41:41.203329+0000","last_fullsized":"2023-10-16T19:41:41.203329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.035616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:20.614273+0000","scrub_duration":0.0022946379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850758+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:40.850758+0000","last_peered":"2023-10-16T19:41:40.850758+0000","last_clean":"2023-10-16T19:41:40.850758+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:40.850758+0000","last_undegraded":"2023-10-16T19:41:40.850758+0000","last_fullsized":"2023-10-16T19:41:40.850758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204448+0000","last_change":"2023-10-16T19:41:32.432168+0000","last_active":"2023-10-16T19:41:41.204448+0000","last_peered":"2023-10-16T19:41:41.204448+0000","last_clean":"2023-10-16T19:41:41.204448+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:41.204448+0000","last_undegraded":"2023-10-16T19:41:41.204448+0000","last_fullsized":"2023-10-16T19:41:41.204448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.432006+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:38.982254+0000","scrub_duration":0.0022757319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689755+0000","last_change":"2023-10-16T19:41:07.757372+0000","last_active":"2023-10-16T19:41:40.689755+0000","last_peered":"2023-10-16T19:41:40.689755+0000","last_clean":"2023-10-16T19:41:40.689755+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:40.689755+0000","last_undegraded":"2023-10-16T19:41:40.689755+0000","last_fullsized":"2023-10-16T19:41:40.689755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.072514+0000","last_change":"2023-10-16T19:41:43.072571+0000","last_active":"2023-10-16T19:41:43.072514+0000","last_peered":"2023-10-16T19:41:43.072514+0000","last_clean":"2023-10-16T19:41:43.072514+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:43.072514+0000","last_undegraded":"2023-10-16T19:41:43.072514+0000","last_fullsized":"2023-10-16T19:41:43.072514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.072401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:58.808051+0000","scrub_duration":0.0037554989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203182+0000","last_change":"2023-10-16T19:41:07.753106+0000","last_active":"2023-10-16T19:41:41.203182+0000","last_peered":"2023-10-16T19:41:41.203182+0000","last_clean":"2023-10-16T19:41:41.203182+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:41.203182+0000","last_undegraded":"2023-10-16T19:41:41.203182+0000","last_fullsized":"2023-10-16T19:41:41.203182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203471+0000","last_change":"2023-10-16T19:41:26.798802+0000","last_active":"2023-10-16T19:41:41.203471+0000","last_peered":"2023-10-16T19:41:41.203471+0000","last_clean":"2023-10-16T19:41:41.203471+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:41.203471+0000","last_undegraded":"2023-10-16T19:41:41.203471+0000","last_fullsized":"2023-10-16T19:41:41.203471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.798653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:38.064241+0000","scrub_duration":0.001787713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.892163+0000","last_change":"2023-10-16T19:41:44.892234+0000","last_active":"2023-10-16T19:41:44.892163+0000","last_peered":"2023-10-16T19:41:44.892163+0000","last_clean":"2023-10-16T19:41:44.892163+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:44.892163+0000","last_undegraded":"2023-10-16T19:41:44.892163+0000","last_fullsized":"2023-10-16T19:41:44.892163+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.892065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:08:04.319315+0000","scrub_duration":0.002070302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689354+0000","last_change":"2023-10-16T19:41:37.399738+0000","last_active":"2023-10-16T19:41:40.689354+0000","last_peered":"2023-10-16T19:41:40.689354+0000","last_clean":"2023-10-16T19:41:40.689354+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:40.689354+0000","last_undegraded":"2023-10-16T19:41:40.689354+0000","last_fullsized":"2023-10-16T19:41:40.689354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.399584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:33.218462+0000","scrub_duration":0.001624889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850378+0000","last_change":"2023-10-16T19:41:07.766775+0000","last_active":"2023-10-16T19:41:40.850378+0000","last_peered":"2023-10-16T19:41:40.850378+0000","last_clean":"2023-10-16T19:41:40.850378+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:41:40.850378+0000","last_undegraded":"2023-10-16T19:41:40.850378+0000","last_fullsized":"2023-10-16T19:41:40.850378+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203361+0000","last_change":"2023-10-16T19:41:24.416785+0000","last_active":"2023-10-16T19:41:41.203361+0000","last_peered":"2023-10-16T19:41:41.203361+0000","last_clean":"2023-10-16T19:41:41.203361+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:41.203361+0000","last_undegraded":"2023-10-16T19:41:41.203361+0000","last_fullsized":"2023-10-16T19:41:41.203361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_clean_scrub_stamp":"2023-10-16T19:41:24.416675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:21.105171+0000","scrub_duration":0.001987988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689330+0000","last_change":"2023-10-16T19:41:07.760183+0000","last_active":"2023-10-16T19:41:40.689330+0000","last_peered":"2023-10-16T19:41:40.689330+0000","last_clean":"2023-10-16T19:41:40.689330+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:40.689330+0000","last_undegraded":"2023-10-16T19:41:40.689330+0000","last_fullsized":"2023-10-16T19:41:40.689330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850360+0000","last_change":"2023-10-16T19:41:28.074502+0000","last_active":"2023-10-16T19:41:40.850360+0000","last_peered":"2023-10-16T19:41:40.850360+0000","last_clean":"2023-10-16T19:41:40.850360+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:40.850360+0000","last_undegraded":"2023-10-16T19:41:40.850360+0000","last_fullsized":"2023-10-16T19:41:40.850360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.074317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:38.834029+0000","scrub_duration":0.001624524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204579+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:41.204579+0000","last_peered":"2023-10-16T19:41:41.204579+0000","last_clean":"2023-10-16T19:41:41.204579+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:41.204579+0000","last_undegraded":"2023-10-16T19:41:41.204579+0000","last_fullsized":"2023-10-16T19:41:41.204579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689832+0000","last_change":"2023-10-16T19:41:32.439032+0000","last_active":"2023-10-16T19:41:40.689832+0000","last_peered":"2023-10-16T19:41:40.689832+0000","last_clean":"2023-10-16T19:41:40.689832+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:40.689832+0000","last_undegraded":"2023-10-16T19:41:40.689832+0000","last_fullsized":"2023-10-16T19:41:40.689832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.438870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:11.870902+0000","scrub_duration":0.0014613199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689527+0000","last_change":"2023-10-16T19:41:07.761741+0000","last_active":"2023-10-16T19:41:40.689527+0000","last_peered":"2023-10-16T19:41:40.689527+0000","last_clean":"2023-10-16T19:41:40.689527+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:41:40.689527+0000","last_undegraded":"2023-10-16T19:41:40.689527+0000","last_fullsized":"2023-10-16T19:41:40.689527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.859226+0000","last_change":"2023-10-16T19:41:41.859297+0000","last_active":"2023-10-16T19:41:41.859226+0000","last_peered":"2023-10-16T19:41:41.859226+0000","last_clean":"2023-10-16T19:41:41.859226+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:41.859226+0000","last_undegraded":"2023-10-16T19:41:41.859226+0000","last_fullsized":"2023-10-16T19:41:41.859226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.291141+0000","scrub_duration":0.0025848989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203200+0000","last_change":"2023-10-16T19:41:07.758851+0000","last_active":"2023-10-16T19:41:41.203200+0000","last_peered":"2023-10-16T19:41:41.203200+0000","last_clean":"2023-10-16T19:41:41.203200+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:41.203200+0000","last_undegraded":"2023-10-16T19:41:41.203200+0000","last_fullsized":"2023-10-16T19:41:41.203200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203873+0000","last_change":"2023-10-16T19:41:34.813937+0000","last_active":"2023-10-16T19:41:41.203873+0000","last_peered":"2023-10-16T19:41:41.203873+0000","last_clean":"2023-10-16T19:41:41.203873+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:41.203873+0000","last_undegraded":"2023-10-16T19:41:41.203873+0000","last_fullsized":"2023-10-16T19:41:41.203873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.813765+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:26.030685+0000","scrub_duration":0.0026970840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850842+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:40.850842+0000","last_peered":"2023-10-16T19:41:40.850842+0000","last_clean":"2023-10-16T19:41:40.850842+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:40.850842+0000","last_undegraded":"2023-10-16T19:41:40.850842+0000","last_fullsized":"2023-10-16T19:41:40.850842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689468+0000","last_change":"2023-10-16T19:41:26.265248+0000","last_active":"2023-10-16T19:41:40.689468+0000","last_peered":"2023-10-16T19:41:40.689468+0000","last_clean":"2023-10-16T19:41:40.689468+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:40.689468+0000","last_undegraded":"2023-10-16T19:41:40.689468+0000","last_fullsized":"2023-10-16T19:41:40.689468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.265088+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:17.482008+0000","scrub_duration":0.0027794270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.698835+0000","last_change":"2023-10-16T19:41:41.698835+0000","last_active":"2023-10-16T19:41:41.698835+0000","last_peered":"2023-10-16T19:41:41.698835+0000","last_clean":"2023-10-16T19:41:41.698835+0000","last_became_active":"2023-10-16T19:41:41.698445+0000","last_became_peered":"2023-10-16T19:41:41.698445+0000","last_unstale":"2023-10-16T19:41:41.698835+0000","last_undegraded":"2023-10-16T19:41:41.698835+0000","last_fullsized":"2023-10-16T19:41:41.698835+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689358+0000","last_change":"2023-10-16T19:41:31.405513+0000","last_active":"2023-10-16T19:41:40.689358+0000","last_peered":"2023-10-16T19:41:40.689358+0000","last_clean":"2023-10-16T19:41:40.689358+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:40.689358+0000","last_undegraded":"2023-10-16T19:41:40.689358+0000","last_fullsized":"2023-10-16T19:41:40.689358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.405339+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:09.781936+0000","scrub_duration":0.002339828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689131+0000","last_change":"2023-10-16T19:41:34.498969+0000","last_active":"2023-10-16T19:41:40.689131+0000","last_peered":"2023-10-16T19:41:40.689131+0000","last_clean":"2023-10-16T19:41:40.689131+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:40.689131+0000","last_undegraded":"2023-10-16T19:41:40.689131+0000","last_fullsized":"2023-10-16T19:41:40.689131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.498811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:07:53.926061+0000","scrub_duration":0.0015560299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203581+0000","last_change":"2023-10-16T19:41:29.397336+0000","last_active":"2023-10-16T19:41:41.203581+0000","last_peered":"2023-10-16T19:41:41.203581+0000","last_clean":"2023-10-16T19:41:41.203581+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:41.203581+0000","last_undegraded":"2023-10-16T19:41:41.203581+0000","last_fullsized":"2023-10-16T19:41:41.203581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.397178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:31.388581+0000","scrub_duration":0.002123893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689492+0000","last_change":"2023-10-16T19:41:07.773490+0000","last_active":"2023-10-16T19:41:40.689492+0000","last_peered":"2023-10-16T19:41:40.689492+0000","last_clean":"2023-10-16T19:41:40.689492+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:40.689492+0000","last_undegraded":"2023-10-16T19:41:40.689492+0000","last_fullsized":"2023-10-16T19:41:40.689492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689712+0000","last_change":"2023-10-16T19:41:35.144062+0000","last_active":"2023-10-16T19:41:40.689712+0000","last_peered":"2023-10-16T19:41:40.689712+0000","last_clean":"2023-10-16T19:41:40.689712+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:40.689712+0000","last_undegraded":"2023-10-16T19:41:40.689712+0000","last_fullsized":"2023-10-16T19:41:40.689712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.143921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:31.832417+0000","scrub_duration":0.001607083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.521694+0000","last_change":"2023-10-16T19:41:45.521762+0000","last_active":"2023-10-16T19:41:45.521694+0000","last_peered":"2023-10-16T19:41:45.521694+0000","last_clean":"2023-10-16T19:41:45.521694+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:45.521694+0000","last_undegraded":"2023-10-16T19:41:45.521694+0000","last_fullsized":"2023-10-16T19:41:45.521694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.521556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:05.994374+0000","scrub_duration":0.001605558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689314+0000","last_change":"2023-10-16T19:41:32.365943+0000","last_active":"2023-10-16T19:41:40.689314+0000","last_peered":"2023-10-16T19:41:40.689314+0000","last_clean":"2023-10-16T19:41:40.689314+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:40.689314+0000","last_undegraded":"2023-10-16T19:41:40.689314+0000","last_fullsized":"2023-10-16T19:41:40.689314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.365731+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:33:57.382620+0000","scrub_duration":0.0025667099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689341+0000","last_change":"2023-10-16T19:41:07.752031+0000","last_active":"2023-10-16T19:41:40.689341+0000","last_peered":"2023-10-16T19:41:40.689341+0000","last_clean":"2023-10-16T19:41:40.689341+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:40.689341+0000","last_undegraded":"2023-10-16T19:41:40.689341+0000","last_fullsized":"2023-10-16T19:41:40.689341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203892+0000","last_change":"2023-10-16T19:41:39.819129+0000","last_active":"2023-10-16T19:41:41.203892+0000","last_peered":"2023-10-16T19:41:41.203892+0000","last_clean":"2023-10-16T19:41:41.203892+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:41.203892+0000","last_undegraded":"2023-10-16T19:41:41.203892+0000","last_fullsized":"2023-10-16T19:41:41.203892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.818988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:12.359324+0000","scrub_duration":0.003109541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203730+0000","last_change":"2023-10-16T19:41:07.770864+0000","last_active":"2023-10-16T19:41:41.203730+0000","last_peered":"2023-10-16T19:41:41.203730+0000","last_clean":"2023-10-16T19:41:41.203730+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:41:41.203730+0000","last_undegraded":"2023-10-16T19:41:41.203730+0000","last_fullsized":"2023-10-16T19:41:41.203730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.097262+0000","last_change":"2023-10-16T19:41:44.097334+0000","last_active":"2023-10-16T19:41:44.097262+0000","last_peered":"2023-10-16T19:41:44.097262+0000","last_clean":"2023-10-16T19:41:44.097262+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:44.097262+0000","last_undegraded":"2023-10-16T19:41:44.097262+0000","last_fullsized":"2023-10-16T19:41:44.097262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.097170+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:16.613802+0000","scrub_duration":0.0033001850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850824+0000","last_change":"2023-10-16T19:41:07.756570+0000","last_active":"2023-10-16T19:41:40.850824+0000","last_peered":"2023-10-16T19:41:40.850824+0000","last_clean":"2023-10-16T19:41:40.850824+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:40.850824+0000","last_undegraded":"2023-10-16T19:41:40.850824+0000","last_fullsized":"2023-10-16T19:41:40.850824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204759+0000","last_change":"2023-10-16T19:41:06.751046+0000","last_active":"2023-10-16T19:41:41.204759+0000","last_peered":"2023-10-16T19:41:41.204759+0000","last_clean":"2023-10-16T19:41:41.204759+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:41.204759+0000","last_undegraded":"2023-10-16T19:41:41.204759+0000","last_fullsized":"2023-10-16T19:41:41.204759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.205005+0000","last_change":"2023-10-16T19:41:07.760114+0000","last_active":"2023-10-16T19:41:41.205005+0000","last_peered":"2023-10-16T19:41:41.205005+0000","last_clean":"2023-10-16T19:41:41.205005+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:41:41.205005+0000","last_undegraded":"2023-10-16T19:41:41.205005+0000","last_fullsized":"2023-10-16T19:41:41.205005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203944+0000","last_change":"2023-10-16T19:41:28.359470+0000","last_active":"2023-10-16T19:41:41.203944+0000","last_peered":"2023-10-16T19:41:41.203944+0000","last_clean":"2023-10-16T19:41:41.203944+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:41.203944+0000","last_undegraded":"2023-10-16T19:41:41.203944+0000","last_fullsized":"2023-10-16T19:41:41.203944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.359320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:40.272993+0000","scrub_duration":0.001874943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.506730+0000","last_change":"2023-10-16T19:41:45.506800+0000","last_active":"2023-10-16T19:41:45.506730+0000","last_peered":"2023-10-16T19:41:45.506730+0000","last_clean":"2023-10-16T19:41:45.506730+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:45.506730+0000","last_undegraded":"2023-10-16T19:41:45.506730+0000","last_fullsized":"2023-10-16T19:41:45.506730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.506600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:51:54.174118+0000","scrub_duration":0.0021900819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204311+0000","last_change":"2023-10-16T19:41:06.753050+0000","last_active":"2023-10-16T19:41:41.204311+0000","last_peered":"2023-10-16T19:41:41.204311+0000","last_clean":"2023-10-16T19:41:41.204311+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:41.204311+0000","last_undegraded":"2023-10-16T19:41:41.204311+0000","last_fullsized":"2023-10-16T19:41:41.204311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203075+0000","last_change":"2023-10-16T19:41:37.991413+0000","last_active":"2023-10-16T19:41:41.203075+0000","last_peered":"2023-10-16T19:41:41.203075+0000","last_clean":"2023-10-16T19:41:41.203075+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:41.203075+0000","last_undegraded":"2023-10-16T19:41:41.203075+0000","last_fullsized":"2023-10-16T19:41:41.203075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.991268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:03.514348+0000","scrub_duration":0.0019647050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.151371+0000","last_change":"2023-10-16T19:41:45.151421+0000","last_active":"2023-10-16T19:41:45.151371+0000","last_peered":"2023-10-16T19:41:45.151371+0000","last_clean":"2023-10-16T19:41:45.151371+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:45.151371+0000","last_undegraded":"2023-10-16T19:41:45.151371+0000","last_fullsized":"2023-10-16T19:41:45.151371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.151281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:39.157471+0000","scrub_duration":0.0019257510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203583+0000","last_change":"2023-10-16T19:41:07.765580+0000","last_active":"2023-10-16T19:41:41.203583+0000","last_peered":"2023-10-16T19:41:41.203583+0000","last_clean":"2023-10-16T19:41:41.203583+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:41.203583+0000","last_undegraded":"2023-10-16T19:41:41.203583+0000","last_fullsized":"2023-10-16T19:41:41.203583+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689285+0000","last_change":"2023-10-16T19:41:34.344641+0000","last_active":"2023-10-16T19:41:40.689285+0000","last_peered":"2023-10-16T19:41:40.689285+0000","last_clean":"2023-10-16T19:41:40.689285+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:40.689285+0000","last_undegraded":"2023-10-16T19:41:40.689285+0000","last_fullsized":"2023-10-16T19:41:40.689285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.344482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:00:12.314887+0000","scrub_duration":0.0016727179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.476588+0000","last_change":"2023-10-16T19:41:41.476588+0000","last_active":"2023-10-16T19:41:41.476588+0000","last_peered":"2023-10-16T19:41:41.476588+0000","last_clean":"2023-10-16T19:41:41.476588+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:41.476588+0000","last_undegraded":"2023-10-16T19:41:41.476588+0000","last_fullsized":"2023-10-16T19:41:41.476588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.476462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:13.370623+0000","scrub_duration":0.0020194219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204062+0000","last_change":"2023-10-16T19:41:33.039261+0000","last_active":"2023-10-16T19:41:41.204062+0000","last_peered":"2023-10-16T19:41:41.204062+0000","last_clean":"2023-10-16T19:41:41.204062+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:41.204062+0000","last_undegraded":"2023-10-16T19:41:41.204062+0000","last_fullsized":"2023-10-16T19:41:41.204062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.039106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:12.030925+0000","scrub_duration":0.001540869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.394202+0000","last_change":"2023-10-16T19:41:41.394202+0000","last_active":"2023-10-16T19:41:41.394202+0000","last_peered":"2023-10-16T19:41:41.394202+0000","last_clean":"2023-10-16T19:41:41.394202+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:41.394202+0000","last_undegraded":"2023-10-16T19:41:41.394202+0000","last_fullsized":"2023-10-16T19:41:41.394202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.394045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:58.221103+0000","scrub_duration":0.0021463179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203900+0000","last_change":"2023-10-16T19:41:40.835813+0000","last_active":"2023-10-16T19:41:41.203900+0000","last_peered":"2023-10-16T19:41:41.203900+0000","last_clean":"2023-10-16T19:41:41.203900+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:41.203900+0000","last_undegraded":"2023-10-16T19:41:41.203900+0000","last_fullsized":"2023-10-16T19:41:41.203900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.835600+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:29.874255+0000","scrub_duration":0.0042860880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689593+0000","last_change":"2023-10-16T19:41:07.761437+0000","last_active":"2023-10-16T19:41:40.689593+0000","last_peered":"2023-10-16T19:41:40.689593+0000","last_clean":"2023-10-16T19:41:40.689593+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:40.689593+0000","last_undegraded":"2023-10-16T19:41:40.689593+0000","last_fullsized":"2023-10-16T19:41:40.689593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204927+0000","last_change":"2023-10-16T19:41:06.755026+0000","last_active":"2023-10-16T19:41:41.204927+0000","last_peered":"2023-10-16T19:41:41.204927+0000","last_clean":"2023-10-16T19:41:41.204927+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:41.204927+0000","last_undegraded":"2023-10-16T19:41:41.204927+0000","last_fullsized":"2023-10-16T19:41:41.204927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689628+0000","last_change":"2023-10-16T19:41:38.463191+0000","last_active":"2023-10-16T19:41:40.689628+0000","last_peered":"2023-10-16T19:41:40.689628+0000","last_clean":"2023-10-16T19:41:40.689628+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:40.689628+0000","last_undegraded":"2023-10-16T19:41:40.689628+0000","last_fullsized":"2023-10-16T19:41:40.689628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.463035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:11.032374+0000","scrub_duration":0.0018809720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203321+0000","last_change":"2023-10-16T19:41:31.031202+0000","last_active":"2023-10-16T19:41:41.203321+0000","last_peered":"2023-10-16T19:41:41.203321+0000","last_clean":"2023-10-16T19:41:41.203321+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:41.203321+0000","last_undegraded":"2023-10-16T19:41:41.203321+0000","last_fullsized":"2023-10-16T19:41:41.203321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.031043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:46.766692+0000","scrub_duration":0.001647171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.202987+0000","last_change":"2023-10-16T19:41:07.751558+0000","last_active":"2023-10-16T19:41:41.202987+0000","last_peered":"2023-10-16T19:41:41.202987+0000","last_clean":"2023-10-16T19:41:41.202987+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:41.202987+0000","last_undegraded":"2023-10-16T19:41:41.202987+0000","last_fullsized":"2023-10-16T19:41:41.202987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203418+0000","last_change":"2023-10-16T19:41:26.949224+0000","last_active":"2023-10-16T19:41:41.203418+0000","last_peered":"2023-10-16T19:41:41.203418+0000","last_clean":"2023-10-16T19:41:41.203418+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:41.203418+0000","last_undegraded":"2023-10-16T19:41:41.203418+0000","last_fullsized":"2023-10-16T19:41:41.203418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.949056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:33.499304+0000","scrub_duration":0.001636935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203266+0000","last_change":"2023-10-16T19:41:35.404620+0000","last_active":"2023-10-16T19:41:41.203266+0000","last_peered":"2023-10-16T19:41:41.203266+0000","last_clean":"2023-10-16T19:41:41.203266+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:41.203266+0000","last_undegraded":"2023-10-16T19:41:41.203266+0000","last_fullsized":"2023-10-16T19:41:41.203266+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.404463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:51.140112+0000","scrub_duration":0.001879155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689925+0000","last_change":"2023-10-16T19:41:06.751490+0000","last_active":"2023-10-16T19:41:40.689925+0000","last_peered":"2023-10-16T19:41:40.689925+0000","last_clean":"2023-10-16T19:41:40.689925+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:40.689925+0000","last_undegraded":"2023-10-16T19:41:40.689925+0000","last_fullsized":"2023-10-16T19:41:40.689925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:05.724433+0000","last_clean_scrub_stamp":"2023-10-16T19:41:05.724433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850453+0000","last_change":"2023-10-16T19:41:07.751669+0000","last_active":"2023-10-16T19:41:40.850453+0000","last_peered":"2023-10-16T19:41:40.850453+0000","last_clean":"2023-10-16T19:41:40.850453+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:40.850453+0000","last_undegraded":"2023-10-16T19:41:40.850453+0000","last_fullsized":"2023-10-16T19:41:40.850453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850326+0000","last_change":"2023-10-16T19:41:33.055184+0000","last_active":"2023-10-16T19:41:40.850326+0000","last_peered":"2023-10-16T19:41:40.850326+0000","last_clean":"2023-10-16T19:41:40.850326+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:40.850326+0000","last_undegraded":"2023-10-16T19:41:40.850326+0000","last_fullsized":"2023-10-16T19:41:40.850326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.055042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:45.001071+0000","scrub_duration":0.0020577270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689922+0000","last_change":"2023-10-16T19:41:07.760145+0000","last_active":"2023-10-16T19:41:40.689922+0000","last_peered":"2023-10-16T19:41:40.689922+0000","last_clean":"2023-10-16T19:41:40.689922+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:40.689922+0000","last_undegraded":"2023-10-16T19:41:40.689922+0000","last_fullsized":"2023-10-16T19:41:40.689922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689032+0000","last_change":"2023-10-16T19:41:29.348081+0000","last_active":"2023-10-16T19:41:40.689032+0000","last_peered":"2023-10-16T19:41:40.689032+0000","last_clean":"2023-10-16T19:41:40.689032+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:40.689032+0000","last_undegraded":"2023-10-16T19:41:40.689032+0000","last_fullsized":"2023-10-16T19:41:40.689032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.347858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:01.888194+0000","scrub_duration":0.0017072509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203778+0000","last_change":"2023-10-16T19:41:07.770218+0000","last_active":"2023-10-16T19:41:41.203778+0000","last_peered":"2023-10-16T19:41:41.203778+0000","last_clean":"2023-10-16T19:41:41.203778+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:41.203778+0000","last_undegraded":"2023-10-16T19:41:41.203778+0000","last_fullsized":"2023-10-16T19:41:41.203778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689481+0000","last_change":"2023-10-16T19:41:38.353018+0000","last_active":"2023-10-16T19:41:40.689481+0000","last_peered":"2023-10-16T19:41:40.689481+0000","last_clean":"2023-10-16T19:41:40.689481+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:40.689481+0000","last_undegraded":"2023-10-16T19:41:40.689481+0000","last_fullsized":"2023-10-16T19:41:40.689481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.352810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:10.893146+0000","scrub_duration":0.0020448939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"40'119","reported_seq":195,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689420+0000","last_change":"2023-10-16T19:41:29.433686+0000","last_active":"2023-10-16T19:41:40.689420+0000","last_peered":"2023-10-16T19:41:40.689420+0000","last_clean":"2023-10-16T19:41:40.689420+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:40.689420+0000","last_undegraded":"2023-10-16T19:41:40.689420+0000","last_fullsized":"2023-10-16T19:41:40.689420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'119","last_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_deep_scrub":"40'119","last_deep_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.433479+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:01.950112+0000","scrub_duration":0.0052109569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":804226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.79300000000000004}]},{"osd":3,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.75},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.76800000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.434}]},{"osd":5,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":212758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":11.582000000000001,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.749},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.75900000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":212266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":10.465,"5min":10.465,"15min":10.465},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.53400000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.497,"5min":14.497,"15min":14.497},"last":0.497},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":16.306999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":16.234999999999999,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2939999999999996,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":16.192,"5min":16.192,"15min":16.192},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":16.274999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.83199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":802578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.503},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.437}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70099999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":212246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.311},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61799999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":213822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.36399999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.52900000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46899999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.6180000000000003,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.9039999999999999,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.9290000000000003,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55700000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.435},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.876},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.85699999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:41:47.611 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.611 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.611 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.612 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.612 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.613 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.613 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.613 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.614 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.614 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.614 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.615 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.615 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.615 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.616 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.616 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.616 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.617 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.617 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.617 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.618 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.618 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.618 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.619 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.619 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.619 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.620 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.620 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.621 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.621 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.621 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.622 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.622 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.622 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.623 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.623 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.623 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.624 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.624 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.624 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.625 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.625 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.625 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.626 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.626 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.627 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.627 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.627 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-16T19:41:05.724433+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=5, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.628 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.628 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.629 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:41:47.629 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:41:57.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:41:57.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:07.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:42:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.767+0000 7f2015ba1700 1 Processor -- start 2023-10-16T19:42:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.767+0000 7f2015ba1700 1 -- start start 2023-10-16T19:42:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f2015ba1700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f2015ba1700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20100a8490 0x7f201014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f2015ba1700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2010156dd0 con 0x7f201006aaf0 2023-10-16T19:42:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f2015ba1700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20100c1d00 con 0x7f20100a8490 2023-10-16T19:42:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f2015ba1700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2010156830 con 0x7f20100c2710 2023-10-16T19:42:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20100a8490 0x7f201014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20100a8490 0x7f201014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:44384/0 (socket says 172.21.15.29:44384) 2023-10-16T19:42:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 -- 172.21.15.29:0/2323556882 learned_addr learned my addr 172.21.15.29:0/2323556882 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200effd700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:46550/0 (socket says 172.21.15.29:46550) 2023-10-16T19:42:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 -- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 msgr2=0x7f201014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 -- 172.21.15.29:0/2323556882 >> v1:172.21.15.53:6789/0 conn(0x7f201006aaf0 legacy=0x7f20100c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200ffff700 1 -- 172.21.15.29:0/2323556882 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20100c1f50 con 0x7f20100a8490 2023-10-16T19:42:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.768+0000 7f200effd700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:42:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f200ffff700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20100a8490 0x7f201014fe80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2008009e50 tx=0x7f200800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cf5cc1186837be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f200e7fc700 1 -- 172.21.15.29:0/2323556882 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800e070 con 0x7f20100a8490 2023-10-16T19:42:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f200e7fc700 1 -- 172.21.15.29:0/2323556882 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200800b910 con 0x7f20100a8490 2023-10-16T19:42:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f200e7fc700 1 -- 172.21.15.29:0/2323556882 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800bcc0 con 0x7f20100a8490 2023-10-16T19:42:07.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 -- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20100a8490 msgr2=0x7f201014fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20100a8490 0x7f201014fe80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2008009e50 tx=0x7f200800b330 comp rx=0 tx=0).stop 2023-10-16T19:42:07.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 -- 172.21.15.29:0/2323556882 shutdown_connections 2023-10-16T19:42:07.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20100a8490 0x7f201014fe80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 --2- 172.21.15.29:0/2323556882 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.769+0000 7f2015ba1700 1 -- 172.21.15.29:0/2323556882 >> 172.21.15.29:0/2323556882 conn(0x7f20100c7100 msgr2=0x7f20100c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:07.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.770+0000 7f2015ba1700 1 -- 172.21.15.29:0/2323556882 shutdown_connections 2023-10-16T19:42:07.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.770+0000 7f2015ba1700 1 -- 172.21.15.29:0/2323556882 wait complete. 2023-10-16T19:42:07.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.771+0000 7f2015ba1700 1 Processor -- start 2023-10-16T19:42:07.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.771+0000 7f2015ba1700 1 -- start start 2023-10-16T19:42:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201006aaf0 0x7f20101dc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20101e9a10 con 0x7f20100a8490 2023-10-16T19:42:07.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20100c4d20 con 0x7f201006aaf0 2023-10-16T19:42:07.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f2015ba1700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201014b200 con 0x7f20100c2710 2023-10-16T19:42:07.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54102/0 (socket says 172.21.15.29:54102) 2023-10-16T19:42:07.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 -- 172.21.15.29:0/1897564433 learned_addr learned my addr 172.21.15.29:0/1897564433 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:07.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200ffff700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200f7fe700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201006aaf0 0x7f20101dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 -- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 msgr2=0x7f201014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 -- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201006aaf0 msgr2=0x7f20101dc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201006aaf0 0x7f20101dc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 -- 172.21.15.29:0/1897564433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20040094a0 con 0x7f20100a8490 2023-10-16T19:42:07.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.772+0000 7f200effd700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f200400ec10 tx=0x7f200400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:07.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.773+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004009760 con 0x7f20100a8490 2023-10-16T19:42:07.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.773+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400c850 con 0x7f20100a8490 2023-10-16T19:42:07.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.773+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2008009b30 con 0x7f20100a8490 2023-10-16T19:42:07.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.773+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400cbe0 con 0x7f20100a8490 2023-10-16T19:42:07.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.773+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20100c0ec0 con 0x7f20100a8490 2023-10-16T19:42:07.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.774+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20101e9b80 con 0x7f20100a8490 2023-10-16T19:42:07.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.774+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f200400cd40 con 0x7f20100a8490 2023-10-16T19:42:07.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.775+0000 7f1ff7fff700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 0x7f1ffc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.775+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f2004089a20 con 0x7f20100a8490 2023-10-16T19:42:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.775+0000 7f200f7fe700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 0x7f1ffc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.775+0000 7f200f7fe700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 0x7f1ffc06d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20000018a0 tx=0x7f2000009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.779+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20101e9b80 con 0x7f20100a8490 2023-10-16T19:42:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.976+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20100a8fb0 con 0x7f1ffc06af00 2023-10-16T19:42:07.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.985+0000 7f1ff7fff700 1 -- 172.21.15.29:0/1897564433 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290356 (secure 0 0 0) 0x7f2000001540 con 0x7f1ffc06af00 2023-10-16T19:42:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:42:07.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 msgr2=0x7f1ffc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 0x7f1ffc06d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20000018a0 tx=0x7f2000009040 comp rx=0 tx=0).stop 2023-10-16T19:42:07.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 msgr2=0x7f201014a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:07.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f200400ec10 tx=0x7f200400ef20 comp rx=0 tx=0).stop 2023-10-16T19:42:07.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 shutdown_connections 2023-10-16T19:42:07.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f1ffc06af00 0x7f1ffc06d3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f20100c2710 0x7f201014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201006aaf0 0x7f20101dc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 --2- 172.21.15.29:0/1897564433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20100a8490 0x7f201014a780 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 >> 172.21.15.29:0/1897564433 conn(0x7f20100c7100 msgr2=0x7f2010073470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 shutdown_connections 2023-10-16T19:42:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:07.988+0000 7f2015ba1700 1 -- 172.21.15.29:0/1897564433 wait complete. 2023-10-16T19:42:07.997 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:42:08.003 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-10-16T19:42:06.590449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5152768,"data_stored":2882964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.504572+0000","last_change":"2023-10-16T19:41:48.504620+0000","last_active":"2023-10-16T19:41:48.504572+0000","last_peered":"2023-10-16T19:41:48.504572+0000","last_clean":"2023-10-16T19:41:48.504572+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:48.504572+0000","last_undegraded":"2023-10-16T19:41:48.504572+0000","last_fullsized":"2023-10-16T19:41:48.504572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.504480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.504480+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.504480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:50:55.351581+0000","scrub_duration":0.001303963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689621+0000","last_change":"2023-10-16T19:41:37.432770+0000","last_active":"2023-10-16T19:41:40.689621+0000","last_peered":"2023-10-16T19:41:40.689621+0000","last_clean":"2023-10-16T19:41:40.689621+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:40.689621+0000","last_undegraded":"2023-10-16T19:41:40.689621+0000","last_fullsized":"2023-10-16T19:41:40.689621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.432607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:45:58.851261+0000","scrub_duration":0.001589827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:55.059577+0000","last_change":"2023-10-16T19:41:55.059653+0000","last_active":"2023-10-16T19:41:55.059577+0000","last_peered":"2023-10-16T19:41:55.059577+0000","last_clean":"2023-10-16T19:41:55.059577+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:55.059577+0000","last_undegraded":"2023-10-16T19:41:55.059577+0000","last_fullsized":"2023-10-16T19:41:55.059577+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:55.059468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:55.059468+0000","last_clean_scrub_stamp":"2023-10-16T19:41:55.059468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:18:23.028350+0000","scrub_duration":0.0021066399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.952446+0000","last_change":"2023-10-16T19:41:57.952495+0000","last_active":"2023-10-16T19:41:57.952446+0000","last_peered":"2023-10-16T19:41:57.952446+0000","last_clean":"2023-10-16T19:41:57.952446+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:57.952446+0000","last_undegraded":"2023-10-16T19:41:57.952446+0000","last_fullsized":"2023-10-16T19:41:57.952446+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.952337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.952337+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.952337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:51.111641+0000","scrub_duration":0.001819088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:03.031336+0000","last_change":"2023-10-16T19:42:03.031384+0000","last_active":"2023-10-16T19:42:03.031336+0000","last_peered":"2023-10-16T19:42:03.031336+0000","last_clean":"2023-10-16T19:42:03.031336+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:42:03.031336+0000","last_undegraded":"2023-10-16T19:42:03.031336+0000","last_fullsized":"2023-10-16T19:42:03.031336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:03.031239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:03.031239+0000","last_clean_scrub_stamp":"2023-10-16T19:42:03.031239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:28.048129+0000","scrub_duration":0.0021445869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.454527+0000","last_change":"2023-10-16T19:41:46.454576+0000","last_active":"2023-10-16T19:41:46.454527+0000","last_peered":"2023-10-16T19:41:46.454527+0000","last_clean":"2023-10-16T19:41:46.454527+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:46.454527+0000","last_undegraded":"2023-10-16T19:41:46.454527+0000","last_fullsized":"2023-10-16T19:41:46.454527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.454417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.454417+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.454417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:35.493072+0000","scrub_duration":0.0015396330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:42.819585+0000","last_change":"2023-10-16T19:41:42.819641+0000","last_active":"2023-10-16T19:41:42.819585+0000","last_peered":"2023-10-16T19:41:42.819585+0000","last_clean":"2023-10-16T19:41:42.819585+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:42.819585+0000","last_undegraded":"2023-10-16T19:41:42.819585+0000","last_fullsized":"2023-10-16T19:41:42.819585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_clean_scrub_stamp":"2023-10-16T19:41:42.819483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:25:02.979210+0000","scrub_duration":0.0019850570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.688960+0000","last_change":"2023-10-16T19:41:33.469584+0000","last_active":"2023-10-16T19:41:40.688960+0000","last_peered":"2023-10-16T19:41:40.688960+0000","last_clean":"2023-10-16T19:41:40.688960+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:40.688960+0000","last_undegraded":"2023-10-16T19:41:40.688960+0000","last_fullsized":"2023-10-16T19:41:40.688960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.469436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:53.629164+0000","scrub_duration":0.001807835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203491+0000","last_change":"2023-10-16T19:41:40.998502+0000","last_active":"2023-10-16T19:41:41.203491+0000","last_peered":"2023-10-16T19:41:41.203491+0000","last_clean":"2023-10-16T19:41:41.203491+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:41.203491+0000","last_undegraded":"2023-10-16T19:41:41.203491+0000","last_fullsized":"2023-10-16T19:41:41.203491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.998308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:36.817186+0000","scrub_duration":0.002136102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.881678+0000","last_change":"2023-10-16T19:41:57.881729+0000","last_active":"2023-10-16T19:41:57.881678+0000","last_peered":"2023-10-16T19:41:57.881678+0000","last_clean":"2023-10-16T19:41:57.881678+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:57.881678+0000","last_undegraded":"2023-10-16T19:41:57.881678+0000","last_fullsized":"2023-10-16T19:41:57.881678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.881575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.881575+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.881575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:47:00.547554+0000","scrub_duration":0.00162159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203674+0000","last_change":"2023-10-16T19:41:07.771080+0000","last_active":"2023-10-16T19:41:41.203674+0000","last_peered":"2023-10-16T19:41:41.203674+0000","last_clean":"2023-10-16T19:41:41.203674+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:41:41.203674+0000","last_undegraded":"2023-10-16T19:41:41.203674+0000","last_fullsized":"2023-10-16T19:41:41.203674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.028371+0000","last_change":"2023-10-16T19:41:46.028456+0000","last_active":"2023-10-16T19:41:46.028371+0000","last_peered":"2023-10-16T19:41:46.028371+0000","last_clean":"2023-10-16T19:41:46.028371+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:46.028371+0000","last_undegraded":"2023-10-16T19:41:46.028371+0000","last_fullsized":"2023-10-16T19:41:46.028371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.028259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.028259+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.028259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:35.066913+0000","scrub_duration":0.001461452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:54.858984+0000","last_change":"2023-10-16T19:41:54.859039+0000","last_active":"2023-10-16T19:41:54.858984+0000","last_peered":"2023-10-16T19:41:54.858984+0000","last_clean":"2023-10-16T19:41:54.858984+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:54.858984+0000","last_undegraded":"2023-10-16T19:41:54.858984+0000","last_fullsized":"2023-10-16T19:41:54.858984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:54.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:54.858870+0000","last_clean_scrub_stamp":"2023-10-16T19:41:54.858870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:44.878933+0000","scrub_duration":0.0015857860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850507+0000","last_change":"2023-10-16T19:41:07.751869+0000","last_active":"2023-10-16T19:41:40.850507+0000","last_peered":"2023-10-16T19:41:40.850507+0000","last_clean":"2023-10-16T19:41:40.850507+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:41:40.850507+0000","last_undegraded":"2023-10-16T19:41:40.850507+0000","last_fullsized":"2023-10-16T19:41:40.850507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.896297+0000","last_change":"2023-10-16T19:41:45.896345+0000","last_active":"2023-10-16T19:41:45.896297+0000","last_peered":"2023-10-16T19:41:45.896297+0000","last_clean":"2023-10-16T19:41:45.896297+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:45.896297+0000","last_undegraded":"2023-10-16T19:41:45.896297+0000","last_fullsized":"2023-10-16T19:41:45.896297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.896203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.896203+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.896203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:07.314856+0000","scrub_duration":0.002060596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.421640+0000","last_change":"2023-10-16T19:42:02.421713+0000","last_active":"2023-10-16T19:42:02.421640+0000","last_peered":"2023-10-16T19:42:02.421640+0000","last_clean":"2023-10-16T19:42:02.421640+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:42:02.421640+0000","last_undegraded":"2023-10-16T19:42:02.421640+0000","last_fullsized":"2023-10-16T19:42:02.421640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.421513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.421513+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.421513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:52.441576+0000","scrub_duration":0.0016558320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:56.425774+0000","last_change":"2023-10-16T19:41:56.425821+0000","last_active":"2023-10-16T19:41:56.425774+0000","last_peered":"2023-10-16T19:41:56.425774+0000","last_clean":"2023-10-16T19:41:56.425774+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:56.425774+0000","last_undegraded":"2023-10-16T19:41:56.425774+0000","last_fullsized":"2023-10-16T19:41:56.425774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:56.425672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:56.425672+0000","last_clean_scrub_stamp":"2023-10-16T19:41:56.425672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:28.319833+0000","scrub_duration":0.0016027979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:58.149131+0000","last_change":"2023-10-16T19:41:58.149181+0000","last_active":"2023-10-16T19:41:58.149131+0000","last_peered":"2023-10-16T19:41:58.149131+0000","last_clean":"2023-10-16T19:41:58.149131+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:58.149131+0000","last_undegraded":"2023-10-16T19:41:58.149131+0000","last_fullsized":"2023-10-16T19:41:58.149131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:58.149045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:58.149045+0000","last_clean_scrub_stamp":"2023-10-16T19:41:58.149045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:23.165934+0000","scrub_duration":0.001625797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:55.033725+0000","last_change":"2023-10-16T19:41:55.033773+0000","last_active":"2023-10-16T19:41:55.033725+0000","last_peered":"2023-10-16T19:41:55.033725+0000","last_clean":"2023-10-16T19:41:55.033725+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:55.033725+0000","last_undegraded":"2023-10-16T19:41:55.033725+0000","last_fullsized":"2023-10-16T19:41:55.033725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:55.033618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:55.033618+0000","last_clean_scrub_stamp":"2023-10-16T19:41:55.033618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:22.281259+0000","scrub_duration":0.00153554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:59.133351+0000","last_change":"2023-10-16T19:41:59.133421+0000","last_active":"2023-10-16T19:41:59.133351+0000","last_peered":"2023-10-16T19:41:59.133351+0000","last_clean":"2023-10-16T19:41:59.133351+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:59.133351+0000","last_undegraded":"2023-10-16T19:41:59.133351+0000","last_fullsized":"2023-10-16T19:41:59.133351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:59.133200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:59.133200+0000","last_clean_scrub_stamp":"2023-10-16T19:41:59.133200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:31:15.960259+0000","scrub_duration":0.0017418889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:53.871596+0000","last_change":"2023-10-16T19:41:53.871643+0000","last_active":"2023-10-16T19:41:53.871596+0000","last_peered":"2023-10-16T19:41:53.871596+0000","last_clean":"2023-10-16T19:41:53.871596+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:53.871596+0000","last_undegraded":"2023-10-16T19:41:53.871596+0000","last_fullsized":"2023-10-16T19:41:53.871596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:53.871498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:53.871498+0000","last_clean_scrub_stamp":"2023-10-16T19:41:53.871498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:14.344317+0000","scrub_duration":0.0020676140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850355+0000","last_change":"2023-10-16T19:41:07.773223+0000","last_active":"2023-10-16T19:41:40.850355+0000","last_peered":"2023-10-16T19:41:40.850355+0000","last_clean":"2023-10-16T19:41:40.850355+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:41:40.850355+0000","last_undegraded":"2023-10-16T19:41:40.850355+0000","last_fullsized":"2023-10-16T19:41:40.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689194+0000","last_change":"2023-10-16T19:41:07.774488+0000","last_active":"2023-10-16T19:41:40.689194+0000","last_peered":"2023-10-16T19:41:40.689194+0000","last_clean":"2023-10-16T19:41:40.689194+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:41:40.689194+0000","last_undegraded":"2023-10-16T19:41:40.689194+0000","last_fullsized":"2023-10-16T19:41:40.689194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.021389+0000","last_change":"2023-10-16T19:42:02.021433+0000","last_active":"2023-10-16T19:42:02.021389+0000","last_peered":"2023-10-16T19:42:02.021389+0000","last_clean":"2023-10-16T19:42:02.021389+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:42:02.021389+0000","last_undegraded":"2023-10-16T19:42:02.021389+0000","last_fullsized":"2023-10-16T19:42:02.021389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.021287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.021287+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.021287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:34.537919+0000","scrub_duration":0.0022118810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:03.169699+0000","last_change":"2023-10-16T19:42:03.169747+0000","last_active":"2023-10-16T19:42:03.169699+0000","last_peered":"2023-10-16T19:42:03.169699+0000","last_clean":"2023-10-16T19:42:03.169699+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:42:03.169699+0000","last_undegraded":"2023-10-16T19:42:03.169699+0000","last_fullsized":"2023-10-16T19:42:03.169699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:03.169611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:03.169611+0000","last_clean_scrub_stamp":"2023-10-16T19:42:03.169611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:35.709946+0000","scrub_duration":0.0021629819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204682+0000","last_change":"2023-10-16T19:41:39.424899+0000","last_active":"2023-10-16T19:41:41.204682+0000","last_peered":"2023-10-16T19:41:41.204682+0000","last_clean":"2023-10-16T19:41:41.204682+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:41.204682+0000","last_undegraded":"2023-10-16T19:41:41.204682+0000","last_fullsized":"2023-10-16T19:41:41.204682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.424752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:04.441642+0000","scrub_duration":0.0021646320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.112052+0000","last_change":"2023-10-16T19:41:57.112128+0000","last_active":"2023-10-16T19:41:57.112052+0000","last_peered":"2023-10-16T19:41:57.112052+0000","last_clean":"2023-10-16T19:41:57.112052+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:57.112052+0000","last_undegraded":"2023-10-16T19:41:57.112052+0000","last_fullsized":"2023-10-16T19:41:57.112052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.111942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.111942+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.111942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:45.690599+0000","scrub_duration":0.0018859619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:56.894998+0000","last_change":"2023-10-16T19:41:56.895054+0000","last_active":"2023-10-16T19:41:56.894998+0000","last_peered":"2023-10-16T19:41:56.894998+0000","last_clean":"2023-10-16T19:41:56.894998+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:56.894998+0000","last_undegraded":"2023-10-16T19:41:56.894998+0000","last_fullsized":"2023-10-16T19:41:56.894998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:56.894897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:56.894897+0000","last_clean_scrub_stamp":"2023-10-16T19:41:56.894897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:20.354990+0000","scrub_duration":0.0023078159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.122358+0000","last_change":"2023-10-16T19:42:00.122432+0000","last_active":"2023-10-16T19:42:00.122358+0000","last_peered":"2023-10-16T19:42:00.122358+0000","last_clean":"2023-10-16T19:42:00.122358+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:42:00.122358+0000","last_undegraded":"2023-10-16T19:42:00.122358+0000","last_fullsized":"2023-10-16T19:42:00.122358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.122219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.122219+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.122219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:51.339139+0000","scrub_duration":0.0021405220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:52.105799+0000","last_change":"2023-10-16T19:41:52.105846+0000","last_active":"2023-10-16T19:41:52.105799+0000","last_peered":"2023-10-16T19:41:52.105799+0000","last_clean":"2023-10-16T19:41:52.105799+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:52.105799+0000","last_undegraded":"2023-10-16T19:41:52.105799+0000","last_fullsized":"2023-10-16T19:41:52.105799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:52.105711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:52.105711+0000","last_clean_scrub_stamp":"2023-10-16T19:41:52.105711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:56.030990+0000","scrub_duration":0.001835988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.466343+0000","last_change":"2023-10-16T19:41:44.466397+0000","last_active":"2023-10-16T19:41:44.466343+0000","last_peered":"2023-10-16T19:41:44.466343+0000","last_clean":"2023-10-16T19:41:44.466343+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:44.466343+0000","last_undegraded":"2023-10-16T19:41:44.466343+0000","last_fullsized":"2023-10-16T19:41:44.466343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.466248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:56:07.937480+0000","scrub_duration":0.0019996940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.380727+0000","last_change":"2023-10-16T19:41:43.380778+0000","last_active":"2023-10-16T19:41:43.380727+0000","last_peered":"2023-10-16T19:41:43.380727+0000","last_clean":"2023-10-16T19:41:43.380727+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:43.380727+0000","last_undegraded":"2023-10-16T19:41:43.380727+0000","last_fullsized":"2023-10-16T19:41:43.380727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.380637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:39.199515+0000","scrub_duration":0.0016328530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.487590+0000","last_change":"2023-10-16T19:41:49.487637+0000","last_active":"2023-10-16T19:41:49.487590+0000","last_peered":"2023-10-16T19:41:49.487590+0000","last_clean":"2023-10-16T19:41:49.487590+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:49.487590+0000","last_undegraded":"2023-10-16T19:41:49.487590+0000","last_fullsized":"2023-10-16T19:41:49.487590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:49.487487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:49.487487+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.487487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:22.056826+0000","scrub_duration":0.001710879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"41'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.210712+0000","last_change":"2023-10-16T19:41:41.210712+0000","last_active":"2023-10-16T19:41:41.210712+0000","last_peered":"2023-10-16T19:41:41.210712+0000","last_clean":"2023-10-16T19:41:41.210712+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:41.210712+0000","last_undegraded":"2023-10-16T19:41:41.210712+0000","last_fullsized":"2023-10-16T19:41:41.210712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'6","last_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_deep_scrub":"41'6","last_deep_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.210537+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:53.124209+0000","scrub_duration":0.0037256020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204257+0000","last_change":"2023-10-16T19:41:38.438093+0000","last_active":"2023-10-16T19:41:41.204257+0000","last_peered":"2023-10-16T19:41:41.204257+0000","last_clean":"2023-10-16T19:41:41.204257+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:41.204257+0000","last_undegraded":"2023-10-16T19:41:41.204257+0000","last_fullsized":"2023-10-16T19:41:41.204257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.437940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:10.954572+0000","scrub_duration":0.002000309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203329+0000","last_change":"2023-10-16T19:41:32.035790+0000","last_active":"2023-10-16T19:41:41.203329+0000","last_peered":"2023-10-16T19:41:41.203329+0000","last_clean":"2023-10-16T19:41:41.203329+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:41.203329+0000","last_undegraded":"2023-10-16T19:41:41.203329+0000","last_fullsized":"2023-10-16T19:41:41.203329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.035616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:20.614273+0000","scrub_duration":0.0022946379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850758+0000","last_change":"2023-10-16T19:41:07.752025+0000","last_active":"2023-10-16T19:41:40.850758+0000","last_peered":"2023-10-16T19:41:40.850758+0000","last_clean":"2023-10-16T19:41:40.850758+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:41:40.850758+0000","last_undegraded":"2023-10-16T19:41:40.850758+0000","last_fullsized":"2023-10-16T19:41:40.850758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204448+0000","last_change":"2023-10-16T19:41:32.432168+0000","last_active":"2023-10-16T19:41:41.204448+0000","last_peered":"2023-10-16T19:41:41.204448+0000","last_clean":"2023-10-16T19:41:41.204448+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:41.204448+0000","last_undegraded":"2023-10-16T19:41:41.204448+0000","last_fullsized":"2023-10-16T19:41:41.204448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.432006+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:38.982254+0000","scrub_duration":0.0022757319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.477648+0000","last_change":"2023-10-16T19:41:49.477704+0000","last_active":"2023-10-16T19:41:49.477648+0000","last_peered":"2023-10-16T19:41:49.477648+0000","last_clean":"2023-10-16T19:41:49.477648+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:49.477648+0000","last_undegraded":"2023-10-16T19:41:49.477648+0000","last_fullsized":"2023-10-16T19:41:49.477648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:49.477545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:49.477545+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.477545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:16:02.664963+0000","scrub_duration":0.0018905510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.072514+0000","last_change":"2023-10-16T19:41:43.072571+0000","last_active":"2023-10-16T19:41:43.072514+0000","last_peered":"2023-10-16T19:41:43.072514+0000","last_clean":"2023-10-16T19:41:43.072514+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:43.072514+0000","last_undegraded":"2023-10-16T19:41:43.072514+0000","last_fullsized":"2023-10-16T19:41:43.072514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.072401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:58.808051+0000","scrub_duration":0.0037554989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.073002+0000","last_change":"2023-10-16T19:41:48.073043+0000","last_active":"2023-10-16T19:41:48.073002+0000","last_peered":"2023-10-16T19:41:48.073002+0000","last_clean":"2023-10-16T19:41:48.073002+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:48.073002+0000","last_undegraded":"2023-10-16T19:41:48.073002+0000","last_fullsized":"2023-10-16T19:41:48.073002+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.072922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.072922+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.072922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:05.022464+0000","scrub_duration":0.001209094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203471+0000","last_change":"2023-10-16T19:41:26.798802+0000","last_active":"2023-10-16T19:41:41.203471+0000","last_peered":"2023-10-16T19:41:41.203471+0000","last_clean":"2023-10-16T19:41:41.203471+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:41.203471+0000","last_undegraded":"2023-10-16T19:41:41.203471+0000","last_fullsized":"2023-10-16T19:41:41.203471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.798653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:38.064241+0000","scrub_duration":0.001787713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.892163+0000","last_change":"2023-10-16T19:41:44.892234+0000","last_active":"2023-10-16T19:41:44.892163+0000","last_peered":"2023-10-16T19:41:44.892163+0000","last_clean":"2023-10-16T19:41:44.892163+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:44.892163+0000","last_undegraded":"2023-10-16T19:41:44.892163+0000","last_fullsized":"2023-10-16T19:41:44.892163+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.892065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:08:04.319315+0000","scrub_duration":0.002070302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689354+0000","last_change":"2023-10-16T19:41:37.399738+0000","last_active":"2023-10-16T19:41:40.689354+0000","last_peered":"2023-10-16T19:41:40.689354+0000","last_clean":"2023-10-16T19:41:40.689354+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:40.689354+0000","last_undegraded":"2023-10-16T19:41:40.689354+0000","last_fullsized":"2023-10-16T19:41:40.689354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.399584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:33.218462+0000","scrub_duration":0.001624889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.955018+0000","last_change":"2023-10-16T19:42:00.955088+0000","last_active":"2023-10-16T19:42:00.955018+0000","last_peered":"2023-10-16T19:42:00.955018+0000","last_clean":"2023-10-16T19:42:00.955018+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:42:00.955018+0000","last_undegraded":"2023-10-16T19:42:00.955018+0000","last_fullsized":"2023-10-16T19:42:00.955018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.954886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.954886+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.954886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:39.331483+0000","scrub_duration":0.0016068370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203361+0000","last_change":"2023-10-16T19:41:24.416785+0000","last_active":"2023-10-16T19:41:41.203361+0000","last_peered":"2023-10-16T19:41:41.203361+0000","last_clean":"2023-10-16T19:41:41.203361+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:41.203361+0000","last_undegraded":"2023-10-16T19:41:41.203361+0000","last_fullsized":"2023-10-16T19:41:41.203361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_clean_scrub_stamp":"2023-10-16T19:41:24.416675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:21.105171+0000","scrub_duration":0.001987988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.497073+0000","last_change":"2023-10-16T19:41:46.497121+0000","last_active":"2023-10-16T19:41:46.497073+0000","last_peered":"2023-10-16T19:41:46.497073+0000","last_clean":"2023-10-16T19:41:46.497073+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:46.497073+0000","last_undegraded":"2023-10-16T19:41:46.497073+0000","last_fullsized":"2023-10-16T19:41:46.497073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.496971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.496971+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.496971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:31.986679+0000","scrub_duration":0.0019075019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850360+0000","last_change":"2023-10-16T19:41:28.074502+0000","last_active":"2023-10-16T19:41:40.850360+0000","last_peered":"2023-10-16T19:41:40.850360+0000","last_clean":"2023-10-16T19:41:40.850360+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:40.850360+0000","last_undegraded":"2023-10-16T19:41:40.850360+0000","last_fullsized":"2023-10-16T19:41:40.850360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.074317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:38.834029+0000","scrub_duration":0.001624524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204579+0000","last_change":"2023-10-16T19:41:07.761550+0000","last_active":"2023-10-16T19:41:41.204579+0000","last_peered":"2023-10-16T19:41:41.204579+0000","last_clean":"2023-10-16T19:41:41.204579+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:41:41.204579+0000","last_undegraded":"2023-10-16T19:41:41.204579+0000","last_fullsized":"2023-10-16T19:41:41.204579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689832+0000","last_change":"2023-10-16T19:41:32.439032+0000","last_active":"2023-10-16T19:41:40.689832+0000","last_peered":"2023-10-16T19:41:40.689832+0000","last_clean":"2023-10-16T19:41:40.689832+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:40.689832+0000","last_undegraded":"2023-10-16T19:41:40.689832+0000","last_fullsized":"2023-10-16T19:41:40.689832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.438870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:11.870902+0000","scrub_duration":0.0014613199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:04.441376+0000","last_change":"2023-10-16T19:42:04.441425+0000","last_active":"2023-10-16T19:42:04.441376+0000","last_peered":"2023-10-16T19:42:04.441376+0000","last_clean":"2023-10-16T19:42:04.441376+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:42:04.441376+0000","last_undegraded":"2023-10-16T19:42:04.441376+0000","last_fullsized":"2023-10-16T19:42:04.441376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:04.441262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:04.441262+0000","last_clean_scrub_stamp":"2023-10-16T19:42:04.441262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:26.411760+0000","scrub_duration":0.001601849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.859226+0000","last_change":"2023-10-16T19:41:41.859297+0000","last_active":"2023-10-16T19:41:41.859226+0000","last_peered":"2023-10-16T19:41:41.859226+0000","last_clean":"2023-10-16T19:41:41.859226+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:41.859226+0000","last_undegraded":"2023-10-16T19:41:41.859226+0000","last_fullsized":"2023-10-16T19:41:41.859226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.291141+0000","scrub_duration":0.0025848989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:47.076746+0000","last_change":"2023-10-16T19:41:47.076812+0000","last_active":"2023-10-16T19:41:47.076746+0000","last_peered":"2023-10-16T19:41:47.076746+0000","last_clean":"2023-10-16T19:41:47.076746+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:47.076746+0000","last_undegraded":"2023-10-16T19:41:47.076746+0000","last_fullsized":"2023-10-16T19:41:47.076746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:47.076618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:47.076618+0000","last_clean_scrub_stamp":"2023-10-16T19:41:47.076618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:26.508650+0000","scrub_duration":0.0018728270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203873+0000","last_change":"2023-10-16T19:41:34.813937+0000","last_active":"2023-10-16T19:41:41.203873+0000","last_peered":"2023-10-16T19:41:41.203873+0000","last_clean":"2023-10-16T19:41:41.203873+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:41.203873+0000","last_undegraded":"2023-10-16T19:41:41.203873+0000","last_fullsized":"2023-10-16T19:41:41.203873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.813765+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:26.030685+0000","scrub_duration":0.0026970840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850842+0000","last_change":"2023-10-16T19:41:07.772618+0000","last_active":"2023-10-16T19:41:40.850842+0000","last_peered":"2023-10-16T19:41:40.850842+0000","last_clean":"2023-10-16T19:41:40.850842+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:41:40.850842+0000","last_undegraded":"2023-10-16T19:41:40.850842+0000","last_fullsized":"2023-10-16T19:41:40.850842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:06.729245+0000","last_clean_scrub_stamp":"2023-10-16T19:41:06.729245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689468+0000","last_change":"2023-10-16T19:41:26.265248+0000","last_active":"2023-10-16T19:41:40.689468+0000","last_peered":"2023-10-16T19:41:40.689468+0000","last_clean":"2023-10-16T19:41:40.689468+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:40.689468+0000","last_undegraded":"2023-10-16T19:41:40.689468+0000","last_fullsized":"2023-10-16T19:41:40.689468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.265088+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:17.482008+0000","scrub_duration":0.0027794270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:54.012185+0000","last_change":"2023-10-16T19:41:54.012269+0000","last_active":"2023-10-16T19:41:54.012185+0000","last_peered":"2023-10-16T19:41:54.012185+0000","last_clean":"2023-10-16T19:41:54.012185+0000","last_became_active":"2023-10-16T19:41:41.698445+0000","last_became_peered":"2023-10-16T19:41:41.698445+0000","last_unstale":"2023-10-16T19:41:54.012185+0000","last_undegraded":"2023-10-16T19:41:54.012185+0000","last_fullsized":"2023-10-16T19:41:54.012185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:54.012077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:54.012077+0000","last_clean_scrub_stamp":"2023-10-16T19:41:54.012077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:30:38.031506+0000","scrub_duration":0.00163741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689358+0000","last_change":"2023-10-16T19:41:31.405513+0000","last_active":"2023-10-16T19:41:40.689358+0000","last_peered":"2023-10-16T19:41:40.689358+0000","last_clean":"2023-10-16T19:41:40.689358+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:40.689358+0000","last_undegraded":"2023-10-16T19:41:40.689358+0000","last_fullsized":"2023-10-16T19:41:40.689358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.405339+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:09.781936+0000","scrub_duration":0.002339828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689131+0000","last_change":"2023-10-16T19:41:34.498969+0000","last_active":"2023-10-16T19:41:40.689131+0000","last_peered":"2023-10-16T19:41:40.689131+0000","last_clean":"2023-10-16T19:41:40.689131+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:40.689131+0000","last_undegraded":"2023-10-16T19:41:40.689131+0000","last_fullsized":"2023-10-16T19:41:40.689131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.498811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:07:53.926061+0000","scrub_duration":0.0015560299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203581+0000","last_change":"2023-10-16T19:41:29.397336+0000","last_active":"2023-10-16T19:41:41.203581+0000","last_peered":"2023-10-16T19:41:41.203581+0000","last_clean":"2023-10-16T19:41:41.203581+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:41.203581+0000","last_undegraded":"2023-10-16T19:41:41.203581+0000","last_fullsized":"2023-10-16T19:41:41.203581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.397178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:31.388581+0000","scrub_duration":0.002123893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.479388+0000","last_change":"2023-10-16T19:41:46.479454+0000","last_active":"2023-10-16T19:41:46.479388+0000","last_peered":"2023-10-16T19:41:46.479388+0000","last_clean":"2023-10-16T19:41:46.479388+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:46.479388+0000","last_undegraded":"2023-10-16T19:41:46.479388+0000","last_fullsized":"2023-10-16T19:41:46.479388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.479293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.479293+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.479293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:08:05.906543+0000","scrub_duration":0.0019026780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689712+0000","last_change":"2023-10-16T19:41:35.144062+0000","last_active":"2023-10-16T19:41:40.689712+0000","last_peered":"2023-10-16T19:41:40.689712+0000","last_clean":"2023-10-16T19:41:40.689712+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:40.689712+0000","last_undegraded":"2023-10-16T19:41:40.689712+0000","last_fullsized":"2023-10-16T19:41:40.689712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.143921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:31.832417+0000","scrub_duration":0.001607083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.521694+0000","last_change":"2023-10-16T19:41:45.521762+0000","last_active":"2023-10-16T19:41:45.521694+0000","last_peered":"2023-10-16T19:41:45.521694+0000","last_clean":"2023-10-16T19:41:45.521694+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:45.521694+0000","last_undegraded":"2023-10-16T19:41:45.521694+0000","last_fullsized":"2023-10-16T19:41:45.521694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.521556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:05.994374+0000","scrub_duration":0.001605558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689314+0000","last_change":"2023-10-16T19:41:32.365943+0000","last_active":"2023-10-16T19:41:40.689314+0000","last_peered":"2023-10-16T19:41:40.689314+0000","last_clean":"2023-10-16T19:41:40.689314+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:40.689314+0000","last_undegraded":"2023-10-16T19:41:40.689314+0000","last_fullsized":"2023-10-16T19:41:40.689314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.365731+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:33:57.382620+0000","scrub_duration":0.0025667099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:50.486899+0000","last_change":"2023-10-16T19:41:50.486969+0000","last_active":"2023-10-16T19:41:50.486899+0000","last_peered":"2023-10-16T19:41:50.486899+0000","last_clean":"2023-10-16T19:41:50.486899+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:50.486899+0000","last_undegraded":"2023-10-16T19:41:50.486899+0000","last_fullsized":"2023-10-16T19:41:50.486899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:50.486767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:50.486767+0000","last_clean_scrub_stamp":"2023-10-16T19:41:50.486767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:20:58.317288+0000","scrub_duration":0.0019452829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203892+0000","last_change":"2023-10-16T19:41:39.819129+0000","last_active":"2023-10-16T19:41:41.203892+0000","last_peered":"2023-10-16T19:41:41.203892+0000","last_clean":"2023-10-16T19:41:41.203892+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:41.203892+0000","last_undegraded":"2023-10-16T19:41:41.203892+0000","last_fullsized":"2023-10-16T19:41:41.203892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.818988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:12.359324+0000","scrub_duration":0.003109541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.955813+0000","last_change":"2023-10-16T19:42:02.955872+0000","last_active":"2023-10-16T19:42:02.955813+0000","last_peered":"2023-10-16T19:42:02.955813+0000","last_clean":"2023-10-16T19:42:02.955813+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:42:02.955813+0000","last_undegraded":"2023-10-16T19:42:02.955813+0000","last_fullsized":"2023-10-16T19:42:02.955813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.955714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.955714+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.955714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:54.032005+0000","scrub_duration":0.0020691199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.097262+0000","last_change":"2023-10-16T19:41:44.097334+0000","last_active":"2023-10-16T19:41:44.097262+0000","last_peered":"2023-10-16T19:41:44.097262+0000","last_clean":"2023-10-16T19:41:44.097262+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:44.097262+0000","last_undegraded":"2023-10-16T19:41:44.097262+0000","last_fullsized":"2023-10-16T19:41:44.097262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.097170+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:16.613802+0000","scrub_duration":0.0033001850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.013168+0000","last_change":"2023-10-16T19:41:57.013220+0000","last_active":"2023-10-16T19:41:57.013168+0000","last_peered":"2023-10-16T19:41:57.013168+0000","last_clean":"2023-10-16T19:41:57.013168+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:57.013168+0000","last_undegraded":"2023-10-16T19:41:57.013168+0000","last_fullsized":"2023-10-16T19:41:57.013168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.013086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.013086+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.013086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:29.553422+0000","scrub_duration":0.001869405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.174572+0000","last_change":"2023-10-16T19:41:46.174660+0000","last_active":"2023-10-16T19:41:46.174572+0000","last_peered":"2023-10-16T19:41:46.174572+0000","last_clean":"2023-10-16T19:41:46.174572+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:46.174572+0000","last_undegraded":"2023-10-16T19:41:46.174572+0000","last_fullsized":"2023-10-16T19:41:46.174572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2023-10-16T19:41:46.174463+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2023-10-16T19:41:46.174463+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.174463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:47.229878+0000","scrub_duration":0.00334776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.010700+0000","last_change":"2023-10-16T19:42:00.010747+0000","last_active":"2023-10-16T19:42:00.010700+0000","last_peered":"2023-10-16T19:42:00.010700+0000","last_clean":"2023-10-16T19:42:00.010700+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:42:00.010700+0000","last_undegraded":"2023-10-16T19:42:00.010700+0000","last_fullsized":"2023-10-16T19:42:00.010700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.010590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.010590+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.010590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:13.036422+0000","scrub_duration":0.0015924769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203944+0000","last_change":"2023-10-16T19:41:28.359470+0000","last_active":"2023-10-16T19:41:41.203944+0000","last_peered":"2023-10-16T19:41:41.203944+0000","last_clean":"2023-10-16T19:41:41.203944+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:41.203944+0000","last_undegraded":"2023-10-16T19:41:41.203944+0000","last_fullsized":"2023-10-16T19:41:41.203944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.359320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:40.272993+0000","scrub_duration":0.001874943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.506730+0000","last_change":"2023-10-16T19:41:45.506800+0000","last_active":"2023-10-16T19:41:45.506730+0000","last_peered":"2023-10-16T19:41:45.506730+0000","last_clean":"2023-10-16T19:41:45.506730+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:45.506730+0000","last_undegraded":"2023-10-16T19:41:45.506730+0000","last_fullsized":"2023-10-16T19:41:45.506730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.506600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:51:54.174118+0000","scrub_duration":0.0021900819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:50.075151+0000","last_change":"2023-10-16T19:41:50.075239+0000","last_active":"2023-10-16T19:41:50.075151+0000","last_peered":"2023-10-16T19:41:50.075151+0000","last_clean":"2023-10-16T19:41:50.075151+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:50.075151+0000","last_undegraded":"2023-10-16T19:41:50.075151+0000","last_fullsized":"2023-10-16T19:41:50.075151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:50.075049+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:50.075049+0000","last_clean_scrub_stamp":"2023-10-16T19:41:50.075049+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:38.447205+0000","scrub_duration":0.0033427270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203075+0000","last_change":"2023-10-16T19:41:37.991413+0000","last_active":"2023-10-16T19:41:41.203075+0000","last_peered":"2023-10-16T19:41:41.203075+0000","last_clean":"2023-10-16T19:41:41.203075+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:41.203075+0000","last_undegraded":"2023-10-16T19:41:41.203075+0000","last_fullsized":"2023-10-16T19:41:41.203075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.991268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:03.514348+0000","scrub_duration":0.0019647050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.151371+0000","last_change":"2023-10-16T19:41:45.151421+0000","last_active":"2023-10-16T19:41:45.151371+0000","last_peered":"2023-10-16T19:41:45.151371+0000","last_clean":"2023-10-16T19:41:45.151371+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:45.151371+0000","last_undegraded":"2023-10-16T19:41:45.151371+0000","last_fullsized":"2023-10-16T19:41:45.151371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.151281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:39.157471+0000","scrub_duration":0.0019257510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.859845+0000","last_change":"2023-10-16T19:41:46.859927+0000","last_active":"2023-10-16T19:41:46.859845+0000","last_peered":"2023-10-16T19:41:46.859845+0000","last_clean":"2023-10-16T19:41:46.859845+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:46.859845+0000","last_undegraded":"2023-10-16T19:41:46.859845+0000","last_fullsized":"2023-10-16T19:41:46.859845+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.859709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.859709+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.859709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:19.429048+0000","scrub_duration":0.00162306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689285+0000","last_change":"2023-10-16T19:41:34.344641+0000","last_active":"2023-10-16T19:41:40.689285+0000","last_peered":"2023-10-16T19:41:40.689285+0000","last_clean":"2023-10-16T19:41:40.689285+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:40.689285+0000","last_undegraded":"2023-10-16T19:41:40.689285+0000","last_fullsized":"2023-10-16T19:41:40.689285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.344482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:00:12.314887+0000","scrub_duration":0.0016727179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.476588+0000","last_change":"2023-10-16T19:41:41.476588+0000","last_active":"2023-10-16T19:41:41.476588+0000","last_peered":"2023-10-16T19:41:41.476588+0000","last_clean":"2023-10-16T19:41:41.476588+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:41.476588+0000","last_undegraded":"2023-10-16T19:41:41.476588+0000","last_fullsized":"2023-10-16T19:41:41.476588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.476462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:13.370623+0000","scrub_duration":0.0020194219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204062+0000","last_change":"2023-10-16T19:41:33.039261+0000","last_active":"2023-10-16T19:41:41.204062+0000","last_peered":"2023-10-16T19:41:41.204062+0000","last_clean":"2023-10-16T19:41:41.204062+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:41.204062+0000","last_undegraded":"2023-10-16T19:41:41.204062+0000","last_fullsized":"2023-10-16T19:41:41.204062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.039106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:12.030925+0000","scrub_duration":0.001540869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.394202+0000","last_change":"2023-10-16T19:41:41.394202+0000","last_active":"2023-10-16T19:41:41.394202+0000","last_peered":"2023-10-16T19:41:41.394202+0000","last_clean":"2023-10-16T19:41:41.394202+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:41.394202+0000","last_undegraded":"2023-10-16T19:41:41.394202+0000","last_fullsized":"2023-10-16T19:41:41.394202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.394045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:58.221103+0000","scrub_duration":0.0021463179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203900+0000","last_change":"2023-10-16T19:41:40.835813+0000","last_active":"2023-10-16T19:41:41.203900+0000","last_peered":"2023-10-16T19:41:41.203900+0000","last_clean":"2023-10-16T19:41:41.203900+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:41.203900+0000","last_undegraded":"2023-10-16T19:41:41.203900+0000","last_fullsized":"2023-10-16T19:41:41.203900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.835600+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:29.874255+0000","scrub_duration":0.0042860880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:47.455540+0000","last_change":"2023-10-16T19:41:47.455598+0000","last_active":"2023-10-16T19:41:47.455540+0000","last_peered":"2023-10-16T19:41:47.455540+0000","last_clean":"2023-10-16T19:41:47.455540+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:47.455540+0000","last_undegraded":"2023-10-16T19:41:47.455540+0000","last_fullsized":"2023-10-16T19:41:47.455540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:47.455432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:47.455432+0000","last_clean_scrub_stamp":"2023-10-16T19:41:47.455432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:36:52.777131+0000","scrub_duration":0.001809913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"42'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.087897+0000","last_change":"2023-10-16T19:41:49.087953+0000","last_active":"2023-10-16T19:41:49.087897+0000","last_peered":"2023-10-16T19:41:49.087897+0000","last_clean":"2023-10-16T19:41:49.087897+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:49.087897+0000","last_undegraded":"2023-10-16T19:41:49.087897+0000","last_fullsized":"2023-10-16T19:41:49.087897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2023-10-16T19:41:49.087801+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2023-10-16T19:41:49.087801+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.087801+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.847513+0000","scrub_duration":0.0033824969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689628+0000","last_change":"2023-10-16T19:41:38.463191+0000","last_active":"2023-10-16T19:41:40.689628+0000","last_peered":"2023-10-16T19:41:40.689628+0000","last_clean":"2023-10-16T19:41:40.689628+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:40.689628+0000","last_undegraded":"2023-10-16T19:41:40.689628+0000","last_fullsized":"2023-10-16T19:41:40.689628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.463035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:11.032374+0000","scrub_duration":0.0018809720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203321+0000","last_change":"2023-10-16T19:41:31.031202+0000","last_active":"2023-10-16T19:41:41.203321+0000","last_peered":"2023-10-16T19:41:41.203321+0000","last_clean":"2023-10-16T19:41:41.203321+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:41.203321+0000","last_undegraded":"2023-10-16T19:41:41.203321+0000","last_fullsized":"2023-10-16T19:41:41.203321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.031043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:46.766692+0000","scrub_duration":0.001647171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:53.020913+0000","last_change":"2023-10-16T19:41:53.020995+0000","last_active":"2023-10-16T19:41:53.020913+0000","last_peered":"2023-10-16T19:41:53.020913+0000","last_clean":"2023-10-16T19:41:53.020913+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:53.020913+0000","last_undegraded":"2023-10-16T19:41:53.020913+0000","last_fullsized":"2023-10-16T19:41:53.020913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:53.020796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:53.020796+0000","last_clean_scrub_stamp":"2023-10-16T19:41:53.020796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:36:58.342494+0000","scrub_duration":0.001640922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203418+0000","last_change":"2023-10-16T19:41:26.949224+0000","last_active":"2023-10-16T19:41:41.203418+0000","last_peered":"2023-10-16T19:41:41.203418+0000","last_clean":"2023-10-16T19:41:41.203418+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:41.203418+0000","last_undegraded":"2023-10-16T19:41:41.203418+0000","last_fullsized":"2023-10-16T19:41:41.203418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.949056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:33.499304+0000","scrub_duration":0.001636935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203266+0000","last_change":"2023-10-16T19:41:35.404620+0000","last_active":"2023-10-16T19:41:41.203266+0000","last_peered":"2023-10-16T19:41:41.203266+0000","last_clean":"2023-10-16T19:41:41.203266+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:41.203266+0000","last_undegraded":"2023-10-16T19:41:41.203266+0000","last_fullsized":"2023-10-16T19:41:41.203266+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.404463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:51.140112+0000","scrub_duration":0.001879155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.154699+0000","last_change":"2023-10-16T19:41:48.154782+0000","last_active":"2023-10-16T19:41:48.154699+0000","last_peered":"2023-10-16T19:41:48.154699+0000","last_clean":"2023-10-16T19:41:48.154699+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:48.154699+0000","last_undegraded":"2023-10-16T19:41:48.154699+0000","last_fullsized":"2023-10-16T19:41:48.154699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.154578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.154578+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.154578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:15.402220+0000","scrub_duration":0.0021881040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.155820+0000","last_change":"2023-10-16T19:41:48.155880+0000","last_active":"2023-10-16T19:41:48.155820+0000","last_peered":"2023-10-16T19:41:48.155820+0000","last_clean":"2023-10-16T19:41:48.155820+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:48.155820+0000","last_undegraded":"2023-10-16T19:41:48.155820+0000","last_fullsized":"2023-10-16T19:41:48.155820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.155727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.155727+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.155727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:13.678807+0000","scrub_duration":0.001325927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850326+0000","last_change":"2023-10-16T19:41:33.055184+0000","last_active":"2023-10-16T19:41:40.850326+0000","last_peered":"2023-10-16T19:41:40.850326+0000","last_clean":"2023-10-16T19:41:40.850326+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:40.850326+0000","last_undegraded":"2023-10-16T19:41:40.850326+0000","last_fullsized":"2023-10-16T19:41:40.850326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.055042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:45.001071+0000","scrub_duration":0.0020577270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:58.422380+0000","last_change":"2023-10-16T19:41:58.422430+0000","last_active":"2023-10-16T19:41:58.422380+0000","last_peered":"2023-10-16T19:41:58.422380+0000","last_clean":"2023-10-16T19:41:58.422380+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:58.422380+0000","last_undegraded":"2023-10-16T19:41:58.422380+0000","last_fullsized":"2023-10-16T19:41:58.422380+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:58.422277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:58.422277+0000","last_clean_scrub_stamp":"2023-10-16T19:41:58.422277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:37.176731+0000","scrub_duration":0.001530478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689032+0000","last_change":"2023-10-16T19:41:29.348081+0000","last_active":"2023-10-16T19:41:40.689032+0000","last_peered":"2023-10-16T19:41:40.689032+0000","last_clean":"2023-10-16T19:41:40.689032+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:40.689032+0000","last_undegraded":"2023-10-16T19:41:40.689032+0000","last_fullsized":"2023-10-16T19:41:40.689032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.347858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:01.888194+0000","scrub_duration":0.0017072509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:52.873674+0000","last_change":"2023-10-16T19:41:52.873724+0000","last_active":"2023-10-16T19:41:52.873674+0000","last_peered":"2023-10-16T19:41:52.873674+0000","last_clean":"2023-10-16T19:41:52.873674+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:52.873674+0000","last_undegraded":"2023-10-16T19:41:52.873674+0000","last_fullsized":"2023-10-16T19:41:52.873674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:52.873573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:52.873573+0000","last_clean_scrub_stamp":"2023-10-16T19:41:52.873573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:24.767734+0000","scrub_duration":0.0019564399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689481+0000","last_change":"2023-10-16T19:41:38.353018+0000","last_active":"2023-10-16T19:41:40.689481+0000","last_peered":"2023-10-16T19:41:40.689481+0000","last_clean":"2023-10-16T19:41:40.689481+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:40.689481+0000","last_undegraded":"2023-10-16T19:41:40.689481+0000","last_fullsized":"2023-10-16T19:41:40.689481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.352810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:10.893146+0000","scrub_duration":0.0020448939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"40'119","reported_seq":196,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:42.167420+0000","last_change":"2023-10-16T19:41:29.433686+0000","last_active":"2023-10-16T19:41:42.167420+0000","last_peered":"2023-10-16T19:41:42.167420+0000","last_clean":"2023-10-16T19:41:42.167420+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:42.167420+0000","last_undegraded":"2023-10-16T19:41:42.167420+0000","last_fullsized":"2023-10-16T19:41:42.167420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'119","last_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_deep_scrub":"40'119","last_deep_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.433479+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:01.950112+0000","scrub_duration":0.0052109569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1097728,"data_stored":804226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89900000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78700000000000003,"5min":0.879,"15min":0.879},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.44700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.47099999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.62},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0920000000000001,"5min":1.208,"15min":1.208},"last":0.65600000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":1.157,"15min":1.157},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.82799999999999996,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":1.113,"15min":1.1970000000000001},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80900000000000005,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.63}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.749},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":1.046,"15min":1.046},"last":0.81399999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79700000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.505},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.45000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":1.329,"15min":1.329},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.625},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.878,"5min":1.111,"15min":1.111},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.85599999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.51500000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.353,"15min":1.353},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.83899999999999997,"15min":0.91500000000000004},"min":{"1min":0.26300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.63400000000000001,"5min":10.465,"15min":10.465},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.245,"15min":0.245},"max":{"1min":0.53600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.0600000000000001,"15min":1.1579999999999999},"min":{"1min":0.32600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":14.497,"15min":14.497},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":1.1579999999999999,"15min":1.28},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61699999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97799999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.748}]},{"osd":5,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.325,"15min":1.4319999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":0.89300000000000002},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.004,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.3240000000000001,"15min":1.431},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":16.192,"15min":16.192},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.85399999999999998,"15min":0.88400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96699999999999997,"5min":5.258,"15min":5.258},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":1.3460000000000001,"15min":1.454},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98999999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.76100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1085440,"data_stored":802578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.432,"15min":0.44},"min":{"1min":0.252,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.46800000000000003,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54200000000000004,"5min":1.54,"15min":1.54},"last":0.45800000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.41299999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56000000000000005,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61499999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.36899999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.876,"5min":1.667,"15min":1.667},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94599999999999995,"5min":1.619,"15min":1.619},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91500000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82699999999999996,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.502,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52800000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.49099999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.622,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.438},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46999999999999997}]},{"osd":7,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":213822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40400000000000003,"15min":0.40799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.49399999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.748},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.749},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82399999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.624,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90800000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70399999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.86799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.87,"15min":0.87},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.98199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51300000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.97499999999999998,"15min":1.0389999999999999},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76200000000000001,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63400000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.97999999999999998,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75600000000000001,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.755,"15min":0.755},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":1.046,"15min":1.046},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84699999999999998,"5min":0.879,"15min":0.879},"last":0.74199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.752,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73299999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.629},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.749},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.84299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78200000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:42:08.009 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.009 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.010 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.010 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.011 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.011 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.012 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-16T19:41:06.729245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=41, tm_sec=21, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:42:08.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:42:27.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:27.584 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:28.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:42:28.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.151+0000 7fd5cdd1c700 1 Processor -- start 2023-10-16T19:42:28.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.151+0000 7fd5cdd1c700 1 -- start start 2023-10-16T19:42:28.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5cdd1c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5c8153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5cdd1c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5c80c7bb0 0x7fd5c8070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5cdd1c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80bd0e0 con 0x7fd5c8070ac0 2023-10-16T19:42:28.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5cdd1c700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80c3000 con 0x7fd5c80c7bb0 2023-10-16T19:42:28.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5cdd1c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c5330 con 0x7fd5c80c4f50 2023-10-16T19:42:28.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5c7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd5c8070ac0 0x7fd5c8155e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39552/0 (socket says 172.21.15.29:39552) 2023-10-16T19:42:28.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.152+0000 7fd5c7fff700 1 -- 172.21.15.29:0/99703515 learned_addr learned my addr 172.21.15.29:0/99703515 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:42:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c6ffd700 1 --2- 172.21.15.29:0/99703515 >> v2:172.21.15.53:3300/0 conn(0x7fd5c80c7bb0 0x7fd5c8070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c77fe700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5c8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052049681 0 0) 0x7fd5c80bd0e0 con 0x7fd5c8070ac0 2023-10-16T19:42:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b40035b0 con 0x7fd5c8070ac0 2023-10-16T19:42:28.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 831678342 0 0) 0x7fd5b40035b0 con 0x7fd5c8070ac0 2023-10-16T19:42:28.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 msgr2=0x7fd5c8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5c8153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 >> v2:172.21.15.53:3300/0 conn(0x7fd5c80c7bb0 msgr2=0x7fd5c8070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 --2- 172.21.15.29:0/99703515 >> v2:172.21.15.53:3300/0 conn(0x7fd5c80c7bb0 0x7fd5c8070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80c2a40 con 0x7fd5c8070ac0 2023-10-16T19:42:28.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1260348052 0 0) 0x7fd5c00019f0 con 0x7fd5c8070ac0 2023-10-16T19:42:28.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 >> v1:172.21.15.29:6789/0 conn(0x7fd5c8070ac0 legacy=0x7fd5c8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5b4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4003f80 0x7fd5b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5b4004d90 0x7fd5b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c3000 con 0x7fd5b4004d90 2023-10-16T19:42:28.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c5330 con 0x7fd5b4003f80 2023-10-16T19:42:28.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b400ba10 con 0x7fd5c80c4f50 2023-10-16T19:42:28.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5b4004d90 0x7fd5b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c77fe700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5b4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c6ffd700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4003f80 0x7fd5b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 -- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 msgr2=0x7fd5b4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c4f50 0x7fd5b4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 -- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4003f80 msgr2=0x7fd5b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4003f80 0x7fd5b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.153+0000 7fd5c7fff700 1 -- 172.21.15.29:0/99703515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b40035b0 con 0x7fd5b4004d90 2023-10-16T19:42:28.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5b4004d90 0x7fd5b4005210 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000a860 tx=0x7fd5b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168a2dd639665c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012600 con 0x7fd5b4004d90 2023-10-16T19:42:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c0012780 con 0x7fd5b4004d90 2023-10-16T19:42:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5c67fc700 1 -- 172.21.15.29:0/99703515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012b30 con 0x7fd5b4004d90 2023-10-16T19:42:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/99703515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5b4004d90 msgr2=0x7fd5b4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/99703515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5b4004d90 0x7fd5b4005210 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000a860 tx=0x7fd5b4005880 comp rx=0 tx=0).stop 2023-10-16T19:42:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5c7fff700 1 -- 172.21.15.29:0/99703515 reap_dead start 2023-10-16T19:42:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/99703515 shutdown_connections 2023-10-16T19:42:28.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/99703515 >> 172.21.15.29:0/99703515 conn(0x7fd5c80a9cd0 msgr2=0x7fd5c80aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/99703515 shutdown_connections 2023-10-16T19:42:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.154+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/99703515 wait complete. 2023-10-16T19:42:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 Processor -- start 2023-10-16T19:42:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 -- start start 2023-10-16T19:42:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4004d90 0x7fd5c80abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c1e20 0x7fd5c8154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c10f0 con 0x7fd5c80c1510 2023-10-16T19:42:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8145200 con 0x7fd5b4004d90 2023-10-16T19:42:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.156+0000 7fd5cdd1c700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e8570 con 0x7fd5c80c1e20 2023-10-16T19:42:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54122/0 (socket says 172.21.15.29:54122) 2023-10-16T19:42:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 -- 172.21.15.29:0/4121365589 learned_addr learned my addr 172.21.15.29:0/4121365589 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c77fe700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4004d90 0x7fd5c80abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c6ffd700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c1e20 0x7fd5c8154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 -- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c1e20 msgr2=0x7fd5c8154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c1e20 0x7fd5c8154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 -- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4004d90 msgr2=0x7fd5c80abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4004d90 0x7fd5c80abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 -- 172.21.15.29:0/4121365589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80c0a30 con 0x7fd5c80c1510 2023-10-16T19:42:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5c7fff700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0012000 tx=0x7fd5c0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c001e600 con 0x7fd5c80c1510 2023-10-16T19:42:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c001e780 con 0x7fd5c80c1510 2023-10-16T19:42:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c001eb30 con 0x7fd5c80c1510 2023-10-16T19:42:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c80c0d10 con 0x7fd5c80c1510 2023-10-16T19:42:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.157+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c81e8850 con 0x7fd5c80c1510 2023-10-16T19:42:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.158+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c804f400 con 0x7fd5c80c1510 2023-10-16T19:42:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.159+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd5c0019030 con 0x7fd5c80c1510 2023-10-16T19:42:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.159+0000 7fd5bffff700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 0x7fd5a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.160+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6078+0+0 (secure 0 0 0) 0x7fd5c008b380 con 0x7fd5c80c1510 2023-10-16T19:42:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.160+0000 7fd5c77fe700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 0x7fd5a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.160+0000 7fd5c77fe700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 0x7fd5a806d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009c60 tx=0x7fd5b8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.164+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5c0056410 con 0x7fd5c80c1510 2023-10-16T19:42:28.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.363+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 --> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5c80bd380 con 0x7fd5a806af00 2023-10-16T19:42:28.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.372+0000 7fd5bffff700 1 -- 172.21.15.29:0/4121365589 <== mgr.4099 v2:172.21.15.53:6832/2936749946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290707 (secure 0 0 0) 0x7fd5b8019070 con 0x7fd5a806af00 2023-10-16T19:42:28.378 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:42:28.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 msgr2=0x7fd5a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 0x7fd5a806d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009c60 tx=0x7fd5b8009210 comp rx=0 tx=0).stop 2023-10-16T19:42:28.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 msgr2=0x7fd5c81562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0012000 tx=0x7fd5c0001d80 comp rx=0 tx=0).stop 2023-10-16T19:42:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 shutdown_connections 2023-10-16T19:42:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7fd5a806af00 0x7fd5a806d3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80c1510 0x7fd5c81562a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b4004d90 0x7fd5c80abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 --2- 172.21.15.29:0/4121365589 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd5c80c1e20 0x7fd5c8154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 >> 172.21.15.29:0/4121365589 conn(0x7fd5c80a9cd0 msgr2=0x7fd5c80c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 shutdown_connections 2023-10-16T19:42:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.376+0000 7fd5cdd1c700 1 -- 172.21.15.29:0/4121365589 wait complete. 2023-10-16T19:42:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-16T19:42:28.390 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-10-16T19:42:26.596096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5152768,"data_stored":2882964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003120"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.504572+0000","last_change":"2023-10-16T19:41:48.504620+0000","last_active":"2023-10-16T19:41:48.504572+0000","last_peered":"2023-10-16T19:41:48.504572+0000","last_clean":"2023-10-16T19:41:48.504572+0000","last_became_active":"2023-10-16T19:41:07.755046+0000","last_became_peered":"2023-10-16T19:41:07.755046+0000","last_unstale":"2023-10-16T19:41:48.504572+0000","last_undegraded":"2023-10-16T19:41:48.504572+0000","last_fullsized":"2023-10-16T19:41:48.504572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.504480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.504480+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.504480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:50:55.351581+0000","scrub_duration":0.001303963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689621+0000","last_change":"2023-10-16T19:41:37.432770+0000","last_active":"2023-10-16T19:41:40.689621+0000","last_peered":"2023-10-16T19:41:40.689621+0000","last_clean":"2023-10-16T19:41:40.689621+0000","last_became_active":"2023-10-16T19:41:07.770016+0000","last_became_peered":"2023-10-16T19:41:07.770016+0000","last_unstale":"2023-10-16T19:41:40.689621+0000","last_undegraded":"2023-10-16T19:41:40.689621+0000","last_fullsized":"2023-10-16T19:41:40.689621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.432607+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.432607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:45:58.851261+0000","scrub_duration":0.001589827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:55.059577+0000","last_change":"2023-10-16T19:41:55.059653+0000","last_active":"2023-10-16T19:41:55.059577+0000","last_peered":"2023-10-16T19:41:55.059577+0000","last_clean":"2023-10-16T19:41:55.059577+0000","last_became_active":"2023-10-16T19:41:07.770441+0000","last_became_peered":"2023-10-16T19:41:07.770441+0000","last_unstale":"2023-10-16T19:41:55.059577+0000","last_undegraded":"2023-10-16T19:41:55.059577+0000","last_fullsized":"2023-10-16T19:41:55.059577+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:55.059468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:55.059468+0000","last_clean_scrub_stamp":"2023-10-16T19:41:55.059468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:18:23.028350+0000","scrub_duration":0.0021066399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.952446+0000","last_change":"2023-10-16T19:41:57.952495+0000","last_active":"2023-10-16T19:41:57.952446+0000","last_peered":"2023-10-16T19:41:57.952446+0000","last_clean":"2023-10-16T19:41:57.952446+0000","last_became_active":"2023-10-16T19:41:07.761247+0000","last_became_peered":"2023-10-16T19:41:07.761247+0000","last_unstale":"2023-10-16T19:41:57.952446+0000","last_undegraded":"2023-10-16T19:41:57.952446+0000","last_fullsized":"2023-10-16T19:41:57.952446+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.952337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.952337+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.952337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:51.111641+0000","scrub_duration":0.001819088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:03.031336+0000","last_change":"2023-10-16T19:42:03.031384+0000","last_active":"2023-10-16T19:42:03.031336+0000","last_peered":"2023-10-16T19:42:03.031336+0000","last_clean":"2023-10-16T19:42:03.031336+0000","last_became_active":"2023-10-16T19:41:07.758872+0000","last_became_peered":"2023-10-16T19:41:07.758872+0000","last_unstale":"2023-10-16T19:42:03.031336+0000","last_undegraded":"2023-10-16T19:42:03.031336+0000","last_fullsized":"2023-10-16T19:42:03.031336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:03.031239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:03.031239+0000","last_clean_scrub_stamp":"2023-10-16T19:42:03.031239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:28.048129+0000","scrub_duration":0.0021445869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.454527+0000","last_change":"2023-10-16T19:41:46.454576+0000","last_active":"2023-10-16T19:41:46.454527+0000","last_peered":"2023-10-16T19:41:46.454527+0000","last_clean":"2023-10-16T19:41:46.454527+0000","last_became_active":"2023-10-16T19:41:07.762949+0000","last_became_peered":"2023-10-16T19:41:07.762949+0000","last_unstale":"2023-10-16T19:41:46.454527+0000","last_undegraded":"2023-10-16T19:41:46.454527+0000","last_fullsized":"2023-10-16T19:41:46.454527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.454417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.454417+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.454417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:35.493072+0000","scrub_duration":0.0015396330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:42.819585+0000","last_change":"2023-10-16T19:41:42.819641+0000","last_active":"2023-10-16T19:41:42.819585+0000","last_peered":"2023-10-16T19:41:42.819585+0000","last_clean":"2023-10-16T19:41:42.819585+0000","last_became_active":"2023-10-16T19:41:07.764533+0000","last_became_peered":"2023-10-16T19:41:07.764533+0000","last_unstale":"2023-10-16T19:41:42.819585+0000","last_undegraded":"2023-10-16T19:41:42.819585+0000","last_fullsized":"2023-10-16T19:41:42.819585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:42.819483+0000","last_clean_scrub_stamp":"2023-10-16T19:41:42.819483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:25:02.979210+0000","scrub_duration":0.0019850570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.688960+0000","last_change":"2023-10-16T19:41:33.469584+0000","last_active":"2023-10-16T19:41:40.688960+0000","last_peered":"2023-10-16T19:41:40.688960+0000","last_clean":"2023-10-16T19:41:40.688960+0000","last_became_active":"2023-10-16T19:41:07.766372+0000","last_became_peered":"2023-10-16T19:41:07.766372+0000","last_unstale":"2023-10-16T19:41:40.688960+0000","last_undegraded":"2023-10-16T19:41:40.688960+0000","last_fullsized":"2023-10-16T19:41:40.688960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.469436+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.469436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:24:53.629164+0000","scrub_duration":0.001807835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203491+0000","last_change":"2023-10-16T19:41:40.998502+0000","last_active":"2023-10-16T19:41:41.203491+0000","last_peered":"2023-10-16T19:41:41.203491+0000","last_clean":"2023-10-16T19:41:41.203491+0000","last_became_active":"2023-10-16T19:41:07.767583+0000","last_became_peered":"2023-10-16T19:41:07.767583+0000","last_unstale":"2023-10-16T19:41:41.203491+0000","last_undegraded":"2023-10-16T19:41:41.203491+0000","last_fullsized":"2023-10-16T19:41:41.203491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:40.998308+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.998308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:36.817186+0000","scrub_duration":0.002136102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.881678+0000","last_change":"2023-10-16T19:41:57.881729+0000","last_active":"2023-10-16T19:41:57.881678+0000","last_peered":"2023-10-16T19:41:57.881678+0000","last_clean":"2023-10-16T19:41:57.881678+0000","last_became_active":"2023-10-16T19:41:07.765172+0000","last_became_peered":"2023-10-16T19:41:07.765172+0000","last_unstale":"2023-10-16T19:41:57.881678+0000","last_undegraded":"2023-10-16T19:41:57.881678+0000","last_fullsized":"2023-10-16T19:41:57.881678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.881575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.881575+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.881575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:47:00.547554+0000","scrub_duration":0.00162159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:05.893960+0000","last_change":"2023-10-16T19:42:05.894016+0000","last_active":"2023-10-16T19:42:05.893960+0000","last_peered":"2023-10-16T19:42:05.893960+0000","last_clean":"2023-10-16T19:42:05.893960+0000","last_became_active":"2023-10-16T19:41:07.769755+0000","last_became_peered":"2023-10-16T19:41:07.769755+0000","last_unstale":"2023-10-16T19:42:05.893960+0000","last_undegraded":"2023-10-16T19:42:05.893960+0000","last_fullsized":"2023-10-16T19:42:05.893960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:05.893842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:05.893842+0000","last_clean_scrub_stamp":"2023-10-16T19:42:05.893842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:20.441365+0000","scrub_duration":0.0017110999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.028371+0000","last_change":"2023-10-16T19:41:46.028456+0000","last_active":"2023-10-16T19:41:46.028371+0000","last_peered":"2023-10-16T19:41:46.028371+0000","last_clean":"2023-10-16T19:41:46.028371+0000","last_became_active":"2023-10-16T19:41:07.763673+0000","last_became_peered":"2023-10-16T19:41:07.763673+0000","last_unstale":"2023-10-16T19:41:46.028371+0000","last_undegraded":"2023-10-16T19:41:46.028371+0000","last_fullsized":"2023-10-16T19:41:46.028371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.028259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.028259+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.028259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:35.066913+0000","scrub_duration":0.001461452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:54.858984+0000","last_change":"2023-10-16T19:41:54.859039+0000","last_active":"2023-10-16T19:41:54.858984+0000","last_peered":"2023-10-16T19:41:54.858984+0000","last_clean":"2023-10-16T19:41:54.858984+0000","last_became_active":"2023-10-16T19:41:07.766685+0000","last_became_peered":"2023-10-16T19:41:07.766685+0000","last_unstale":"2023-10-16T19:41:54.858984+0000","last_undegraded":"2023-10-16T19:41:54.858984+0000","last_fullsized":"2023-10-16T19:41:54.858984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:54.858870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:54.858870+0000","last_clean_scrub_stamp":"2023-10-16T19:41:54.858870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:44.878933+0000","scrub_duration":0.0015857860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:09.898963+0000","last_change":"2023-10-16T19:42:09.899009+0000","last_active":"2023-10-16T19:42:09.898963+0000","last_peered":"2023-10-16T19:42:09.898963+0000","last_clean":"2023-10-16T19:42:09.898963+0000","last_became_active":"2023-10-16T19:41:07.751381+0000","last_became_peered":"2023-10-16T19:41:07.751381+0000","last_unstale":"2023-10-16T19:42:09.898963+0000","last_undegraded":"2023-10-16T19:42:09.898963+0000","last_fullsized":"2023-10-16T19:42:09.898963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:09.898854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:09.898854+0000","last_clean_scrub_stamp":"2023-10-16T19:42:09.898854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:26.848396+0000","scrub_duration":0.0015123490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.896297+0000","last_change":"2023-10-16T19:41:45.896345+0000","last_active":"2023-10-16T19:41:45.896297+0000","last_peered":"2023-10-16T19:41:45.896297+0000","last_clean":"2023-10-16T19:41:45.896297+0000","last_became_active":"2023-10-16T19:41:07.770206+0000","last_became_peered":"2023-10-16T19:41:07.770206+0000","last_unstale":"2023-10-16T19:41:45.896297+0000","last_undegraded":"2023-10-16T19:41:45.896297+0000","last_fullsized":"2023-10-16T19:41:45.896297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.896203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.896203+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.896203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:07.314856+0000","scrub_duration":0.002060596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.421640+0000","last_change":"2023-10-16T19:42:02.421713+0000","last_active":"2023-10-16T19:42:02.421640+0000","last_peered":"2023-10-16T19:42:02.421640+0000","last_clean":"2023-10-16T19:42:02.421640+0000","last_became_active":"2023-10-16T19:41:07.767121+0000","last_became_peered":"2023-10-16T19:41:07.767121+0000","last_unstale":"2023-10-16T19:42:02.421640+0000","last_undegraded":"2023-10-16T19:42:02.421640+0000","last_fullsized":"2023-10-16T19:42:02.421640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.421513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.421513+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.421513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:52.441576+0000","scrub_duration":0.0016558320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:56.425774+0000","last_change":"2023-10-16T19:41:56.425821+0000","last_active":"2023-10-16T19:41:56.425774+0000","last_peered":"2023-10-16T19:41:56.425774+0000","last_clean":"2023-10-16T19:41:56.425774+0000","last_became_active":"2023-10-16T19:41:07.773542+0000","last_became_peered":"2023-10-16T19:41:07.773542+0000","last_unstale":"2023-10-16T19:41:56.425774+0000","last_undegraded":"2023-10-16T19:41:56.425774+0000","last_fullsized":"2023-10-16T19:41:56.425774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:56.425672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:56.425672+0000","last_clean_scrub_stamp":"2023-10-16T19:41:56.425672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:28.319833+0000","scrub_duration":0.0016027979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:58.149131+0000","last_change":"2023-10-16T19:41:58.149181+0000","last_active":"2023-10-16T19:41:58.149131+0000","last_peered":"2023-10-16T19:41:58.149131+0000","last_clean":"2023-10-16T19:41:58.149131+0000","last_became_active":"2023-10-16T19:41:07.751660+0000","last_became_peered":"2023-10-16T19:41:07.751660+0000","last_unstale":"2023-10-16T19:41:58.149131+0000","last_undegraded":"2023-10-16T19:41:58.149131+0000","last_fullsized":"2023-10-16T19:41:58.149131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:58.149045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:58.149045+0000","last_clean_scrub_stamp":"2023-10-16T19:41:58.149045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:23.165934+0000","scrub_duration":0.001625797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:55.033725+0000","last_change":"2023-10-16T19:41:55.033773+0000","last_active":"2023-10-16T19:41:55.033725+0000","last_peered":"2023-10-16T19:41:55.033725+0000","last_clean":"2023-10-16T19:41:55.033725+0000","last_became_active":"2023-10-16T19:41:07.755761+0000","last_became_peered":"2023-10-16T19:41:07.755761+0000","last_unstale":"2023-10-16T19:41:55.033725+0000","last_undegraded":"2023-10-16T19:41:55.033725+0000","last_fullsized":"2023-10-16T19:41:55.033725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:55.033618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:55.033618+0000","last_clean_scrub_stamp":"2023-10-16T19:41:55.033618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:22.281259+0000","scrub_duration":0.00153554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:59.133351+0000","last_change":"2023-10-16T19:41:59.133421+0000","last_active":"2023-10-16T19:41:59.133351+0000","last_peered":"2023-10-16T19:41:59.133351+0000","last_clean":"2023-10-16T19:41:59.133351+0000","last_became_active":"2023-10-16T19:41:07.755662+0000","last_became_peered":"2023-10-16T19:41:07.755662+0000","last_unstale":"2023-10-16T19:41:59.133351+0000","last_undegraded":"2023-10-16T19:41:59.133351+0000","last_fullsized":"2023-10-16T19:41:59.133351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:59.133200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:59.133200+0000","last_clean_scrub_stamp":"2023-10-16T19:41:59.133200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:31:15.960259+0000","scrub_duration":0.0017418889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:53.871596+0000","last_change":"2023-10-16T19:41:53.871643+0000","last_active":"2023-10-16T19:41:53.871596+0000","last_peered":"2023-10-16T19:41:53.871596+0000","last_clean":"2023-10-16T19:41:53.871596+0000","last_became_active":"2023-10-16T19:41:07.765227+0000","last_became_peered":"2023-10-16T19:41:07.765227+0000","last_unstale":"2023-10-16T19:41:53.871596+0000","last_undegraded":"2023-10-16T19:41:53.871596+0000","last_fullsized":"2023-10-16T19:41:53.871596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:53.871498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:53.871498+0000","last_clean_scrub_stamp":"2023-10-16T19:41:53.871498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:14.344317+0000","scrub_duration":0.0020676140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:14.903853+0000","last_change":"2023-10-16T19:42:14.903944+0000","last_active":"2023-10-16T19:42:14.903853+0000","last_peered":"2023-10-16T19:42:14.903853+0000","last_clean":"2023-10-16T19:42:14.903853+0000","last_became_active":"2023-10-16T19:41:07.772959+0000","last_became_peered":"2023-10-16T19:41:07.772959+0000","last_unstale":"2023-10-16T19:42:14.903853+0000","last_undegraded":"2023-10-16T19:42:14.903853+0000","last_fullsized":"2023-10-16T19:42:14.903853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:14.903730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:14.903730+0000","last_clean_scrub_stamp":"2023-10-16T19:42:14.903730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:30:58.923160+0000","scrub_duration":0.0021994380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:06.410118+0000","last_change":"2023-10-16T19:42:06.410162+0000","last_active":"2023-10-16T19:42:06.410118+0000","last_peered":"2023-10-16T19:42:06.410118+0000","last_clean":"2023-10-16T19:42:06.410118+0000","last_became_active":"2023-10-16T19:41:07.774203+0000","last_became_peered":"2023-10-16T19:41:07.774203+0000","last_unstale":"2023-10-16T19:42:06.410118+0000","last_undegraded":"2023-10-16T19:42:06.410118+0000","last_fullsized":"2023-10-16T19:42:06.410118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:06.410019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:06.410019+0000","last_clean_scrub_stamp":"2023-10-16T19:42:06.410019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:16:19.597437+0000","scrub_duration":0.001867409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.021389+0000","last_change":"2023-10-16T19:42:02.021433+0000","last_active":"2023-10-16T19:42:02.021389+0000","last_peered":"2023-10-16T19:42:02.021389+0000","last_clean":"2023-10-16T19:42:02.021389+0000","last_became_active":"2023-10-16T19:41:07.759795+0000","last_became_peered":"2023-10-16T19:41:07.759795+0000","last_unstale":"2023-10-16T19:42:02.021389+0000","last_undegraded":"2023-10-16T19:42:02.021389+0000","last_fullsized":"2023-10-16T19:42:02.021389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.021287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.021287+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.021287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:34.537919+0000","scrub_duration":0.0022118810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:03.169699+0000","last_change":"2023-10-16T19:42:03.169747+0000","last_active":"2023-10-16T19:42:03.169699+0000","last_peered":"2023-10-16T19:42:03.169699+0000","last_clean":"2023-10-16T19:42:03.169699+0000","last_became_active":"2023-10-16T19:41:07.759552+0000","last_became_peered":"2023-10-16T19:41:07.759552+0000","last_unstale":"2023-10-16T19:42:03.169699+0000","last_undegraded":"2023-10-16T19:42:03.169699+0000","last_fullsized":"2023-10-16T19:42:03.169699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:03.169611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:03.169611+0000","last_clean_scrub_stamp":"2023-10-16T19:42:03.169611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:35.709946+0000","scrub_duration":0.0021629819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204682+0000","last_change":"2023-10-16T19:41:39.424899+0000","last_active":"2023-10-16T19:41:41.204682+0000","last_peered":"2023-10-16T19:41:41.204682+0000","last_clean":"2023-10-16T19:41:41.204682+0000","last_became_active":"2023-10-16T19:41:07.766224+0000","last_became_peered":"2023-10-16T19:41:07.766224+0000","last_unstale":"2023-10-16T19:41:41.204682+0000","last_undegraded":"2023-10-16T19:41:41.204682+0000","last_fullsized":"2023-10-16T19:41:41.204682+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:39.424752+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.424752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:04.441642+0000","scrub_duration":0.0021646320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.112052+0000","last_change":"2023-10-16T19:41:57.112128+0000","last_active":"2023-10-16T19:41:57.112052+0000","last_peered":"2023-10-16T19:41:57.112052+0000","last_clean":"2023-10-16T19:41:57.112052+0000","last_became_active":"2023-10-16T19:41:07.771112+0000","last_became_peered":"2023-10-16T19:41:07.771112+0000","last_unstale":"2023-10-16T19:41:57.112052+0000","last_undegraded":"2023-10-16T19:41:57.112052+0000","last_fullsized":"2023-10-16T19:41:57.112052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.111942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.111942+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.111942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:45.690599+0000","scrub_duration":0.0018859619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:56.894998+0000","last_change":"2023-10-16T19:41:56.895054+0000","last_active":"2023-10-16T19:41:56.894998+0000","last_peered":"2023-10-16T19:41:56.894998+0000","last_clean":"2023-10-16T19:41:56.894998+0000","last_became_active":"2023-10-16T19:41:07.764897+0000","last_became_peered":"2023-10-16T19:41:07.764897+0000","last_unstale":"2023-10-16T19:41:56.894998+0000","last_undegraded":"2023-10-16T19:41:56.894998+0000","last_fullsized":"2023-10-16T19:41:56.894998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:56.894897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:56.894897+0000","last_clean_scrub_stamp":"2023-10-16T19:41:56.894897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:20.354990+0000","scrub_duration":0.0023078159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.122358+0000","last_change":"2023-10-16T19:42:00.122432+0000","last_active":"2023-10-16T19:42:00.122358+0000","last_peered":"2023-10-16T19:42:00.122358+0000","last_clean":"2023-10-16T19:42:00.122358+0000","last_became_active":"2023-10-16T19:41:07.756127+0000","last_became_peered":"2023-10-16T19:41:07.756127+0000","last_unstale":"2023-10-16T19:42:00.122358+0000","last_undegraded":"2023-10-16T19:42:00.122358+0000","last_fullsized":"2023-10-16T19:42:00.122358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.122219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.122219+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.122219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:51.339139+0000","scrub_duration":0.0021405220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:52.105799+0000","last_change":"2023-10-16T19:41:52.105846+0000","last_active":"2023-10-16T19:41:52.105799+0000","last_peered":"2023-10-16T19:41:52.105799+0000","last_clean":"2023-10-16T19:41:52.105799+0000","last_became_active":"2023-10-16T19:41:07.749749+0000","last_became_peered":"2023-10-16T19:41:07.749749+0000","last_unstale":"2023-10-16T19:41:52.105799+0000","last_undegraded":"2023-10-16T19:41:52.105799+0000","last_fullsized":"2023-10-16T19:41:52.105799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:52.105711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:52.105711+0000","last_clean_scrub_stamp":"2023-10-16T19:41:52.105711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:56.030990+0000","scrub_duration":0.001835988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.466343+0000","last_change":"2023-10-16T19:41:44.466397+0000","last_active":"2023-10-16T19:41:44.466343+0000","last_peered":"2023-10-16T19:41:44.466343+0000","last_clean":"2023-10-16T19:41:44.466343+0000","last_became_active":"2023-10-16T19:41:07.773067+0000","last_became_peered":"2023-10-16T19:41:07.773067+0000","last_unstale":"2023-10-16T19:41:44.466343+0000","last_undegraded":"2023-10-16T19:41:44.466343+0000","last_fullsized":"2023-10-16T19:41:44.466343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.466248+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.466248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:56:07.937480+0000","scrub_duration":0.0019996940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.380727+0000","last_change":"2023-10-16T19:41:43.380778+0000","last_active":"2023-10-16T19:41:43.380727+0000","last_peered":"2023-10-16T19:41:43.380727+0000","last_clean":"2023-10-16T19:41:43.380727+0000","last_became_active":"2023-10-16T19:41:07.763867+0000","last_became_peered":"2023-10-16T19:41:07.763867+0000","last_unstale":"2023-10-16T19:41:43.380727+0000","last_undegraded":"2023-10-16T19:41:43.380727+0000","last_fullsized":"2023-10-16T19:41:43.380727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:43.380637+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.380637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:39.199515+0000","scrub_duration":0.0016328530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.487590+0000","last_change":"2023-10-16T19:41:49.487637+0000","last_active":"2023-10-16T19:41:49.487590+0000","last_peered":"2023-10-16T19:41:49.487590+0000","last_clean":"2023-10-16T19:41:49.487590+0000","last_became_active":"2023-10-16T19:41:07.765985+0000","last_became_peered":"2023-10-16T19:41:07.765985+0000","last_unstale":"2023-10-16T19:41:49.487590+0000","last_undegraded":"2023-10-16T19:41:49.487590+0000","last_fullsized":"2023-10-16T19:41:49.487590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:49.487487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:49.487487+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.487487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:22.056826+0000","scrub_duration":0.001710879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"41'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.210712+0000","last_change":"2023-10-16T19:41:41.210712+0000","last_active":"2023-10-16T19:41:41.210712+0000","last_peered":"2023-10-16T19:41:41.210712+0000","last_clean":"2023-10-16T19:41:41.210712+0000","last_became_active":"2023-10-16T19:41:06.755025+0000","last_became_peered":"2023-10-16T19:41:06.755025+0000","last_unstale":"2023-10-16T19:41:41.210712+0000","last_undegraded":"2023-10-16T19:41:41.210712+0000","last_fullsized":"2023-10-16T19:41:41.210712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'6","last_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_deep_scrub":"41'6","last_deep_scrub_stamp":"2023-10-16T19:41:41.210537+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.210537+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:53.124209+0000","scrub_duration":0.0037256020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204257+0000","last_change":"2023-10-16T19:41:38.438093+0000","last_active":"2023-10-16T19:41:41.204257+0000","last_peered":"2023-10-16T19:41:41.204257+0000","last_clean":"2023-10-16T19:41:41.204257+0000","last_became_active":"2023-10-16T19:41:07.769985+0000","last_became_peered":"2023-10-16T19:41:07.769985+0000","last_unstale":"2023-10-16T19:41:41.204257+0000","last_undegraded":"2023-10-16T19:41:41.204257+0000","last_fullsized":"2023-10-16T19:41:41.204257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.437940+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.437940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:10.954572+0000","scrub_duration":0.002000309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203329+0000","last_change":"2023-10-16T19:41:32.035790+0000","last_active":"2023-10-16T19:41:41.203329+0000","last_peered":"2023-10-16T19:41:41.203329+0000","last_clean":"2023-10-16T19:41:41.203329+0000","last_became_active":"2023-10-16T19:41:06.757617+0000","last_became_peered":"2023-10-16T19:41:06.757617+0000","last_unstale":"2023-10-16T19:41:41.203329+0000","last_undegraded":"2023-10-16T19:41:41.203329+0000","last_fullsized":"2023-10-16T19:41:41.203329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:32.035616+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.035616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:20.614273+0000","scrub_duration":0.0022946379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:11.944268+0000","last_change":"2023-10-16T19:42:11.944316+0000","last_active":"2023-10-16T19:42:11.944268+0000","last_peered":"2023-10-16T19:42:11.944268+0000","last_clean":"2023-10-16T19:42:11.944268+0000","last_became_active":"2023-10-16T19:41:07.751727+0000","last_became_peered":"2023-10-16T19:41:07.751727+0000","last_unstale":"2023-10-16T19:42:11.944268+0000","last_undegraded":"2023-10-16T19:42:11.944268+0000","last_fullsized":"2023-10-16T19:42:11.944268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:11.944177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:11.944177+0000","last_clean_scrub_stamp":"2023-10-16T19:42:11.944177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:44.017578+0000","scrub_duration":0.001693403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204448+0000","last_change":"2023-10-16T19:41:32.432168+0000","last_active":"2023-10-16T19:41:41.204448+0000","last_peered":"2023-10-16T19:41:41.204448+0000","last_clean":"2023-10-16T19:41:41.204448+0000","last_became_active":"2023-10-16T19:41:06.752843+0000","last_became_peered":"2023-10-16T19:41:06.752843+0000","last_unstale":"2023-10-16T19:41:41.204448+0000","last_undegraded":"2023-10-16T19:41:41.204448+0000","last_fullsized":"2023-10-16T19:41:41.204448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:32.432006+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.432006+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:38.982254+0000","scrub_duration":0.0022757319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.477648+0000","last_change":"2023-10-16T19:41:49.477704+0000","last_active":"2023-10-16T19:41:49.477648+0000","last_peered":"2023-10-16T19:41:49.477648+0000","last_clean":"2023-10-16T19:41:49.477648+0000","last_became_active":"2023-10-16T19:41:07.756294+0000","last_became_peered":"2023-10-16T19:41:07.756294+0000","last_unstale":"2023-10-16T19:41:49.477648+0000","last_undegraded":"2023-10-16T19:41:49.477648+0000","last_fullsized":"2023-10-16T19:41:49.477648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:49.477545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:49.477545+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.477545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:16:02.664963+0000","scrub_duration":0.0018905510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:43.072514+0000","last_change":"2023-10-16T19:41:43.072571+0000","last_active":"2023-10-16T19:41:43.072514+0000","last_peered":"2023-10-16T19:41:43.072514+0000","last_clean":"2023-10-16T19:41:43.072514+0000","last_became_active":"2023-10-16T19:41:06.755618+0000","last_became_peered":"2023-10-16T19:41:06.755618+0000","last_unstale":"2023-10-16T19:41:43.072514+0000","last_undegraded":"2023-10-16T19:41:43.072514+0000","last_fullsized":"2023-10-16T19:41:43.072514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:43.072401+0000","last_clean_scrub_stamp":"2023-10-16T19:41:43.072401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:58.808051+0000","scrub_duration":0.0037554989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.073002+0000","last_change":"2023-10-16T19:41:48.073043+0000","last_active":"2023-10-16T19:41:48.073002+0000","last_peered":"2023-10-16T19:41:48.073002+0000","last_clean":"2023-10-16T19:41:48.073002+0000","last_became_active":"2023-10-16T19:41:07.752829+0000","last_became_peered":"2023-10-16T19:41:07.752829+0000","last_unstale":"2023-10-16T19:41:48.073002+0000","last_undegraded":"2023-10-16T19:41:48.073002+0000","last_fullsized":"2023-10-16T19:41:48.073002+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.072922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.072922+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.072922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:05.022464+0000","scrub_duration":0.001209094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203471+0000","last_change":"2023-10-16T19:41:26.798802+0000","last_active":"2023-10-16T19:41:41.203471+0000","last_peered":"2023-10-16T19:41:41.203471+0000","last_clean":"2023-10-16T19:41:41.203471+0000","last_became_active":"2023-10-16T19:41:06.757969+0000","last_became_peered":"2023-10-16T19:41:06.757969+0000","last_unstale":"2023-10-16T19:41:41.203471+0000","last_undegraded":"2023-10-16T19:41:41.203471+0000","last_fullsized":"2023-10-16T19:41:41.203471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:26.798653+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.798653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:38.064241+0000","scrub_duration":0.001787713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.892163+0000","last_change":"2023-10-16T19:41:44.892234+0000","last_active":"2023-10-16T19:41:44.892163+0000","last_peered":"2023-10-16T19:41:44.892163+0000","last_clean":"2023-10-16T19:41:44.892163+0000","last_became_active":"2023-10-16T19:41:07.766171+0000","last_became_peered":"2023-10-16T19:41:07.766171+0000","last_unstale":"2023-10-16T19:41:44.892163+0000","last_undegraded":"2023-10-16T19:41:44.892163+0000","last_fullsized":"2023-10-16T19:41:44.892163+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:44.892065+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.892065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:08:04.319315+0000","scrub_duration":0.002070302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689354+0000","last_change":"2023-10-16T19:41:37.399738+0000","last_active":"2023-10-16T19:41:40.689354+0000","last_peered":"2023-10-16T19:41:40.689354+0000","last_clean":"2023-10-16T19:41:40.689354+0000","last_became_active":"2023-10-16T19:41:06.754101+0000","last_became_peered":"2023-10-16T19:41:06.754101+0000","last_unstale":"2023-10-16T19:41:40.689354+0000","last_undegraded":"2023-10-16T19:41:40.689354+0000","last_fullsized":"2023-10-16T19:41:40.689354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-10-16T19:41:37.399584+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.399584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:33.218462+0000","scrub_duration":0.001624889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.955018+0000","last_change":"2023-10-16T19:42:00.955088+0000","last_active":"2023-10-16T19:42:00.955018+0000","last_peered":"2023-10-16T19:42:00.955018+0000","last_clean":"2023-10-16T19:42:00.955018+0000","last_became_active":"2023-10-16T19:41:07.766490+0000","last_became_peered":"2023-10-16T19:41:07.766490+0000","last_unstale":"2023-10-16T19:42:00.955018+0000","last_undegraded":"2023-10-16T19:42:00.955018+0000","last_fullsized":"2023-10-16T19:42:00.955018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.954886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.954886+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.954886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:39.331483+0000","scrub_duration":0.0016068370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203361+0000","last_change":"2023-10-16T19:41:24.416785+0000","last_active":"2023-10-16T19:41:41.203361+0000","last_peered":"2023-10-16T19:41:41.203361+0000","last_clean":"2023-10-16T19:41:41.203361+0000","last_became_active":"2023-10-16T19:41:06.753929+0000","last_became_peered":"2023-10-16T19:41:06.753929+0000","last_unstale":"2023-10-16T19:41:41.203361+0000","last_undegraded":"2023-10-16T19:41:41.203361+0000","last_fullsized":"2023-10-16T19:41:41.203361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:24.416675+0000","last_clean_scrub_stamp":"2023-10-16T19:41:24.416675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:21.105171+0000","scrub_duration":0.001987988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.497073+0000","last_change":"2023-10-16T19:41:46.497121+0000","last_active":"2023-10-16T19:41:46.497073+0000","last_peered":"2023-10-16T19:41:46.497073+0000","last_clean":"2023-10-16T19:41:46.497073+0000","last_became_active":"2023-10-16T19:41:07.759877+0000","last_became_peered":"2023-10-16T19:41:07.759877+0000","last_unstale":"2023-10-16T19:41:46.497073+0000","last_undegraded":"2023-10-16T19:41:46.497073+0000","last_fullsized":"2023-10-16T19:41:46.497073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.496971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.496971+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.496971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:31.986679+0000","scrub_duration":0.0019075019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850360+0000","last_change":"2023-10-16T19:41:28.074502+0000","last_active":"2023-10-16T19:41:40.850360+0000","last_peered":"2023-10-16T19:41:40.850360+0000","last_clean":"2023-10-16T19:41:40.850360+0000","last_became_active":"2023-10-16T19:41:06.749276+0000","last_became_peered":"2023-10-16T19:41:06.749276+0000","last_unstale":"2023-10-16T19:41:40.850360+0000","last_undegraded":"2023-10-16T19:41:40.850360+0000","last_fullsized":"2023-10-16T19:41:40.850360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.074317+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.074317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:38.834029+0000","scrub_duration":0.001624524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:15.984360+0000","last_change":"2023-10-16T19:42:15.984417+0000","last_active":"2023-10-16T19:42:15.984360+0000","last_peered":"2023-10-16T19:42:15.984360+0000","last_clean":"2023-10-16T19:42:15.984360+0000","last_became_active":"2023-10-16T19:41:07.761274+0000","last_became_peered":"2023-10-16T19:41:07.761274+0000","last_unstale":"2023-10-16T19:42:15.984360+0000","last_undegraded":"2023-10-16T19:42:15.984360+0000","last_fullsized":"2023-10-16T19:42:15.984360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:15.984272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:15.984272+0000","last_clean_scrub_stamp":"2023-10-16T19:42:15.984272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:51:00.354699+0000","scrub_duration":0.0020227790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689832+0000","last_change":"2023-10-16T19:41:32.439032+0000","last_active":"2023-10-16T19:41:40.689832+0000","last_peered":"2023-10-16T19:41:40.689832+0000","last_clean":"2023-10-16T19:41:40.689832+0000","last_became_active":"2023-10-16T19:41:06.750118+0000","last_became_peered":"2023-10-16T19:41:06.750118+0000","last_unstale":"2023-10-16T19:41:40.689832+0000","last_undegraded":"2023-10-16T19:41:40.689832+0000","last_fullsized":"2023-10-16T19:41:40.689832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:32.438870+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.438870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:11.870902+0000","scrub_duration":0.0014613199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:04.441376+0000","last_change":"2023-10-16T19:42:04.441425+0000","last_active":"2023-10-16T19:42:04.441376+0000","last_peered":"2023-10-16T19:42:04.441376+0000","last_clean":"2023-10-16T19:42:04.441376+0000","last_became_active":"2023-10-16T19:41:07.761467+0000","last_became_peered":"2023-10-16T19:41:07.761467+0000","last_unstale":"2023-10-16T19:42:04.441376+0000","last_undegraded":"2023-10-16T19:42:04.441376+0000","last_fullsized":"2023-10-16T19:42:04.441376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:04.441262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:04.441262+0000","last_clean_scrub_stamp":"2023-10-16T19:42:04.441262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:26.411760+0000","scrub_duration":0.001601849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.859226+0000","last_change":"2023-10-16T19:41:41.859297+0000","last_active":"2023-10-16T19:41:41.859226+0000","last_peered":"2023-10-16T19:41:41.859226+0000","last_clean":"2023-10-16T19:41:41.859226+0000","last_became_active":"2023-10-16T19:41:06.756011+0000","last_became_peered":"2023-10-16T19:41:06.756011+0000","last_unstale":"2023-10-16T19:41:41.859226+0000","last_undegraded":"2023-10-16T19:41:41.859226+0000","last_fullsized":"2023-10-16T19:41:41.859226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.859110+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.291141+0000","scrub_duration":0.0025848989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:47.076746+0000","last_change":"2023-10-16T19:41:47.076812+0000","last_active":"2023-10-16T19:41:47.076746+0000","last_peered":"2023-10-16T19:41:47.076746+0000","last_clean":"2023-10-16T19:41:47.076746+0000","last_became_active":"2023-10-16T19:41:07.758572+0000","last_became_peered":"2023-10-16T19:41:07.758572+0000","last_unstale":"2023-10-16T19:41:47.076746+0000","last_undegraded":"2023-10-16T19:41:47.076746+0000","last_fullsized":"2023-10-16T19:41:47.076746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:47.076618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:47.076618+0000","last_clean_scrub_stamp":"2023-10-16T19:41:47.076618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:26.508650+0000","scrub_duration":0.0018728270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203873+0000","last_change":"2023-10-16T19:41:34.813937+0000","last_active":"2023-10-16T19:41:41.203873+0000","last_peered":"2023-10-16T19:41:41.203873+0000","last_clean":"2023-10-16T19:41:41.203873+0000","last_became_active":"2023-10-16T19:41:06.753813+0000","last_became_peered":"2023-10-16T19:41:06.753813+0000","last_unstale":"2023-10-16T19:41:41.203873+0000","last_undegraded":"2023-10-16T19:41:41.203873+0000","last_fullsized":"2023-10-16T19:41:41.203873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-10-16T19:41:34.813765+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.813765+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:26.030685+0000","scrub_duration":0.0026970840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:15.880924+0000","last_change":"2023-10-16T19:42:15.880973+0000","last_active":"2023-10-16T19:42:15.880924+0000","last_peered":"2023-10-16T19:42:15.880924+0000","last_clean":"2023-10-16T19:42:15.880924+0000","last_became_active":"2023-10-16T19:41:07.772356+0000","last_became_peered":"2023-10-16T19:41:07.772356+0000","last_unstale":"2023-10-16T19:42:15.880924+0000","last_undegraded":"2023-10-16T19:42:15.880924+0000","last_fullsized":"2023-10-16T19:42:15.880924+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:15.880814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:15.880814+0000","last_clean_scrub_stamp":"2023-10-16T19:42:15.880814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:18:43.849696+0000","scrub_duration":0.0020218440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689468+0000","last_change":"2023-10-16T19:41:26.265248+0000","last_active":"2023-10-16T19:41:40.689468+0000","last_peered":"2023-10-16T19:41:40.689468+0000","last_clean":"2023-10-16T19:41:40.689468+0000","last_became_active":"2023-10-16T19:41:06.754262+0000","last_became_peered":"2023-10-16T19:41:06.754262+0000","last_unstale":"2023-10-16T19:41:40.689468+0000","last_undegraded":"2023-10-16T19:41:40.689468+0000","last_fullsized":"2023-10-16T19:41:40.689468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2023-10-16T19:41:26.265088+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.265088+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:17.482008+0000","scrub_duration":0.0027794270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:54.012185+0000","last_change":"2023-10-16T19:41:54.012269+0000","last_active":"2023-10-16T19:41:54.012185+0000","last_peered":"2023-10-16T19:41:54.012185+0000","last_clean":"2023-10-16T19:41:54.012185+0000","last_became_active":"2023-10-16T19:41:41.698445+0000","last_became_peered":"2023-10-16T19:41:41.698445+0000","last_unstale":"2023-10-16T19:41:54.012185+0000","last_undegraded":"2023-10-16T19:41:54.012185+0000","last_fullsized":"2023-10-16T19:41:54.012185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:54.012077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:54.012077+0000","last_clean_scrub_stamp":"2023-10-16T19:41:54.012077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:30:38.031506+0000","scrub_duration":0.00163741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689358+0000","last_change":"2023-10-16T19:41:31.405513+0000","last_active":"2023-10-16T19:41:40.689358+0000","last_peered":"2023-10-16T19:41:40.689358+0000","last_clean":"2023-10-16T19:41:40.689358+0000","last_became_active":"2023-10-16T19:41:06.752612+0000","last_became_peered":"2023-10-16T19:41:06.752612+0000","last_unstale":"2023-10-16T19:41:40.689358+0000","last_undegraded":"2023-10-16T19:41:40.689358+0000","last_fullsized":"2023-10-16T19:41:40.689358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2023-10-16T19:41:31.405339+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.405339+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:09.781936+0000","scrub_duration":0.002339828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689131+0000","last_change":"2023-10-16T19:41:34.498969+0000","last_active":"2023-10-16T19:41:40.689131+0000","last_peered":"2023-10-16T19:41:40.689131+0000","last_clean":"2023-10-16T19:41:40.689131+0000","last_became_active":"2023-10-16T19:41:07.753402+0000","last_became_peered":"2023-10-16T19:41:07.753402+0000","last_unstale":"2023-10-16T19:41:40.689131+0000","last_undegraded":"2023-10-16T19:41:40.689131+0000","last_fullsized":"2023-10-16T19:41:40.689131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.498811+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.498811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:07:53.926061+0000","scrub_duration":0.0015560299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203581+0000","last_change":"2023-10-16T19:41:29.397336+0000","last_active":"2023-10-16T19:41:41.203581+0000","last_peered":"2023-10-16T19:41:41.203581+0000","last_clean":"2023-10-16T19:41:41.203581+0000","last_became_active":"2023-10-16T19:41:06.753816+0000","last_became_peered":"2023-10-16T19:41:06.753816+0000","last_unstale":"2023-10-16T19:41:41.203581+0000","last_undegraded":"2023-10-16T19:41:41.203581+0000","last_fullsized":"2023-10-16T19:41:41.203581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.397178+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.397178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:19:31.388581+0000","scrub_duration":0.002123893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.479388+0000","last_change":"2023-10-16T19:41:46.479454+0000","last_active":"2023-10-16T19:41:46.479388+0000","last_peered":"2023-10-16T19:41:46.479388+0000","last_clean":"2023-10-16T19:41:46.479388+0000","last_became_active":"2023-10-16T19:41:07.773144+0000","last_became_peered":"2023-10-16T19:41:07.773144+0000","last_unstale":"2023-10-16T19:41:46.479388+0000","last_undegraded":"2023-10-16T19:41:46.479388+0000","last_fullsized":"2023-10-16T19:41:46.479388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.479293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.479293+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.479293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:08:05.906543+0000","scrub_duration":0.0019026780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689712+0000","last_change":"2023-10-16T19:41:35.144062+0000","last_active":"2023-10-16T19:41:40.689712+0000","last_peered":"2023-10-16T19:41:40.689712+0000","last_clean":"2023-10-16T19:41:40.689712+0000","last_became_active":"2023-10-16T19:41:06.755108+0000","last_became_peered":"2023-10-16T19:41:06.755108+0000","last_unstale":"2023-10-16T19:41:40.689712+0000","last_undegraded":"2023-10-16T19:41:40.689712+0000","last_fullsized":"2023-10-16T19:41:40.689712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.143921+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.143921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:10:31.832417+0000","scrub_duration":0.001607083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.521694+0000","last_change":"2023-10-16T19:41:45.521762+0000","last_active":"2023-10-16T19:41:45.521694+0000","last_peered":"2023-10-16T19:41:45.521694+0000","last_clean":"2023-10-16T19:41:45.521694+0000","last_became_active":"2023-10-16T19:41:07.753467+0000","last_became_peered":"2023-10-16T19:41:07.753467+0000","last_unstale":"2023-10-16T19:41:45.521694+0000","last_undegraded":"2023-10-16T19:41:45.521694+0000","last_fullsized":"2023-10-16T19:41:45.521694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.521556+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.521556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:01:05.994374+0000","scrub_duration":0.001605558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689314+0000","last_change":"2023-10-16T19:41:32.365943+0000","last_active":"2023-10-16T19:41:40.689314+0000","last_peered":"2023-10-16T19:41:40.689314+0000","last_clean":"2023-10-16T19:41:40.689314+0000","last_became_active":"2023-10-16T19:41:06.748493+0000","last_became_peered":"2023-10-16T19:41:06.748493+0000","last_unstale":"2023-10-16T19:41:40.689314+0000","last_undegraded":"2023-10-16T19:41:40.689314+0000","last_fullsized":"2023-10-16T19:41:40.689314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-10-16T19:41:32.365731+0000","last_clean_scrub_stamp":"2023-10-16T19:41:32.365731+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:33:57.382620+0000","scrub_duration":0.0025667099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:50.486899+0000","last_change":"2023-10-16T19:41:50.486969+0000","last_active":"2023-10-16T19:41:50.486899+0000","last_peered":"2023-10-16T19:41:50.486899+0000","last_clean":"2023-10-16T19:41:50.486899+0000","last_became_active":"2023-10-16T19:41:07.751740+0000","last_became_peered":"2023-10-16T19:41:07.751740+0000","last_unstale":"2023-10-16T19:41:50.486899+0000","last_undegraded":"2023-10-16T19:41:50.486899+0000","last_fullsized":"2023-10-16T19:41:50.486899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:50.486767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:50.486767+0000","last_clean_scrub_stamp":"2023-10-16T19:41:50.486767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:20:58.317288+0000","scrub_duration":0.0019452829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'2","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203892+0000","last_change":"2023-10-16T19:41:39.819129+0000","last_active":"2023-10-16T19:41:41.203892+0000","last_peered":"2023-10-16T19:41:41.203892+0000","last_clean":"2023-10-16T19:41:41.203892+0000","last_became_active":"2023-10-16T19:41:06.754721+0000","last_became_peered":"2023-10-16T19:41:06.754721+0000","last_unstale":"2023-10-16T19:41:41.203892+0000","last_undegraded":"2023-10-16T19:41:41.203892+0000","last_fullsized":"2023-10-16T19:41:41.203892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T19:41:39.818988+0000","last_clean_scrub_stamp":"2023-10-16T19:41:39.818988+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:12.359324+0000","scrub_duration":0.003109541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:02.955813+0000","last_change":"2023-10-16T19:42:02.955872+0000","last_active":"2023-10-16T19:42:02.955813+0000","last_peered":"2023-10-16T19:42:02.955813+0000","last_clean":"2023-10-16T19:42:02.955813+0000","last_became_active":"2023-10-16T19:41:07.769290+0000","last_became_peered":"2023-10-16T19:41:07.769290+0000","last_unstale":"2023-10-16T19:42:02.955813+0000","last_undegraded":"2023-10-16T19:42:02.955813+0000","last_fullsized":"2023-10-16T19:42:02.955813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:02.955714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:02.955714+0000","last_clean_scrub_stamp":"2023-10-16T19:42:02.955714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:54.032005+0000","scrub_duration":0.0020691199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:44.097262+0000","last_change":"2023-10-16T19:41:44.097334+0000","last_active":"2023-10-16T19:41:44.097262+0000","last_peered":"2023-10-16T19:41:44.097262+0000","last_clean":"2023-10-16T19:41:44.097262+0000","last_became_active":"2023-10-16T19:41:06.755933+0000","last_became_peered":"2023-10-16T19:41:06.755933+0000","last_unstale":"2023-10-16T19:41:44.097262+0000","last_undegraded":"2023-10-16T19:41:44.097262+0000","last_fullsized":"2023-10-16T19:41:44.097262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:44.097170+0000","last_clean_scrub_stamp":"2023-10-16T19:41:44.097170+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:16.613802+0000","scrub_duration":0.0033001850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:57.013168+0000","last_change":"2023-10-16T19:41:57.013220+0000","last_active":"2023-10-16T19:41:57.013168+0000","last_peered":"2023-10-16T19:41:57.013168+0000","last_clean":"2023-10-16T19:41:57.013168+0000","last_became_active":"2023-10-16T19:41:07.755636+0000","last_became_peered":"2023-10-16T19:41:07.755636+0000","last_unstale":"2023-10-16T19:41:57.013168+0000","last_undegraded":"2023-10-16T19:41:57.013168+0000","last_fullsized":"2023-10-16T19:41:57.013168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:57.013086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:57.013086+0000","last_clean_scrub_stamp":"2023-10-16T19:41:57.013086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:29.553422+0000","scrub_duration":0.001869405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.174572+0000","last_change":"2023-10-16T19:41:46.174660+0000","last_active":"2023-10-16T19:41:46.174572+0000","last_peered":"2023-10-16T19:41:46.174572+0000","last_clean":"2023-10-16T19:41:46.174572+0000","last_became_active":"2023-10-16T19:41:06.750731+0000","last_became_peered":"2023-10-16T19:41:06.750731+0000","last_unstale":"2023-10-16T19:41:46.174572+0000","last_undegraded":"2023-10-16T19:41:46.174572+0000","last_fullsized":"2023-10-16T19:41:46.174572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2023-10-16T19:41:46.174463+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2023-10-16T19:41:46.174463+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.174463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:02:47.229878+0000","scrub_duration":0.00334776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:42:00.010700+0000","last_change":"2023-10-16T19:42:00.010747+0000","last_active":"2023-10-16T19:42:00.010700+0000","last_peered":"2023-10-16T19:42:00.010700+0000","last_clean":"2023-10-16T19:42:00.010700+0000","last_became_active":"2023-10-16T19:41:07.759772+0000","last_became_peered":"2023-10-16T19:41:07.759772+0000","last_unstale":"2023-10-16T19:42:00.010700+0000","last_undegraded":"2023-10-16T19:42:00.010700+0000","last_fullsized":"2023-10-16T19:42:00.010700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:42:00.010590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:42:00.010590+0000","last_clean_scrub_stamp":"2023-10-16T19:42:00.010590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:13.036422+0000","scrub_duration":0.0015924769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203944+0000","last_change":"2023-10-16T19:41:28.359470+0000","last_active":"2023-10-16T19:41:41.203944+0000","last_peered":"2023-10-16T19:41:41.203944+0000","last_clean":"2023-10-16T19:41:41.203944+0000","last_became_active":"2023-10-16T19:41:06.751546+0000","last_became_peered":"2023-10-16T19:41:06.751546+0000","last_unstale":"2023-10-16T19:41:41.203944+0000","last_undegraded":"2023-10-16T19:41:41.203944+0000","last_fullsized":"2023-10-16T19:41:41.203944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:28.359320+0000","last_clean_scrub_stamp":"2023-10-16T19:41:28.359320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:26:40.272993+0000","scrub_duration":0.001874943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.506730+0000","last_change":"2023-10-16T19:41:45.506800+0000","last_active":"2023-10-16T19:41:45.506730+0000","last_peered":"2023-10-16T19:41:45.506730+0000","last_clean":"2023-10-16T19:41:45.506730+0000","last_became_active":"2023-10-16T19:41:07.773219+0000","last_became_peered":"2023-10-16T19:41:07.773219+0000","last_unstale":"2023-10-16T19:41:45.506730+0000","last_undegraded":"2023-10-16T19:41:45.506730+0000","last_fullsized":"2023-10-16T19:41:45.506730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.506600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.506600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:51:54.174118+0000","scrub_duration":0.0021900819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"42'3","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:50.075151+0000","last_change":"2023-10-16T19:41:50.075239+0000","last_active":"2023-10-16T19:41:50.075151+0000","last_peered":"2023-10-16T19:41:50.075151+0000","last_clean":"2023-10-16T19:41:50.075151+0000","last_became_active":"2023-10-16T19:41:06.752757+0000","last_became_peered":"2023-10-16T19:41:06.752757+0000","last_unstale":"2023-10-16T19:41:50.075151+0000","last_undegraded":"2023-10-16T19:41:50.075151+0000","last_fullsized":"2023-10-16T19:41:50.075151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3","last_scrub_stamp":"2023-10-16T19:41:50.075049+0000","last_deep_scrub":"42'3","last_deep_scrub_stamp":"2023-10-16T19:41:50.075049+0000","last_clean_scrub_stamp":"2023-10-16T19:41:50.075049+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:50:38.447205+0000","scrub_duration":0.0033427270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203075+0000","last_change":"2023-10-16T19:41:37.991413+0000","last_active":"2023-10-16T19:41:41.203075+0000","last_peered":"2023-10-16T19:41:41.203075+0000","last_clean":"2023-10-16T19:41:41.203075+0000","last_became_active":"2023-10-16T19:41:07.757847+0000","last_became_peered":"2023-10-16T19:41:07.757847+0000","last_unstale":"2023-10-16T19:41:41.203075+0000","last_undegraded":"2023-10-16T19:41:41.203075+0000","last_fullsized":"2023-10-16T19:41:41.203075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:37.991268+0000","last_clean_scrub_stamp":"2023-10-16T19:41:37.991268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:03.514348+0000","scrub_duration":0.0019647050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:45.151371+0000","last_change":"2023-10-16T19:41:45.151421+0000","last_active":"2023-10-16T19:41:45.151371+0000","last_peered":"2023-10-16T19:41:45.151371+0000","last_clean":"2023-10-16T19:41:45.151371+0000","last_became_active":"2023-10-16T19:41:06.756514+0000","last_became_peered":"2023-10-16T19:41:06.756514+0000","last_unstale":"2023-10-16T19:41:45.151371+0000","last_undegraded":"2023-10-16T19:41:45.151371+0000","last_fullsized":"2023-10-16T19:41:45.151371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:45.151281+0000","last_clean_scrub_stamp":"2023-10-16T19:41:45.151281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:39.157471+0000","scrub_duration":0.0019257510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:46.859845+0000","last_change":"2023-10-16T19:41:46.859927+0000","last_active":"2023-10-16T19:41:46.859845+0000","last_peered":"2023-10-16T19:41:46.859845+0000","last_clean":"2023-10-16T19:41:46.859845+0000","last_became_active":"2023-10-16T19:41:07.765041+0000","last_became_peered":"2023-10-16T19:41:07.765041+0000","last_unstale":"2023-10-16T19:41:46.859845+0000","last_undegraded":"2023-10-16T19:41:46.859845+0000","last_fullsized":"2023-10-16T19:41:46.859845+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:46.859709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:46.859709+0000","last_clean_scrub_stamp":"2023-10-16T19:41:46.859709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:19.429048+0000","scrub_duration":0.00162306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689285+0000","last_change":"2023-10-16T19:41:34.344641+0000","last_active":"2023-10-16T19:41:40.689285+0000","last_peered":"2023-10-16T19:41:40.689285+0000","last_clean":"2023-10-16T19:41:40.689285+0000","last_became_active":"2023-10-16T19:41:06.754195+0000","last_became_peered":"2023-10-16T19:41:06.754195+0000","last_unstale":"2023-10-16T19:41:40.689285+0000","last_undegraded":"2023-10-16T19:41:40.689285+0000","last_fullsized":"2023-10-16T19:41:40.689285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:34.344482+0000","last_clean_scrub_stamp":"2023-10-16T19:41:34.344482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:00:12.314887+0000","scrub_duration":0.0016727179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.476588+0000","last_change":"2023-10-16T19:41:41.476588+0000","last_active":"2023-10-16T19:41:41.476588+0000","last_peered":"2023-10-16T19:41:41.476588+0000","last_clean":"2023-10-16T19:41:41.476588+0000","last_became_active":"2023-10-16T19:41:07.759320+0000","last_became_peered":"2023-10-16T19:41:07.759320+0000","last_unstale":"2023-10-16T19:41:41.476588+0000","last_undegraded":"2023-10-16T19:41:41.476588+0000","last_fullsized":"2023-10-16T19:41:41.476588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.476462+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.476462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:13.370623+0000","scrub_duration":0.0020194219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.204062+0000","last_change":"2023-10-16T19:41:33.039261+0000","last_active":"2023-10-16T19:41:41.204062+0000","last_peered":"2023-10-16T19:41:41.204062+0000","last_clean":"2023-10-16T19:41:41.204062+0000","last_became_active":"2023-10-16T19:41:06.751183+0000","last_became_peered":"2023-10-16T19:41:06.751183+0000","last_unstale":"2023-10-16T19:41:41.204062+0000","last_undegraded":"2023-10-16T19:41:41.204062+0000","last_fullsized":"2023-10-16T19:41:41.204062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.039106+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.039106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:12.030925+0000","scrub_duration":0.001540869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.394202+0000","last_change":"2023-10-16T19:41:41.394202+0000","last_active":"2023-10-16T19:41:41.394202+0000","last_peered":"2023-10-16T19:41:41.394202+0000","last_clean":"2023-10-16T19:41:41.394202+0000","last_became_active":"2023-10-16T19:41:07.766003+0000","last_became_peered":"2023-10-16T19:41:07.766003+0000","last_unstale":"2023-10-16T19:41:41.394202+0000","last_undegraded":"2023-10-16T19:41:41.394202+0000","last_fullsized":"2023-10-16T19:41:41.394202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:41.394045+0000","last_clean_scrub_stamp":"2023-10-16T19:41:41.394045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:58.221103+0000","scrub_duration":0.0021463179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'3","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203900+0000","last_change":"2023-10-16T19:41:40.835813+0000","last_active":"2023-10-16T19:41:41.203900+0000","last_peered":"2023-10-16T19:41:41.203900+0000","last_clean":"2023-10-16T19:41:41.203900+0000","last_became_active":"2023-10-16T19:41:06.753358+0000","last_became_peered":"2023-10-16T19:41:06.753358+0000","last_unstale":"2023-10-16T19:41:41.203900+0000","last_undegraded":"2023-10-16T19:41:41.203900+0000","last_fullsized":"2023-10-16T19:41:41.203900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T19:41:40.835600+0000","last_clean_scrub_stamp":"2023-10-16T19:41:40.835600+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:19:29.874255+0000","scrub_duration":0.0042860880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:47.455540+0000","last_change":"2023-10-16T19:41:47.455598+0000","last_active":"2023-10-16T19:41:47.455540+0000","last_peered":"2023-10-16T19:41:47.455540+0000","last_clean":"2023-10-16T19:41:47.455540+0000","last_became_active":"2023-10-16T19:41:07.761118+0000","last_became_peered":"2023-10-16T19:41:07.761118+0000","last_unstale":"2023-10-16T19:41:47.455540+0000","last_undegraded":"2023-10-16T19:41:47.455540+0000","last_fullsized":"2023-10-16T19:41:47.455540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:47.455432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:47.455432+0000","last_clean_scrub_stamp":"2023-10-16T19:41:47.455432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:36:52.777131+0000","scrub_duration":0.001809913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"42'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:49.087897+0000","last_change":"2023-10-16T19:41:49.087953+0000","last_active":"2023-10-16T19:41:49.087897+0000","last_peered":"2023-10-16T19:41:49.087897+0000","last_clean":"2023-10-16T19:41:49.087897+0000","last_became_active":"2023-10-16T19:41:06.754734+0000","last_became_peered":"2023-10-16T19:41:06.754734+0000","last_unstale":"2023-10-16T19:41:49.087897+0000","last_undegraded":"2023-10-16T19:41:49.087897+0000","last_fullsized":"2023-10-16T19:41:49.087897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2023-10-16T19:41:49.087801+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2023-10-16T19:41:49.087801+0000","last_clean_scrub_stamp":"2023-10-16T19:41:49.087801+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:57:59.847513+0000","scrub_duration":0.0033824969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689628+0000","last_change":"2023-10-16T19:41:38.463191+0000","last_active":"2023-10-16T19:41:40.689628+0000","last_peered":"2023-10-16T19:41:40.689628+0000","last_clean":"2023-10-16T19:41:40.689628+0000","last_became_active":"2023-10-16T19:41:07.752300+0000","last_became_peered":"2023-10-16T19:41:07.752300+0000","last_unstale":"2023-10-16T19:41:40.689628+0000","last_undegraded":"2023-10-16T19:41:40.689628+0000","last_fullsized":"2023-10-16T19:41:40.689628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.463035+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.463035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:11.032374+0000","scrub_duration":0.0018809720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203321+0000","last_change":"2023-10-16T19:41:31.031202+0000","last_active":"2023-10-16T19:41:41.203321+0000","last_peered":"2023-10-16T19:41:41.203321+0000","last_clean":"2023-10-16T19:41:41.203321+0000","last_became_active":"2023-10-16T19:41:06.750491+0000","last_became_peered":"2023-10-16T19:41:06.750491+0000","last_unstale":"2023-10-16T19:41:41.203321+0000","last_undegraded":"2023-10-16T19:41:41.203321+0000","last_fullsized":"2023-10-16T19:41:41.203321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:31.031043+0000","last_clean_scrub_stamp":"2023-10-16T19:41:31.031043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:46.766692+0000","scrub_duration":0.001647171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:53.020913+0000","last_change":"2023-10-16T19:41:53.020995+0000","last_active":"2023-10-16T19:41:53.020913+0000","last_peered":"2023-10-16T19:41:53.020913+0000","last_clean":"2023-10-16T19:41:53.020913+0000","last_became_active":"2023-10-16T19:41:07.751250+0000","last_became_peered":"2023-10-16T19:41:07.751250+0000","last_unstale":"2023-10-16T19:41:53.020913+0000","last_undegraded":"2023-10-16T19:41:53.020913+0000","last_fullsized":"2023-10-16T19:41:53.020913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:53.020796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:53.020796+0000","last_clean_scrub_stamp":"2023-10-16T19:41:53.020796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:36:58.342494+0000","scrub_duration":0.001640922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203418+0000","last_change":"2023-10-16T19:41:26.949224+0000","last_active":"2023-10-16T19:41:41.203418+0000","last_peered":"2023-10-16T19:41:41.203418+0000","last_clean":"2023-10-16T19:41:41.203418+0000","last_became_active":"2023-10-16T19:41:06.749583+0000","last_became_peered":"2023-10-16T19:41:06.749583+0000","last_unstale":"2023-10-16T19:41:41.203418+0000","last_undegraded":"2023-10-16T19:41:41.203418+0000","last_fullsized":"2023-10-16T19:41:41.203418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:26.949056+0000","last_clean_scrub_stamp":"2023-10-16T19:41:26.949056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:13:33.499304+0000","scrub_duration":0.001636935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:41.203266+0000","last_change":"2023-10-16T19:41:35.404620+0000","last_active":"2023-10-16T19:41:41.203266+0000","last_peered":"2023-10-16T19:41:41.203266+0000","last_clean":"2023-10-16T19:41:41.203266+0000","last_became_active":"2023-10-16T19:41:07.758140+0000","last_became_peered":"2023-10-16T19:41:07.758140+0000","last_unstale":"2023-10-16T19:41:41.203266+0000","last_undegraded":"2023-10-16T19:41:41.203266+0000","last_fullsized":"2023-10-16T19:41:41.203266+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:35.404463+0000","last_clean_scrub_stamp":"2023-10-16T19:41:35.404463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:12:51.140112+0000","scrub_duration":0.001879155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.154699+0000","last_change":"2023-10-16T19:41:48.154782+0000","last_active":"2023-10-16T19:41:48.154699+0000","last_peered":"2023-10-16T19:41:48.154699+0000","last_clean":"2023-10-16T19:41:48.154699+0000","last_became_active":"2023-10-16T19:41:06.751149+0000","last_became_peered":"2023-10-16T19:41:06.751149+0000","last_unstale":"2023-10-16T19:41:48.154699+0000","last_undegraded":"2023-10-16T19:41:48.154699+0000","last_fullsized":"2023-10-16T19:41:48.154699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.154578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.154578+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.154578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:15.402220+0000","scrub_duration":0.0021881040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:48.155820+0000","last_change":"2023-10-16T19:41:48.155880+0000","last_active":"2023-10-16T19:41:48.155820+0000","last_peered":"2023-10-16T19:41:48.155820+0000","last_clean":"2023-10-16T19:41:48.155820+0000","last_became_active":"2023-10-16T19:41:07.751002+0000","last_became_peered":"2023-10-16T19:41:07.751002+0000","last_unstale":"2023-10-16T19:41:48.155820+0000","last_undegraded":"2023-10-16T19:41:48.155820+0000","last_fullsized":"2023-10-16T19:41:48.155820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:48.155727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:48.155727+0000","last_clean_scrub_stamp":"2023-10-16T19:41:48.155727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:32:13.678807+0000","scrub_duration":0.001325927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.850326+0000","last_change":"2023-10-16T19:41:33.055184+0000","last_active":"2023-10-16T19:41:40.850326+0000","last_peered":"2023-10-16T19:41:40.850326+0000","last_clean":"2023-10-16T19:41:40.850326+0000","last_became_active":"2023-10-16T19:41:06.757356+0000","last_became_peered":"2023-10-16T19:41:06.757356+0000","last_unstale":"2023-10-16T19:41:40.850326+0000","last_undegraded":"2023-10-16T19:41:40.850326+0000","last_fullsized":"2023-10-16T19:41:40.850326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:33.055042+0000","last_clean_scrub_stamp":"2023-10-16T19:41:33.055042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:45.001071+0000","scrub_duration":0.0020577270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:58.422380+0000","last_change":"2023-10-16T19:41:58.422430+0000","last_active":"2023-10-16T19:41:58.422380+0000","last_peered":"2023-10-16T19:41:58.422380+0000","last_clean":"2023-10-16T19:41:58.422380+0000","last_became_active":"2023-10-16T19:41:07.759802+0000","last_became_peered":"2023-10-16T19:41:07.759802+0000","last_unstale":"2023-10-16T19:41:58.422380+0000","last_undegraded":"2023-10-16T19:41:58.422380+0000","last_fullsized":"2023-10-16T19:41:58.422380+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:58.422277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:58.422277+0000","last_clean_scrub_stamp":"2023-10-16T19:41:58.422277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:37.176731+0000","scrub_duration":0.001530478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689032+0000","last_change":"2023-10-16T19:41:29.348081+0000","last_active":"2023-10-16T19:41:40.689032+0000","last_peered":"2023-10-16T19:41:40.689032+0000","last_clean":"2023-10-16T19:41:40.689032+0000","last_became_active":"2023-10-16T19:41:06.750571+0000","last_became_peered":"2023-10-16T19:41:06.750571+0000","last_unstale":"2023-10-16T19:41:40.689032+0000","last_undegraded":"2023-10-16T19:41:40.689032+0000","last_fullsized":"2023-10-16T19:41:40.689032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:29.347858+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.347858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:01.888194+0000","scrub_duration":0.0017072509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:52.873674+0000","last_change":"2023-10-16T19:41:52.873724+0000","last_active":"2023-10-16T19:41:52.873674+0000","last_peered":"2023-10-16T19:41:52.873674+0000","last_clean":"2023-10-16T19:41:52.873674+0000","last_became_active":"2023-10-16T19:41:07.766562+0000","last_became_peered":"2023-10-16T19:41:07.766562+0000","last_unstale":"2023-10-16T19:41:52.873674+0000","last_undegraded":"2023-10-16T19:41:52.873674+0000","last_fullsized":"2023-10-16T19:41:52.873674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:52.873573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:52.873573+0000","last_clean_scrub_stamp":"2023-10-16T19:41:52.873573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:24:24.767734+0000","scrub_duration":0.0019564399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T19:41:40.689481+0000","last_change":"2023-10-16T19:41:38.353018+0000","last_active":"2023-10-16T19:41:40.689481+0000","last_peered":"2023-10-16T19:41:40.689481+0000","last_clean":"2023-10-16T19:41:40.689481+0000","last_became_active":"2023-10-16T19:41:06.758128+0000","last_became_peered":"2023-10-16T19:41:06.758128+0000","last_unstale":"2023-10-16T19:41:40.689481+0000","last_undegraded":"2023-10-16T19:41:40.689481+0000","last_fullsized":"2023-10-16T19:41:40.689481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:41:38.352810+0000","last_clean_scrub_stamp":"2023-10-16T19:41:38.352810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:10.893146+0000","scrub_duration":0.0020448939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"40'119","reported_seq":196,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T19:41:42.167420+0000","last_change":"2023-10-16T19:41:29.433686+0000","last_active":"2023-10-16T19:41:42.167420+0000","last_peered":"2023-10-16T19:41:42.167420+0000","last_clean":"2023-10-16T19:41:42.167420+0000","last_became_active":"2023-10-16T19:39:48.281921+0000","last_became_peered":"2023-10-16T19:39:48.281921+0000","last_unstale":"2023-10-16T19:41:42.167420+0000","last_undegraded":"2023-10-16T19:41:42.167420+0000","last_fullsized":"2023-10-16T19:41:42.167420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'119","last_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_deep_scrub":"40'119","last_deep_scrub_stamp":"2023-10-16T19:41:29.433479+0000","last_clean_scrub_stamp":"2023-10-16T19:41:29.433479+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:01.950112+0000","scrub_duration":0.0052109569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1097728,"data_stored":804226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.30299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.89900000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78700000000000003,"5min":0.879,"15min":0.879},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82099999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.44700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0920000000000001,"5min":1.208,"15min":1.208},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":1.157,"15min":1.157},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.501}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.82799999999999996,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":1.113,"15min":1.1970000000000001},"min":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80900000000000005,"5min":11.582000000000001,"15min":11.582000000000001},"last":0.63}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.38,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":1.046,"15min":1.046},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79700000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.316},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.45000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":1.329,"15min":1.329},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.625},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.878,"5min":1.111,"15min":1.111},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.85599999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.51500000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.353,"15min":1.353},"last":0.54600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54600000000000004,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.83899999999999997,"15min":0.91500000000000004},"min":{"1min":0.26300000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.63400000000000001,"5min":10.465,"15min":10.465},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.245,"15min":0.245},"max":{"1min":0.53600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.0600000000000001,"15min":1.1579999999999999},"min":{"1min":0.32600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":14.497,"15min":14.497},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":1.1579999999999999,"15min":1.28},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61699999999999999,"5min":16.306999999999999,"15min":16.306999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97799999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":1.325,"15min":1.4319999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":16.234999999999999,"15min":16.234999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":0.89300000000000002},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.004,"5min":5.2939999999999996,"15min":5.2939999999999996},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.3240000000000001,"15min":1.431},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":16.192,"15min":16.192},"last":0.624},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.85399999999999998,"15min":0.88400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96699999999999997,"5min":5.258,"15min":5.258},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":1.3460000000000001,"15min":1.454},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98999999999999999,"5min":16.274999999999999,"15min":16.274999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1085440,"data_stored":802578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.432,"15min":0.44},"min":{"1min":0.252,"5min":0.245,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.46800000000000003,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54200000000000004,"5min":1.54,"15min":1.54},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.41299999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.439}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56000000000000005,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.373},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61499999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.876,"5min":1.667,"15min":1.667},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94599999999999995,"5min":1.619,"15min":1.619},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91500000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.622}]},{"osd":6,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82699999999999996,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":212246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.502,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52800000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.435}]},{"osd":1,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.49099999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.622,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.436,"15min":0.438},"min":{"1min":0.32700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.78100000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.871},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.92400000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":213822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48999999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.40400000000000003,"15min":0.40799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.49399999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.32600000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.39500000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52800000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.748},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.628,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.624,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90800000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.745}]},{"osd":6,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.87,"15min":0.87},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.40000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.98199999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":8.6180000000000003,"15min":8.6180000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.97499999999999998,"15min":1.0389999999999999},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":9.9039999999999999,"15min":9.9039999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76200000000000001,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71999999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.97999999999999998,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75600000000000001,"5min":9.9290000000000003,"15min":9.9290000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73499999999999999,"5min":0.755,"15min":0.755},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45900000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":1.046,"15min":1.046},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84699999999999998,"5min":0.879,"15min":0.879},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":212288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.75},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.78900000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.752,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69599999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77100000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40500000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.84899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77500000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.84299999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.71999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78200000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T19:42:28.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T19:42:28.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 Processor -- start 2023-10-16T19:42:28.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 -- start start 2023-10-16T19:42:28.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280c3e90 con 0x7f9c280c89b0 2023-10-16T19:42:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c28155bc0 con 0x7f9c281521e0 2023-10-16T19:42:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.560+0000 7f9c2d2c3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c3640 con 0x7f9c2806f8f0 2023-10-16T19:42:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c26ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c26ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.29:44412/0 (socket says 172.21.15.29:44412) 2023-10-16T19:42:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.29:46582/0 (socket says 172.21.15.29:46582) 2023-10-16T19:42:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c26ffd700 1 -- 172.21.15.29:0/1766244747 learned_addr learned my addr 172.21.15.29:0/1766244747 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 -- 172.21.15.29:0/1766244747 >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 msgr2=0x7f9c280a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 --2- 172.21.15.29:0/1766244747 >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 -- 172.21.15.29:0/1766244747 >> v1:172.21.15.53:6789/0 conn(0x7f9c280c89b0 legacy=0x7f9c280c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 -- 172.21.15.29:0/1766244747 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28070440 con 0x7f9c2806f8f0 2023-10-16T19:42:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c26ffd700 1 --2- 172.21.15.29:0/1766244747 >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:42:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c267fc700 1 --2- 172.21.15.29:0/1766244747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009840 tx=0x7f9c18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7d184d899b1bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.561+0000 7f9c25ffb700 1 -- 172.21.15.29:0/1766244747 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18011830 con 0x7f9c2806f8f0 2023-10-16T19:42:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c25ffb700 1 -- 172.21.15.29:0/1766244747 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18011990 con 0x7f9c2806f8f0 2023-10-16T19:42:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c25ffb700 1 -- 172.21.15.29:0/1766244747 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18011d20 con 0x7f9c2806f8f0 2023-10-16T19:42:28.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/1766244747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 msgr2=0x7f9c280c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/1766244747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009840 tx=0x7f9c18009b50 comp rx=0 tx=0).stop 2023-10-16T19:42:28.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/1766244747 shutdown_connections 2023-10-16T19:42:28.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/1766244747 >> v2:172.21.15.53:3300/0 conn(0x7f9c281521e0 0x7f9c280a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/1766244747 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c2806f8f0 0x7f9c280c8470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/1766244747 >> 172.21.15.29:0/1766244747 conn(0x7f9c2806ac70 msgr2=0x7f9c2806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:28.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/1766244747 shutdown_connections 2023-10-16T19:42:28.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.562+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/1766244747 wait complete. 2023-10-16T19:42:28.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 Processor -- start 2023-10-16T19:42:28.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 -- start start 2023-10-16T19:42:28.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c280c89b0 0x7f9c28156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c281521e0 0x7f9c281ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28158080 con 0x7f9c2806f8f0 2023-10-16T19:42:28.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c7dd0 con 0x7f9c280c89b0 2023-10-16T19:42:28.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c2d2c3700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c1830 con 0x7f9c281521e0 2023-10-16T19:42:28.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c26ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c267fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c280c89b0 0x7f9c28156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c26ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54132/0 (socket says 172.21.15.29:54132) 2023-10-16T19:42:28.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c26ffd700 1 -- 172.21.15.29:0/3384792270 learned_addr learned my addr 172.21.15.29:0/3384792270 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:28.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.564+0000 7f9c277fe700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c281521e0 0x7f9c281ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 -- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c281521e0 msgr2=0x7f9c281ed5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c281521e0 0x7f9c281ed5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 -- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c280c89b0 msgr2=0x7f9c28156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c280c89b0 0x7f9c28156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 -- 172.21.15.29:0/3384792270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009550 con 0x7f9c2806f8f0 2023-10-16T19:42:28.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c26ffd700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ec10 tx=0x7f9c1000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000c850 con 0x7f9c2806f8f0 2023-10-16T19:42:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000c9b0 con 0x7f9c2806f8f0 2023-10-16T19:42:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c180094a0 con 0x7f9c2806f8f0 2023-10-16T19:42:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000cd40 con 0x7f9c2806f8f0 2023-10-16T19:42:28.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.565+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c280c1020 con 0x7f9c2806f8f0 2023-10-16T19:42:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.566+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2804f400 con 0x7f9c2806f8f0 2023-10-16T19:42:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.567+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c10013470 con 0x7f9c2806f8f0 2023-10-16T19:42:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.567+0000 7f9c1f7fe700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 0x7f9c0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.567+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f9c10089880 con 0x7f9c2806f8f0 2023-10-16T19:42:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.567+0000 7f9c267fc700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 0x7f9c0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.568+0000 7f9c267fc700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 0x7f9c0806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009fd0 tx=0x7f9c1801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.571+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c10054850 con 0x7f9c2806f8f0 2023-10-16T19:42:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.770+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9c2806f6d0 con 0x7f9c2806f8f0 2023-10-16T19:42:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.773+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9c10021020 con 0x7f9c2806f8f0 2023-10-16T19:42:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.773+0000 7f9c1f7fe700 1 -- 172.21.15.29:0/3384792270 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9c10054850 con 0x7f9c2806f8f0 2023-10-16T19:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.775+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 msgr2=0x7f9c0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.775+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 0x7f9c0806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009fd0 tx=0x7f9c1801c040 comp rx=0 tx=0).stop 2023-10-16T19:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.775+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 msgr2=0x7f9c281577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.775+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ec10 tx=0x7f9c1000ef20 comp rx=0 tx=0).stop 2023-10-16T19:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.775+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 shutdown_connections 2023-10-16T19:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f9c0806af00 0x7f9c0806d3c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9c281521e0 0x7f9c281ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c2806f8f0 0x7f9c281577f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 --2- 172.21.15.29:0/3384792270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c280c89b0 0x7f9c28156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 >> 172.21.15.29:0/3384792270 conn(0x7f9c2806ac70 msgr2=0x7f9c28150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 shutdown_connections 2023-10-16T19:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.776+0000 7f9c2d2c3700 1 -- 172.21.15.29:0/3384792270 wait complete. 2023-10-16T19:42:28.789 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T19:42:28.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:42:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.912+0000 7f0e48711700 1 Processor -- start 2023-10-16T19:42:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.913+0000 7f0e48711700 1 -- start start 2023-10-16T19:42:28.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.913+0000 7f0e48711700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 0x7f0e40156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.913+0000 7f0e48711700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e40150100 0x7f0e40152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e48711700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e400724a0 con 0x7f0e400c18b0 2023-10-16T19:42:28.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e48711700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40152780 con 0x7f0e40150100 2023-10-16T19:42:28.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e48711700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400c2660 con 0x7f0e4006f6e0 2023-10-16T19:42:28.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e45cac700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0e400c18b0 0x7f0e4014f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39584/0 (socket says 172.21.15.29:39584) 2023-10-16T19:42:28.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e45cac700 1 -- 172.21.15.29:0/2438980560 learned_addr learned my addr 172.21.15.29:0/2438980560 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-16T19:42:28.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 --2- 172.21.15.29:0/2438980560 >> v2:172.21.15.29:3300/0 conn(0x7f0e40150100 0x7f0e40152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e464ad700 1 --2- 172.21.15.29:0/2438980560 >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 0x7f0e40156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 -- 172.21.15.29:0/2438980560 >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 msgr2=0x7f0e40156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:42:28.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 --2- 172.21.15.29:0/2438980560 >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 0x7f0e40156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 -- 172.21.15.29:0/2438980560 >> v1:172.21.15.29:6789/0 conn(0x7f0e400c18b0 legacy=0x7f0e4014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 -- 172.21.15.29:0/2438980560 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400a8490 con 0x7f0e40150100 2023-10-16T19:42:28.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e454ab700 1 -- 172.21.15.29:0/2438980560 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586721234 0 0) 0x7f0e400724a0 con 0x7f0e400c18b0 2023-10-16T19:42:28.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e464ad700 1 --2- 172.21.15.29:0/2438980560 >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 0x7f0e40156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:42:28.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e46cae700 1 --2- 172.21.15.29:0/2438980560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e40152ba0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0e4006b910 tx=0x7f0e3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae870ff91039c930 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e454ab700 1 -- 172.21.15.29:0/2438980560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800e070 con 0x7f0e40150100 2023-10-16T19:42:28.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e454ab700 1 -- 172.21.15.29:0/2438980560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e3800bbd0 con 0x7f0e40150100 2023-10-16T19:42:28.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.914+0000 7f0e454ab700 1 -- 172.21.15.29:0/2438980560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38012430 con 0x7f0e40150100 2023-10-16T19:42:28.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 -- 172.21.15.29:0/2438980560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 msgr2=0x7f0e40152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 --2- 172.21.15.29:0/2438980560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e40152ba0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0e4006b910 tx=0x7f0e3800b330 comp rx=0 tx=0).stop 2023-10-16T19:42:28.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 -- 172.21.15.29:0/2438980560 shutdown_connections 2023-10-16T19:42:28.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 --2- 172.21.15.29:0/2438980560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e40152ba0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 --2- 172.21.15.29:0/2438980560 >> v2:172.21.15.53:3300/0 conn(0x7f0e4006f6e0 0x7f0e40156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 -- 172.21.15.29:0/2438980560 >> 172.21.15.29:0/2438980560 conn(0x7f0e400c7110 msgr2=0x7f0e400c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:28.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 -- 172.21.15.29:0/2438980560 shutdown_connections 2023-10-16T19:42:28.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.915+0000 7f0e48711700 1 -- 172.21.15.29:0/2438980560 wait complete. 2023-10-16T19:42:28.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.916+0000 7f0e48711700 1 Processor -- start 2023-10-16T19:42:28.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.916+0000 7f0e48711700 1 -- start start 2023-10-16T19:42:28.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0e4006f6e0 0x7f0e400c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e400c18b0 0x7f0e400c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400c6850 con 0x7f0e40150100 2023-10-16T19:42:28.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400c59d0 con 0x7f0e400c18b0 2023-10-16T19:42:28.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e48711700 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400c54e0 con 0x7f0e4006f6e0 2023-10-16T19:42:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54148/0 (socket says 172.21.15.29:54148) 2023-10-16T19:42:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 -- 172.21.15.29:0/3338400838 learned_addr learned my addr 172.21.15.29:0/3338400838 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-16T19:42:28.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e45cac700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e400c18b0 0x7f0e400c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e464ad700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0e4006f6e0 0x7f0e400c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 -- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0e4006f6e0 msgr2=0x7f0e400c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0e4006f6e0 0x7f0e400c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 -- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e400c18b0 msgr2=0x7f0e400c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:28.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e400c18b0 0x7f0e400c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:28.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 -- 172.21.15.29:0/3338400838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38009a70 con 0x7f0e40150100 2023-10-16T19:42:28.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.917+0000 7f0e46cae700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0e40071620 tx=0x7f0e38004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.918+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38012430 con 0x7f0e40150100 2023-10-16T19:42:28.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.918+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e38020070 con 0x7f0e40150100 2023-10-16T19:42:28.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.918+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38004040 con 0x7f0e40150100 2023-10-16T19:42:28.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.918+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e400c56f0 con 0x7f0e40150100 2023-10-16T19:42:28.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.918+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e401e9a60 con 0x7f0e40150100 2023-10-16T19:42:28.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.919+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4004f400 con 0x7f0e40150100 2023-10-16T19:42:28.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.919+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e380041a0 con 0x7f0e40150100 2023-10-16T19:42:28.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.919+0000 7f0e32ffd700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 0x7f0e2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:42:28.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.920+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f0e38022070 con 0x7f0e40150100 2023-10-16T19:42:28.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.920+0000 7f0e464ad700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 0x7f0e2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:42:28.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.920+0000 7f0e464ad700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 0x7f0e2406d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006fd0 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:42:28.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:28.924+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e38056460 con 0x7f0e40150100 2023-10-16T19:42:29.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.169+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e40153790 con 0x7f0e40150100 2023-10-16T19:42:29.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.169+0000 7f0e32ffd700 1 -- 172.21.15.29:0/3338400838 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f0e38059a80 con 0x7f0e40150100 2023-10-16T19:42:29.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-16T19:42:29.172 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/628400601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":628400601},{"type":"v1","addr":"172.21.15.29:6835","nonce":628400601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/2394385366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2394385366},{"type":"v1","addr":"172.21.15.53:6836","nonce":2394385366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/848265449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":848265449},{"type":"v1","addr":"172.21.15.29:6834","nonce":848265449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:41:07.155742+0000","modified":"2023-10-16T19:41:10.167877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/4202647706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":4202647706},{"type":"v1","addr":"172.21.15.53:6837","nonce":4202647706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:42:29.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 msgr2=0x7f0e2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:29.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 0x7f0e2406d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006fd0 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2023-10-16T19:42:29.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 msgr2=0x7f0e401eca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:42:29.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0e40071620 tx=0x7f0e38004b20 comp rx=0 tx=0).stop 2023-10-16T19:42:29.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 shutdown_connections 2023-10-16T19:42:29.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:6832/2936749946,v1:172.21.15.53:6833/2936749946] conn(0x7f0e2406af00 0x7f0e2406d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:29.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e40150100 0x7f0e401eca70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:29.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0e4006f6e0 0x7f0e400c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 --2- 172.21.15.29:0/3338400838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e400c18b0 0x7f0e400c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:42:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 >> 172.21.15.29:0/3338400838 conn(0x7f0e400c7110 msgr2=0x7f0e401484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:42:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 shutdown_connections 2023-10-16T19:42:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-16T19:42:29.171+0000 7f0e48711700 1 -- 172.21.15.29:0/3338400838 wait complete. 2023-10-16T19:42:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-16T19:42:29.185 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-16T19:42:29.186 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T19:42:29.186 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T19:42:29.186 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.195 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T19:42:29.195 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T19:42:29.196 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.243 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T19:42:29.244 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T19:42:29.244 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.256 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T19:42:29.256 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T19:42:29.257 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.307 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T19:42:29.308 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T19:42:29.308 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T19:42:29.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.345 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T19:42:29.345 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T19:42:29.346 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.425 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T19:42:29.425 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T19:42:29.425 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.495 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T19:42:29.496 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T19:42:29.496 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.574 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T19:42:29.574 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T19:42:29.575 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.620 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T19:42:29.620 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T19:42:29.621 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.658 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T19:42:29.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T19:42:29.659 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.738 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T19:42:29.739 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T19:42:29.739 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.819 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T19:42:29.819 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T19:42:29.820 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T19:42:29.820 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.843 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T19:42:29.843 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T19:42:29.843 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.886 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T19:42:29.886 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T19:42:29.887 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T19:42:29.888 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.898 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T19:42:29.898 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T19:42:29.899 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.938 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T19:42:29.939 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T19:42:29.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:42:29.990 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T19:42:29.991 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T19:42:29.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-16T19:42:30.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:42:30.024 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T19:42:30.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:42:30.337 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T19:42:30.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:42:30.429 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T19:42:30.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:42:30.514 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T19:42:30.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:42:30.592 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T19:42:30.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:42:30.757 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T19:42:30.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:42:30.887 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T19:42:30.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:42:30.959 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T19:42:31.032 INFO:tasks.ceph:Archiving mon data... 2023-10-16T19:42:31.034 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/data/mon.a.tgz 2023-10-16T19:42:31.034 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-16T19:42:31.054 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.rwYEx46AwI 2023-10-16T19:42:31.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rwYEx46AwI 2023-10-16T19:42:31.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.rwYEx46AwI 2023-10-16T19:42:31.319 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.rwYEx46AwI is 307KB 2023-10-16T19:42:31.414 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.rwYEx46AwI 2023-10-16T19:42:31.432 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/data/mon.b.tgz 2023-10-16T19:42:31.432 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-10-16T19:42:31.451 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.hgYFWGiHeq 2023-10-16T19:42:31.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hgYFWGiHeq 2023-10-16T19:42:31.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.hgYFWGiHeq 2023-10-16T19:42:31.726 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.hgYFWGiHeq is 410KB 2023-10-16T19:42:31.823 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.hgYFWGiHeq 2023-10-16T19:42:31.840 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/data/mon.c.tgz 2023-10-16T19:42:31.840 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-10-16T19:42:31.896 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.1CJRNQ2QlT 2023-10-16T19:42:31.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1CJRNQ2QlT 2023-10-16T19:42:32.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.1CJRNQ2QlT 2023-10-16T19:42:32.125 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.1CJRNQ2QlT is 410KB 2023-10-16T19:42:32.222 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.1CJRNQ2QlT 2023-10-16T19:42:32.239 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T19:42:32.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T19:42:32.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T19:42:32.306 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T19:42:32.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T19:42:32.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T19:42:32.355 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T19:42:32.380 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T19:42:32.386 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T19:42:32.388 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi029/crash 2023-10-16T19:42:32.389 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T19:42:32.432 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi053/crash 2023-10-16T19:42:32.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T19:42:32.460 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T19:42:32.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:32.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:32.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:32.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T19:42:32.617 INFO:tasks.ceph:Compressing logs... 2023-10-16T19:42:32.617 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T19:42:32.633 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T19:42:32.659 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110325.log 2023-10-16T19:42:32.659 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115716.log 2023-10-16T19:42:32.664 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111646.log 2023-10-16T19:42:32.664 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110325.log: /var/log/ceph/ceph-client.admin.115716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120031.log 2023-10-16T19:42:32.664 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111646.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115716.log.gz 2023-10-16T19:42:32.665 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113277.log 2023-10-16T19:42:32.665 INFO:teuthology.orchestra.run.smithi029.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.110325.log.gz 2023-10-16T19:42:32.665 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111646.log.gz 2023-10-16T19:42:32.665 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113621.log 2023-10-16T19:42:32.666 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113277.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120031.log.gz 2023-10-16T19:42:32.666 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119985.log 2023-10-16T19:42:32.666 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113277.log.gz 2023-10-16T19:42:32.667 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112903.log 2023-10-16T19:42:32.667 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119985.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113621.log.gz 2023-10-16T19:42:32.667 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115486.log 2023-10-16T19:42:32.667 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119985.log.gz 2023-10-16T19:42:32.668 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110395.log 2023-10-16T19:42:32.668 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115486.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112903.log.gz 2023-10-16T19:42:32.668 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120845.log 2023-10-16T19:42:32.668 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110395.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115486.log.gz 2023-10-16T19:42:32.669 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113759.log 2023-10-16T19:42:32.669 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110395.log.gz 2023-10-16T19:42:32.669 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120845.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-16T19:42:32.670 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120845.log.gz 2023-10-16T19:42:32.670 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118912.log 2023-10-16T19:42:32.670 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.113759.log.gz 2023-10-16T19:42:32.670 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117082.log 2023-10-16T19:42:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116626.log 2023-10-16T19:42:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117082.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118912.log.gz 2023-10-16T19:42:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120499.log 2023-10-16T19:42:32.671 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117082.log.gz 2023-10-16T19:42:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114248.log 2023-10-16T19:42:32.692 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-16T19:42:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110306.log 2023-10-16T19:42:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T19:42:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-16T19:42:32.693 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.1.110306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110306.log.gz 2023-10-16T19:42:32.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104098.log 2023-10-16T19:42:32.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104151.log 2023-10-16T19:42:32.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.104098.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-16T19:42:32.694 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104098.log.gz 2023-10-16T19:42:32.695 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 /var/log/ceph/ceph-client.admin.104151.log: --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T19:42:32.695 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104008.log 2023-10-16T19:42:32.695 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104151.log.gz 2023-10-16T19:42:32.696 INFO:teuthology.orchestra.run.smithi053.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T19:42:32.696 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-16T19:42:32.696 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.104008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110314.log 2023-10-16T19:42:32.696 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104008.log.gz 2023-10-16T19:42:32.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.4.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-16T19:42:32.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.1.110314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110314.log.gz 2023-10-16T19:42:32.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103962.log 2023-10-16T19:42:32.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-16T19:42:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.103962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104053.log 2023-10-16T19:42:32.698 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T19:42:32.698 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103962.log.gz 2023-10-16T19:42:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-16T19:42:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.104053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103824.log 2023-10-16T19:42:32.699 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104053.log.gz 2023-10-16T19:42:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-16T19:42:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.103824.log: /var/log/ceph/ceph-osd.7.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103824.log.gz 2023-10-16T19:42:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103916.log 2023-10-16T19:42:32.702 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.103916.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103916.log.gz 2023-10-16T19:42:32.702 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-16T19:42:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-16T19:42:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103871.log 2023-10-16T19:42:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120499.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116626.log.gz 2023-10-16T19:42:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117174.log 2023-10-16T19:42:32.711 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120499.log.gz 2023-10-16T19:42:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109782.log 2023-10-16T19:42:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117174.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114248.log.gz 2023-10-16T19:42:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109461.log 2023-10-16T19:42:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109782.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117174.log.gz 2023-10-16T19:42:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120891.log 2023-10-16T19:42:32.712 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109782.log.gz 2023-10-16T19:42:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112537.log 2023-10-16T19:42:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110185.log 2023-10-16T19:42:32.713 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109461.log.gz 2023-10-16T19:42:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120891.log.gz 2023-10-16T19:42:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115946.log 2023-10-16T19:42:32.714 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112537.log.gz 2023-10-16T19:42:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110185.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T19:42:32.715 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110185.log.gz 2023-10-16T19:42:32.715 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120545.log 2023-10-16T19:42:32.715 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115946.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113905.log 2023-10-16T19:42:32.715 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115946.log.gz 2023-10-16T19:42:32.716 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115578.log 2023-10-16T19:42:32.716 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120545.log.gz 2023-10-16T19:42:32.716 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116177.log 2023-10-16T19:42:32.716 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112905.log 2023-10-16T19:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113905.log.gz 2023-10-16T19:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T19:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115578.log.gz 2023-10-16T19:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119893.log 2023-10-16T19:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112905.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116177.log.gz 2023-10-16T19:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117220.log 2023-10-16T19:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112905.log.gz 2023-10-16T19:42:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115624.log 2023-10-16T19:42:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119893.log: /var/log/ceph/ceph-client.admin.117220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112901.log 2023-10-16T19:42:32.719 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119893.log.gz 2023-10-16T19:42:32.719 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117220.log.gz 2023-10-16T19:42:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111489.log 2023-10-16T19:42:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118866.log 2023-10-16T19:42:32.720 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2%/var/log/ceph/ceph-client.admin.112901.log: -- replaced with /var/log/ceph/ceph-client.admin.115624.log.gz 2023-10-16T19:42:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119539.log 2023-10-16T19:42:32.721 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112901.log.gz 2023-10-16T19:42:32.721 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111489.log.gz 2023-10-16T19:42:32.721 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118774.log 2023-10-16T19:42:32.722 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.119539.log: gzip 89.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.118866.log.gz-- 2023-10-16T19:42:32.722 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118034.log 2023-10-16T19:42:32.722 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119539.log.gz 2023-10-16T19:42:32.722 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117266.log 2023-10-16T19:42:32.723 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118774.log.gz 2023-10-16T19:42:32.723 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112241.log 2023-10-16T19:42:32.723 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118034.log.gz 2023-10-16T19:42:32.723 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-16T19:42:32.724 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117266.log: /var/log/ceph/ceph-client.admin.112241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113160.log 2023-10-16T19:42:32.724 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117266.log.gz 2023-10-16T19:42:32.724 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112241.log.gz 2023-10-16T19:42:32.724 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118172.log 2023-10-16T19:42:32.725 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113161.log 2023-10-16T19:42:32.725 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113160.log: /var/log/ceph/ceph-client.admin.118172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116580.log 2023-10-16T19:42:32.725 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113160.log.gz 2023-10-16T19:42:32.725 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118172.log.gz 2023-10-16T19:42:32.726 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115993.log 2023-10-16T19:42:32.726 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8%/var/log/ceph/ceph-client.admin.116580.log: -- replaced with /var/log/ceph/ceph-client.admin.113161.log.gz 2023-10-16T19:42:32.726 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117745.log 2023-10-16T19:42:32.727 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115993.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116580.log.gz 2023-10-16T19:42:32.727 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120659.log 2023-10-16T19:42:32.727 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115993.log.gz 2023-10-16T19:42:32.727 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117745.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-16T19:42:32.728 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117312.log 2023-10-16T19:42:32.728 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117745.log.gz 2023-10-16T19:42:32.728 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120659.log.gz 2023-10-16T19:42:32.729 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118958.log 2023-10-16T19:42:32.729 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119847.log 2023-10-16T19:42:32.729 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117312.log: /var/log/ceph/ceph-client.admin.118958.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117312.log.gz 2023-10-16T19:42:32.729 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119847.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118958.log.gz 2023-10-16T19:42:32.730 INFO:teuthology.orchestra.run.smithi029.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-16T19:42:32.730 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119847.log.gz 2023-10-16T19:42:32.730 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115256.log 2023-10-16T19:42:32.730 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116672.log 2023-10-16T19:42:32.731 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109884.log 2023-10-16T19:42:32.731 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115256.log.gz 2023-10-16T19:42:32.731 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116361.log 2023-10-16T19:42:32.732 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116672.log.gz 2023-10-16T19:42:32.732 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112539.log 2023-10-16T19:42:32.732 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-16T19:42:32.732 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116361.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109884.log.gz 2023-10-16T19:42:32.733 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112539.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116361.log.gz 2023-10-16T19:42:32.733 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117988.log 2023-10-16T19:42:32.733 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112539.log.gz 2023-10-16T19:42:32.733 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111259.log 2023-10-16T19:42:32.734 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.117988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112195.log 2023-10-16T19:42:32.734 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117988.log.gz 2023-10-16T19:42:32.734 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111259.log: /var/log/ceph/ceph-client.admin.112195.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111259.log.gz 2023-10-16T19:42:32.734 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112195.log.gz 2023-10-16T19:42:32.735 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118820.log 2023-10-16T19:42:32.735 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119543.log 2023-10-16T19:42:32.735 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118264.log 2023-10-16T19:42:32.736 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118820.log.gz 2023-10-16T19:42:32.736 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.119543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115762.log 2023-10-16T19:42:32.736 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119543.log.gz 2023-10-16T19:42:32.736 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112527.log 2023-10-16T19:42:32.737 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118264.log: /var/log/ceph/ceph-client.admin.115762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111351.log 2023-10-16T19:42:32.737 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118264.log.gz 2023-10-16T19:42:32.737 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115762.log.gz 2023-10-16T19:42:32.737 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112897.log 2023-10-16T19:42:32.738 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111351.log: 88.4%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.112527.log.gz-- 2023-10-16T19:42:32.738 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115532.log 2023-10-16T19:42:32.738 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109514.log 2023-10-16T19:42:32.739 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111351.log.gz 2023-10-16T19:42:32.739 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112897.log.gz 2023-10-16T19:42:32.739 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120123.log 2023-10-16T19:42:32.739 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.109514.log: -- /var/log/ceph/ceph-client.admin.120215.log 2023-10-16T19:42:32.740 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115532.log.gz 2023-10-16T19:42:32.740 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120123.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109514.log.gz 2023-10-16T19:42:32.740 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109932.log 2023-10-16T19:42:32.740 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120215.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120123.log.gz 2023-10-16T19:42:32.741 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120215.log.gz 2023-10-16T19:42:32.741 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109932.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109932.log.gz 2023-10-16T19:42:32.741 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104329.log 2023-10-16T19:42:32.742 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112540.log 2023-10-16T19:42:32.742 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.104329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119709.log 2023-10-16T19:42:32.742 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104329.log.gz 2023-10-16T19:42:32.742 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118590.log 2023-10-16T19:42:32.743 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113275.log 2023-10-16T19:42:32.743 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119709.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112540.log.gz 2023-10-16T19:42:32.743 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117450.log 2023-10-16T19:42:32.743 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119709.log.gz 2023-10-16T19:42:32.744 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113275.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118590.log.gz 2023-10-16T19:42:32.744 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113275.log.gz 2023-10-16T19:42:32.744 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117450.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117450.log.gz 2023-10-16T19:42:32.744 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-16T19:42:32.745 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120169.log 2023-10-16T19:42:32.745 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109376.log 2023-10-16T19:42:32.745 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118218.log 2023-10-16T19:42:32.745 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120169.log.gz 2023-10-16T19:42:32.746 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118218.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109376.log.gz 2023-10-16T19:42:32.746 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118218.log.gz 2023-10-16T19:42:32.746 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112531.log 2023-10-16T19:42:32.747 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116488.log 2023-10-16T19:42:32.747 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116269.log 2023-10-16T19:42:32.747 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116488.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112531.log.gz 2023-10-16T19:42:32.747 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116269.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116488.log.gz 2023-10-16T19:42:32.748 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116269.log.gz 2023-10-16T19:42:32.748 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115900.log 2023-10-16T19:42:32.748 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116898.log 2023-10-16T19:42:32.748 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115900.log: /var/log/ceph/ceph-client.admin.116898.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115900.log.gz 2023-10-16T19:42:32.749 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116898.log.gz 2023-10-16T19:42:32.749 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111919.log 2023-10-16T19:42:32.749 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115670.log 2023-10-16T19:42:32.750 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116944.log 2023-10-16T19:42:32.750 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115670.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111919.log.gz 2023-10-16T19:42:32.750 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115670.log.gz 2023-10-16T19:42:32.750 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116944.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116944.log.gz 2023-10-16T19:42:32.751 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117036.log 2023-10-16T19:42:32.751 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112287.log 2023-10-16T19:42:32.751 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117036.log: /var/log/ceph/ceph-client.admin.112287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117036.log.gz 2023-10-16T19:42:32.751 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112287.log.gz 2023-10-16T19:42:32.752 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118448.log 2023-10-16T19:42:32.752 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112149.log 2023-10-16T19:42:32.752 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115440.log 2023-10-16T19:42:32.753 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112149.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118448.log.gz 2023-10-16T19:42:32.753 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115440.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112149.log.gz 2023-10-16T19:42:32.753 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115440.log.gz 2023-10-16T19:42:32.753 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109588.log 2023-10-16T19:42:32.754 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115302.log 2023-10-16T19:42:32.754 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109588.log: /var/log/ceph/ceph-client.admin.115302.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109588.log.gz 2023-10-16T19:42:32.754 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115302.log.gz 2023-10-16T19:42:32.754 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109734.log 2023-10-16T19:42:32.755 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116085.log 2023-10-16T19:42:32.755 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109734.log: /var/log/ceph/ceph-client.admin.116085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109734.log.gz 2023-10-16T19:42:32.755 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116085.log.gz 2023-10-16T19:42:32.755 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112011.log 2023-10-16T19:42:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119236.log 2023-10-16T19:42:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112011.log: /var/log/ceph/ceph-client.admin.119236.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112011.log.gz 2023-10-16T19:42:32.756 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.119236.log.gz 2023-10-16T19:42:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111873.log 2023-10-16T19:42:32.757 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117588.log 2023-10-16T19:42:32.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111873.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T19:42:32.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117588.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111873.log.gz 2023-10-16T19:42:32.758 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117588.log.gz 2023-10-16T19:42:32.758 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110982.log 2023-10-16T19:42:32.758 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T19:42:32.758 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116039.log 2023-10-16T19:42:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120353.log 2023-10-16T19:42:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116039.log: /var/log/ceph/ceph-client.admin.120353.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116039.log.gz 2023-10-16T19:42:32.759 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120353.log.gz 2023-10-16T19:42:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110277.log 2023-10-16T19:42:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118402.log 2023-10-16T19:42:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110277.log: /var/log/ceph/ceph-client.admin.118402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110277.log.gz 2023-10-16T19:42:32.760 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118402.log.gz 2023-10-16T19:42:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114294.log 2023-10-16T19:42:32.761 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117496.log 2023-10-16T19:42:32.761 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.110982.log.gz 2023-10-16T19:42:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116990.log 2023-10-16T19:42:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117496.log: /var/log/ceph/ceph-client.admin.116990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117496.log.gz 2023-10-16T19:42:32.762 INFO:teuthology.orchestra.run.smithi029.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.114294.log.gz 2023-10-16T19:42:32.762 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116990.log.gz 2023-10-16T19:42:32.763 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115854.log 2023-10-16T19:42:32.763 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117902.log 2023-10-16T19:42:32.763 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115854.log: /var/log/ceph/ceph-client.admin.117902.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115854.log.gz 2023-10-16T19:42:32.763 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117902.log.gz 2023-10-16T19:42:32.764 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115164.log 2023-10-16T19:42:32.764 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111554.log 2023-10-16T19:42:32.764 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115164.log: /var/log/ceph/ceph-client.admin.111554.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115164.log.gz 2023-10-16T19:42:32.764 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119097.log 2023-10-16T19:42:32.765 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111554.log.gz 2023-10-16T19:42:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119097.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119097.log.gz 2023-10-16T19:42:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119939.log 2023-10-16T19:42:32.767 INFO:teuthology.orchestra.run.smithi053.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-16T19:42:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.103871.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103871.log.gz 2023-10-16T19:42:32.767 INFO:teuthology.orchestra.run.smithi053.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-16T19:42:32.772 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-16T19:42:32.789 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111738.log 2023-10-16T19:42:32.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119939.log: /var/log/ceph/ceph-client.admin.111738.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119939.log.gz 2023-10-16T19:42:32.790 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111738.log.gz 2023-10-16T19:42:32.790 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118682.log 2023-10-16T19:42:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97762.log 2023-10-16T19:42:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117542.log 2023-10-16T19:42:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.97762.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118682.log.gz 2023-10-16T19:42:32.791 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97762.log.gz 2023-10-16T19:42:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117542.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117542.log.gz 2023-10-16T19:42:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113529.log 2023-10-16T19:42:32.792 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111692.log 2023-10-16T19:42:32.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113529.log: /var/log/ceph/ceph-client.admin.111692.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113529.log.gz 2023-10-16T19:42:32.793 INFO:teuthology.orchestra.run.smithi029.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-16T19:42:32.793 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111692.log.gz 2023-10-16T19:42:32.793 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120591.log 2023-10-16T19:42:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114156.log 2023-10-16T19:42:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113268.log 2023-10-16T19:42:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114156.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120591.log.gz 2023-10-16T19:42:32.795 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114156.log.gz 2023-10-16T19:42:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118496.log 2023-10-16T19:42:32.795 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116131.log 2023-10-16T19:42:32.795 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113268.log.gz 2023-10-16T19:42:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109980.log 2023-10-16T19:42:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118496.log: /var/log/ceph/ceph-client.admin.116131.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118496.log.gz 2023-10-16T19:42:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109980.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116131.log.gz 2023-10-16T19:42:32.796 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112533.log 2023-10-16T19:42:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111443.log 2023-10-16T19:42:32.797 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109980.log.gz 2023-10-16T19:42:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120077.log 2023-10-16T19:42:32.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111443.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112533.log.gz 2023-10-16T19:42:32.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120077.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111443.log.gz 2023-10-16T19:42:32.798 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113813.log 2023-10-16T19:42:32.798 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.120077.log.gz--verbose 2023-10-16T19:42:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:-- /var/log/ceph/ceph-client.admin.115348.log 2023-10-16T19:42:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113859.log 2023-10-16T19:42:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115348.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113813.log.gz 2023-10-16T19:42:32.799 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113997.log 2023-10-16T19:42:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113859.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115348.log.gz 2023-10-16T19:42:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-16T19:42:32.800 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113859.log.gz 2023-10-16T19:42:32.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114888.log 2023-10-16T19:42:32.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.1.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113997.log.gz 2023-10-16T19:42:32.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.114888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114888.log.gz 2023-10-16T19:42:32.801 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117128.log 2023-10-16T19:42:32.801 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113713.log 2023-10-16T19:42:32.802 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109830.log 2023-10-16T19:42:32.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117128.log: /var/log/ceph/ceph-client.admin.113713.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117128.log.gz 2023-10-16T19:42:32.802 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113713.log.gz 2023-10-16T19:42:32.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110139.log 2023-10-16T19:42:32.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116718.log 2023-10-16T19:42:32.803 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3%/var/log/ceph/ceph-client.admin.110139.log: -- replaced with /var/log/ceph/ceph-client.admin.109830.log.gz 2023-10-16T19:42:32.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116718.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110139.log.gz 2023-10-16T19:42:32.804 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116718.log.gz 2023-10-16T19:42:32.804 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120453.log 2023-10-16T19:42:32.804 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111784.log 2023-10-16T19:42:32.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114202.log 2023-10-16T19:42:32.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111784.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120453.log.gz 2023-10-16T19:42:32.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111784.log.gz 2023-10-16T19:42:32.805 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114202.log.gz 2023-10-16T19:42:32.805 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120726.log 2023-10-16T19:42:32.806 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120801.log 2023-10-16T19:42:32.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log 2023-10-16T19:42:32.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120801.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120726.log.gz 2023-10-16T19:42:32.807 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113951.log 2023-10-16T19:42:32.807 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120801.log.gz 2023-10-16T19:42:32.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119306.log 2023-10-16T19:42:32.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113951.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114064.log.gz 2023-10-16T19:42:32.808 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113951.log.gz 2023-10-16T19:42:32.808 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119306.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119306.log.gz 2023-10-16T19:42:32.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113483.log 2023-10-16T19:42:32.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115394.log 2023-10-16T19:42:32.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109688.log 2023-10-16T19:42:32.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115394.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113483.log.gz 2023-10-16T19:42:32.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109688.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115394.log.gz 2023-10-16T19:42:32.810 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109688.log.gz 2023-10-16T19:42:32.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117404.log 2023-10-16T19:42:32.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112906.log 2023-10-16T19:42:32.810 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117404.log: /var/log/ceph/ceph-client.admin.112906.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117404.log.gz 2023-10-16T19:42:32.811 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112906.log.gz 2023-10-16T19:42:32.811 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119663.log 2023-10-16T19:42:32.811 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112530.log 2023-10-16T19:42:32.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113575.log 2023-10-16T19:42:32.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119663.log.gz 2023-10-16T19:42:32.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112530.log.gz 2023-10-16T19:42:32.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114436.log 2023-10-16T19:42:32.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118544.log 2023-10-16T19:42:32.813 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113575.log.gz 2023-10-16T19:42:32.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115210.log 2023-10-16T19:42:32.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118544.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114436.log.gz 2023-10-16T19:42:32.814 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7%/var/log/ceph/ceph-client.admin.115210.log: -- replaced with /var/log/ceph/ceph-client.admin.118544.log.gz 2023-10-16T19:42:32.814 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115210.log.gz 2023-10-16T19:42:32.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104211.log 2023-10-16T19:42:32.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118636.log 2023-10-16T19:42:32.815 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.104211.log: /var/log/ceph/ceph-client.admin.118636.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104211.log.gz 2023-10-16T19:42:32.815 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118636.log.gz 2023-10-16T19:42:32.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120407.log 2023-10-16T19:42:32.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114110.log 2023-10-16T19:42:32.816 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120407.log: /var/log/ceph/ceph-client.admin.114110.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120407.log.gz 2023-10-16T19:42:32.816 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114110.log.gz 2023-10-16T19:42:32.816 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118310.log 2023-10-16T19:42:32.817 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113667.log 2023-10-16T19:42:32.817 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116806.log 2023-10-16T19:42:32.817 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118310.log.gz 2023-10-16T19:42:32.817 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116806.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113667.log.gz 2023-10-16T19:42:32.818 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116806.log.gz 2023-10-16T19:42:32.818 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110231.log 2023-10-16T19:42:32.818 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113276.log 2023-10-16T19:42:32.819 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110231.log: /var/log/ceph/ceph-client.admin.113276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110231.log.gz 2023-10-16T19:42:32.819 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113276.log.gz 2023-10-16T19:42:32.819 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112103.log 2023-10-16T19:42:32.819 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117652.log 2023-10-16T19:42:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115808.log 2023-10-16T19:42:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117652.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112103.log.gz 2023-10-16T19:42:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115808.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117652.log.gz 2023-10-16T19:42:32.820 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115808.log.gz 2023-10-16T19:42:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111305.log 2023-10-16T19:42:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110093.log 2023-10-16T19:42:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111305.log: /var/log/ceph/ceph-client.admin.110093.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111305.log.gz 2023-10-16T19:42:32.821 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110093.log.gz 2023-10-16T19:42:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120261.log 2023-10-16T19:42:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111965.log 2023-10-16T19:42:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112333.log 2023-10-16T19:42:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111965.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120261.log.gz 2023-10-16T19:42:32.823 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112333.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111965.log.gz 2023-10-16T19:42:32.823 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112333.log.gz 2023-10-16T19:42:32.823 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117358.log 2023-10-16T19:42:32.824 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111600.log 2023-10-16T19:42:32.824 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116315.log 2023-10-16T19:42:32.824 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111600.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117358.log.gz 2023-10-16T19:42:32.824 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111600.log.gz 2023-10-16T19:42:32.825 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116315.log.gz 2023-10-16T19:42:32.825 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113267.log 2023-10-16T19:42:32.825 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112532.log 2023-10-16T19:42:32.825 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120307.log 2023-10-16T19:42:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112532.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113267.log.gz 2023-10-16T19:42:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112532.log.gz 2023-10-16T19:42:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109267.log 2023-10-16T19:42:32.827 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120307.log.gz 2023-10-16T19:42:32.827 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118126.log 2023-10-16T19:42:32.827 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109267.log: /var/log/ceph/ceph-client.admin.118126.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109267.log.gz 2023-10-16T19:42:32.827 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118126.log.gz 2023-10-16T19:42:32.828 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115118.log 2023-10-16T19:42:32.828 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119004.log 2023-10-16T19:42:32.828 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119050.log 2023-10-16T19:42:32.828 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119004.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115118.log.gz 2023-10-16T19:42:32.829 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119050.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119004.log.gz 2023-10-16T19:42:32.829 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119050.log.gz 2023-10-16T19:42:32.829 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116534.log 2023-10-16T19:42:32.830 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118356.log 2023-10-16T19:42:32.830 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116534.log: /var/log/ceph/ceph-client.admin.118356.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116534.log.gz 2023-10-16T19:42:32.830 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118356.log.gz 2023-10-16T19:42:32.830 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119190.log 2023-10-16T19:42:32.831 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112900.log 2023-10-16T19:42:32.831 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119190.log: /var/log/ceph/ceph-client.admin.112900.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119190.log.gz 2023-10-16T19:42:32.831 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112900.log.gz 2023-10-16T19:42:32.831 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112898.log 2023-10-16T19:42:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118080.log 2023-10-16T19:42:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112898.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-16T19:42:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118080.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112898.log.gz 2023-10-16T19:42:32.832 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118080.log.gz 2023-10-16T19:42:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118728.log 2023-10-16T19:42:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119801.log 2023-10-16T19:42:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118728.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118728.log.gz 2023-10-16T19:42:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112057.log 2023-10-16T19:42:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119801.log: 88.4%/var/log/ceph/ceph-client.admin.112057.log: -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz 2023-10-16T19:42:32.834 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112057.log.gz 2023-10-16T19:42:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109634.log 2023-10-16T19:42:32.835 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112908.log 2023-10-16T19:42:32.835 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109634.log: /var/log/ceph/ceph-client.admin.112908.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109634.log.gz 2023-10-16T19:42:32.835 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112908.log.gz 2023-10-16T19:42:32.835 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114896.log 2023-10-16T19:42:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111397.log 2023-10-16T19:42:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.114896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114896.log.gz 2023-10-16T19:42:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111397.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111397.log.gz 2023-10-16T19:42:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119755.log 2023-10-16T19:42:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110026.log 2023-10-16T19:42:32.837 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119755.log: /var/log/ceph/ceph-client.admin.110026.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119755.log.gz 2023-10-16T19:42:32.837 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110026.log.gz 2023-10-16T19:42:32.838 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116852.log 2023-10-16T19:42:32.838 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113115.log 2023-10-16T19:42:32.838 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116852.log: /var/log/ceph/ceph-client.admin.113115.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116852.log.gz 2023-10-16T19:42:32.838 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113115.log.gz 2023-10-16T19:42:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-16T19:42:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117699.log 2023-10-16T19:42:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.117699.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117699.log.gz 2023-10-16T19:42:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117812.log 2023-10-16T19:42:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117812.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117812.log.gz 2023-10-16T19:42:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103915.log 2023-10-16T19:42:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.103915.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.103915.log.gz 2023-10-16T19:42:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116223.log 2023-10-16T19:42:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116223.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116223.log.gz 2023-10-16T19:42:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119144.log 2023-10-16T19:42:32.841 INFO:teuthology.orchestra.run.smithi029.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-16T19:42:32.842 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119144.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119144.log.gz 2023-10-16T19:42:32.842 INFO:teuthology.orchestra.run.smithi053.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-16T19:42:33.044 INFO:teuthology.orchestra.run.smithi029.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-16T19:42:33.330 INFO:teuthology.orchestra.run.smithi053.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-16T19:42:33.352 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-16T19:42:33.353 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-16T19:42:33.364 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-16T19:42:33.385 INFO:teuthology.orchestra.run.smithi053.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-16T19:42:33.387 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-16T19:42:33.389 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-10-16T19:42:33.389 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m0.741s 2023-10-16T19:42:33.389 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m3.033s 2023-10-16T19:42:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m0.248s 2023-10-16T19:42:33.394 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-16T19:42:33.421 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-16T19:42:33.422 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-10-16T19:42:33.423 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m0.750s 2023-10-16T19:42:33.423 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m2.961s 2023-10-16T19:42:33.423 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.114s 2023-10-16T19:42:33.424 INFO:tasks.ceph:Archiving logs... 2023-10-16T19:42:33.425 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi029/log 2023-10-16T19:42:33.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T19:42:34.012 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi053/log 2023-10-16T19:42:34.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T19:42:34.488 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T19:42:34.498 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T19:42:34.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T19:42:34.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T19:42:34.596 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T19:42:34.606 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T19:42:34.606 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:42:34.609 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:42:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-10-16T19:42:34.627 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-10-16T19:42:34.628 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:42:34.629 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-10-16T19:42:34.629 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +124us[ +127us] +/- 95ms 2023-10-16T19:42:34.629 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -2430us[-2427us] +/- 65ms 2023-10-16T19:42:34.629 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +2865us[+2868us] +/- 78ms 2023-10-16T19:42:34.630 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:42:34.631 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:42:34.632 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-10-16T19:42:34.632 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +142us[ +142us] +/- 95ms 2023-10-16T19:42:34.632 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -2432us[-2423us] +/- 65ms 2023-10-16T19:42:34.633 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +2871us[+2871us] +/- 78ms 2023-10-16T19:42:34.633 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:42:34.634 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T19:42:34.644 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T19:42:34.644 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T19:42:34.675 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T19:42:34.779 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T19:42:34.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:42:34.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:42:34.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:42:34.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:42:34.951 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T19:42:34.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T19:42:35.000 INFO:teuthology.task.internal:Duration was 921.120112 seconds 2023-10-16T19:42:35.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T19:42:35.042 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T19:42:35.042 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T19:42:35.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T19:42:35.091 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:42:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:42:35.571 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T19:42:35.572 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2023-10-16T19:42:35.572 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T19:42:35.597 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-10-16T19:42:35.597 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T19:42:35.621 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T19:42:35.622 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T19:42:35.639 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T19:42:35.703 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T19:42:35.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T19:42:35.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T19:42:35.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T19:42:35.834 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T19:42:35.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T19:42:35.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T19:42:35.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T19:42:35.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:42:35.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:42:35.929 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2023-10-16T19:42:35.957 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-10-16T19:42:35.971 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:42:36.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:42:36.001 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:42:36.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:42:36.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T19:42:36.038 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T19:42:36.039 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi029 2023-10-16T19:42:36.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T19:42:36.081 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071/remote/smithi053 2023-10-16T19:42:36.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T19:42:36.120 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T19:42:36.120 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T19:42:36.123 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T19:42:36.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T19:42:36.182 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T19:42:36.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T19:42:36.229 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T19:42:36.229 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T19:42:36.231 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T19:42:36.246 INFO:teuthology.orchestra.run.smithi029.stdout: 262307 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 16 19:42 /home/ubuntu/cephtest 2023-10-16T19:42:36.247 INFO:teuthology.orchestra.run.smithi029.stdout: 393241 4 d--------- 2 ubuntu ubuntu 4096 Oct 16 19:41 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:42:36.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:42:36.248 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-16T19:42:36.248 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-16T19:42:36.249 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T19:42:36.256 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T19:42:36.267 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T19:42:36.309 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi029 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T19:42:36.309 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T19:42:36.317 INFO:teuthology.orchestra.run.smithi053.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 19:42 /home/ubuntu/cephtest 2023-10-16T19:42:36.347 DEBUG:teuthology.nuke:shortname: smithi029 2023-10-16T19:42:36.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:42:36.373 DEBUG:teuthology.nuke:shortname: smithi053 2023-10-16T19:42:36.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:42:36.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:21:42.649852', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:42:36.395 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:21:42.648263', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:42:36.446 INFO:teuthology.orchestra.console.smithi053:Power off 2023-10-16T19:42:36.507 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:42:36.525 INFO:teuthology.orchestra.console.smithi029:Power off 2023-10-16T19:42:36.526 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:42:36.539 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-10-16T19:42:36.540 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:36.554 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-10-16T19:42:36.555 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:36.580 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-10-16T19:42:36.585 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-16T19:42:40.581 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:40.590 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:40.693 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-10-16T19:42:40.700 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-16T19:42:44.695 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:44.702 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:42:44.805 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-10-16T19:42:44.812 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-16T19:42:44.907 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-10-16T19:42:44.914 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-10-16T19:42:45.018 INFO:teuthology.run:Summary data: description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 921.1201121807098 failure_reason: 'Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8dd396d590d24ac4936a21b04456858e status: fail success: false 2023-10-16T19:42:45.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:42:45.095 INFO:teuthology.run:FAIL